2023:Separation Mockup - RP - Revision history

Rpatton: Final Final // Edit via Wikitext Extension for VSCode

2024-01-15T16:04:22Z

Final Final // Edit via Wikitext Extension for VSCode

← Older revision		Revision as of 11:04, 15 January 2024
Line 1:		Line 1:
	<blockquote>		<blockquote>
	Separation is the process of taking an unorganized ~~batch~~ of loose pages and organizing them into document folders. This is done so Grooper can later assign a '''Document Type''' to each document folder in a process known as Classification.		Separation is the process of taking an unorganized '''Batch''' of loose pages and organizing them into document folders. This is done so Grooper can later assign a '''Document Type''' to each document folder in a process known as Classification.
	</blockquote>		</blockquote>

Line 13:		Line 13:
	# Organize		# Organize
	#* '''This is where you separate the pages in the Batch into individual document folders. '''		#* '''This is where you separate the pages in the Batch into individual document folders. '''
	#* After the pages have been separated, then the document folders ~~to be~~ Classified.		#* After the pages have been separated, then the document folders are Classified.
	# Collect		# Collect
	#* Data is extracted from the documents.		#* Data is extracted from the documents.
	# Deliver		# Deliver
	#* ~~Data~~ is exported from Grooper to the destination of your choice.		#* The extracted data is exported from Grooper to the destination of your choice.

	=== What is Separation? ===		=== What is Separation? ===
Line 25:		Line 25:
	Now, let's say you need to look for a specific type of document in the box. It would be difficult to just go through all of the loose pages to find the documents you are looking for. It's difficult to determine where one document ends and another begins.		Now, let's say you need to look for a specific type of document in the box. It would be difficult to just go through all of the loose pages to find the documents you are looking for. It's difficult to determine where one document ends and another begins.

	So, you take those pages and you sort them into folders. Each folder contains one document which is comprised of one or more pages. Now, it is much easier to tell the documents apart.		So, you take those pages and you sort them into folders. Each folder contains one document which is comprised of one or more pages. Now, it is much easier to tell the documents apart!

	This is how separation works. It is organizing the pages so that Grooper can identify one document from another.		This is how separation works. It is organizing the pages so that Grooper can identify one document from another.
Line 55:		Line 55:
	=== How do we separate? ===		=== How do we separate? ===

	Separation is a process that happens as part of a '''Batch Process'''. You will need to add a '''Separate Step''' to your '''Batch Process''' and configure it with a '''''Separation Provider'''''. A '''''Separation Provider''''' is a property that tells Grooper how we want to run separation on the pages. For example, we might want to separate every four pages ~~or we~~ could separate every time Grooper finds a title at the top of a page.		Separation is a process that happens as part of a '''Batch Process'''. You will need to add a '''Separate Step''' to your '''Batch Process''' and configure it with a '''''Separation Provider'''''. A '''''Separation Provider''''' is a property that tells Grooper how we want to run separation on the pages. For example, if each of our documents are four pages each, we might want to tell Grooper to separate every four pages. We could also separate every time Grooper finds a title at the top of a page.

	There are 8 different '''''Separation Providers''''' you can configure. Here we are going to give a brief explanation of the provider, but for a deeper understanding you will need to visit each of their articles individually:		There are 8 different '''''Separation Providers''''' you can configure. Here we are going to give a brief explanation of the provider, but for a deeper understanding you will need to visit each of their articles individually:

	* [[Change in Value Separation]] - Grooper will separate when it detects a value (that you configure) changes from one page to another, ~~like~~ an invoice number ~~for example~~.		* [[Change in Value Separation]] - Grooper will separate when it detects a value (that you configure) changes from one page to another, such as an invoice number.
	* [[Control Sheet Separation]] - Grooper will separate at the point it detects a "Control Sheet".		* [[Control Sheet Separation]] - During the scanning process, you can make sure to place a "Control Sheet" in between each document. Grooper will separate at the point it detects a "Control Sheet".
	* [[EPI Separation]] - Grooper will separate based on extracted page numbers and will detect a new document when the page number resets or when a lower page number comes up in the '''Batch'''.		* [[EPI Separation]] - Grooper will separate based on extracted page numbers and will detect a new document when the page number resets or when a lower page number comes up in the '''Batch'''.
	* [[ESP Auto Separation]] - One of the more complicated separation techniques involving Lexical training.		* [[ESP Auto Separation]] - One of the more complicated separation techniques involving Lexical training.
Line 70:		Line 70:
	=== Text-Based vs. Scan Supported ===		=== Text-Based vs. Scan Supported ===

	It is important to note that the majority of '''''Separation Providers''''' are "Text-Based" providers. That means they require readable data from your pages to work. OCR must be performed prior to any Text-Based provider being used. The following are Text-Based providers:		It is important to note that the majority of '''''Separation Providers''''' are "Text-Based" providers. That means they require readable data from your pages to work. OCR must be performed prior to any Text-Based provider being used. The following are '''Text-Based''' providers:

	* Change in Value Separation		* Change in Value Separation
Line 77:		Line 77:
	* Pattern-Based Separation		* Pattern-Based Separation

	"Scan Supported" providers do not need readable data to work. That means it is possible to run these providers as early as when you ~~scan~~ in pages. OCR is not required prior to running a Scan Supported provider. The following are Scan Supported Providers:		"Scan Supported" providers do not need readable data to work. That means it is possible to run these providers as early as when you are scanning in physical pages. OCR is not required prior to running a Scan Supported provider. The following are '''Scan Supported''' Providers:

	* Control Sheet Separation		* Control Sheet Separation
	* Event-Based Separation		* Event-Based Separation

Rpatton: Final // Edit via Wikitext Extension for VSCode

2024-01-15T15:53:01Z

Final // Edit via Wikitext Extension for VSCode

← Older revision		Revision as of 10:53, 15 January 2024
Line 8:		Line 8:

	# Acquire		# Acquire
	#* ~~This involves bringing in a '''Batch'''~~ into Grooper~~. Usually, documents~~ are ~~scanned~~ into ~~Grooper and the initial~~ '''Batch''' ~~looks like just one long document with individual pages~~.		#* Either physical pages are scanned into Grooper or digital files are imported into a '''Batch''' in Grooper.
	# Condition		# Condition
	#* This involves running Recognize and OCR on the '''Batch''' to allow Grooper to read the text and clean up the ~~document~~ if needed.		#* This involves running Recognize and OCR on the '''Batch''' to allow Grooper to read the text and clean up the pages if needed.
	# Organize		# Organize
	#* '''This is where you separate the ~~documents~~ in the Batch into individual document folders. '''		#* '''This is where you separate the pages in the Batch into individual document folders. '''
	#* After the ~~documents~~ have been separated, then the ~~documents need~~ to ~~go through Classification~~.		#* After the pages have been separated, then the document folders to be Classified.
	# Collect		# Collect
	#* Data is extracted from the documents.		#* Data is extracted from the documents.
Line 21:		Line 21:
	=== What is Separation? ===		=== What is Separation? ===

	Imagine you have a bunch of pages and you put them in a box. This is similar to importing ~~documents~~ into a '''Batch'''.		Imagine you have a bunch of pages and you put them in a box. This is similar to importing pages into a '''Batch'''.

	Now, let's say you need to look for a specific type of document in the box. It would be difficult to just go through all of the loose pages to find the documents you are looking for. It's difficult to determine where one document ends and another begins.		Now, let's say you need to look for a specific type of document in the box. It would be difficult to just go through all of the loose pages to find the documents you are looking for. It's difficult to determine where one document ends and another begins.
Line 27:		Line 27:
	So, you take those pages and you sort them into folders. Each folder contains one document which is comprised of one or more pages. Now, it is much easier to tell the documents apart.		So, you take those pages and you sort them into folders. Each folder contains one document which is comprised of one or more pages. Now, it is much easier to tell the documents apart.

	This is how separation works. It is organizing the ~~documents~~ so that Grooper can identify one document from another.		This is how separation works. It is organizing the pages so that Grooper can identify one document from another.

	[[File:2023 Separation Mockup 01 About 01 When 01.png\|500px\|center]]		[[File:2023 Separation Mockup 01 About 01 When 01.png\|500px\|center]]

	=== Why do we need to separate ~~documents~~? ===		=== Why do we need to separate? ===

	The point of ~~separating documents~~ is ~~ultimately~~ so Grooper can later classify ~~them~~. Classification is the process of assigning '''Document Types''' to the document folders. Classification can only be applied to a document folder, not loose pages. So, even if you are only bringing in a single document into Grooper, you would need to make sure the loose pages are contained within a document folder in order to classify ~~the document~~.		The point of separation is so Grooper can later classify the documents. Classification is the process of assigning '''Document Types''' to the document folders. Classification can only be applied to a document folder, not loose pages. So, even if you are only bringing in a single document into Grooper, you would need to make sure the loose pages are contained within a document folder in order to classify.

	The point of Classification is to let Grooper know what to do with the documents. For more information on Classification, please take a look at our [[Classification]] wiki article.		The point of Classification is to let Grooper know what to do with the documents. For more information on Classification, please take a look at our [[Classification]] wiki article.

	=== When do we need to separate ~~documents~~? ===		=== When do we need to separate? ===

	There are two ways to bring documents into Grooper. You can scan physical copies of ~~documents~~ directly into a '''Batch''' or you can import digital documents into Grooper. After you have your documents in your '''Batch''', whether or not you need to separate depends on whether your documents are "Discreet" or "Packeted" documents.		There are two ways to bring documents into Grooper. You can scan physical copies of the pages directly into a '''Batch''' or you can import digital documents into Grooper. After you have your documents in your '''Batch''', whether or not you need to separate depends on whether your documents are "Discreet" or "Packeted" documents.


Line 49:		Line 49:
	<br>Sometimes when you import digital documents, each file might contain multiple documents. These are considered "Packeted" documents. In this case, Grooper will bring the file in as a document folder, but it will need to be separated so that each document is contained within its own document folder.		<br>Sometimes when you import digital documents, each file might contain multiple documents. These are considered "Packeted" documents. In this case, Grooper will bring the file in as a document folder, but it will need to be separated so that each document is contained within its own document folder.

	When you scan physical ~~documents~~ into Grooper, they come into the '''Batch''' as loose pages. Scanned ~~documents~~ will ALWAYS need to be separated.		When you scan physical pages into Grooper, they come into the '''Batch''' as loose pages. Scanned pages will ALWAYS need to be separated.

	[[File:2023 Separation Mockup 01 About 01 When 02.png\|center\|800px]]		[[File:2023 Separation Mockup 01 About 01 When 02.png\|center\|800px]]


	~~<!--~~
	When you bring documents into Grooper, many times they will come in as just a group of pages. If you scan the documents, they come in the order the pages were scanned. Odds are that when you bring in a '''Batch''', you will be bringing in more than just one document. When Grooper gets a fresh set of pages, it has no way to know what the documents are, where one document starts and/or stops, or how they should be organized.

	We must find a way to tell Grooper where a document begins and ends. Once Grooper can determine that, it can separate the '''Batch''' into document folders and be able to tell one document from another.

	There are some times you need to separate document, and others that you don't. How do you tell the difference? Essentially the difference lies in whether or not your documents are already separated or not.

	*If you bring in a '''Batch''' that is essentially just a bunch of loose pages and not organized by document, then you will need to separate the pages into document folders.
	*If you bring in a '''Batch''' that already has individual documents contained in their own document folders, then there is no need to perform separation.
	~~-->~~

	=== How do we separate? ===		=== How do we separate? ===

	Separation is a process that happens as part of a '''Batch Process'''. You will need to add a '''Separate Step''' to your '''Batch Process''' and configure it with a '''''Separation Provider'''''.		Separation is a process that happens as part of a '''Batch Process'''. You will need to add a '''Separate Step''' to your '''Batch Process''' and configure it with a '''''Separation Provider'''''. A '''''Separation Provider''''' is a property that tells Grooper how we want to run separation on the pages. For example, we might want to separate every four pages or we could separate every time Grooper finds a title at the top of a page.

	There are 8 different '''''Separation Providers''''' you can configure. Here we are going to give a brief explanation of the provider, but for a deeper understanding you will need to visit each of their articles individually:		There are 8 different '''''Separation Providers''''' you can configure. Here we are going to give a brief explanation of the provider, but for a deeper understanding you will need to visit each of their articles individually:

	* [[Change in Value Separation]] - Grooper will separate when it detects a value (that you configure) changes from one page to another, like an invoice number for example.		* [[Change in Value Separation]] - Grooper will separate when it detects a value (that you configure) changes from one page to another, like an invoice number for example.
	* [[Control Sheet Separation]] - Grooper will separate ~~a document~~ at the point it detects a "Control Sheet".		* [[Control Sheet Separation]] - Grooper will separate at the point it detects a "Control Sheet".
	* [[EPI Separation]] - Grooper will separate based on extracted page numbers and will detect a new document when the page number resets or when a lower page number comes up in the '''Batch'''.		* [[EPI Separation]] - Grooper will separate based on extracted page numbers and will detect a new document when the page number resets or when a lower page number comes up in the '''Batch'''.
	* [[ESP Auto Separation]] - One of the more complicated separation techniques involving Lexical training.		* [[ESP Auto Separation]] - One of the more complicated separation techniques involving Lexical training.
Line 82:		Line 70:
	=== Text-Based vs. Scan Supported ===		=== Text-Based vs. Scan Supported ===

	It is important to note that the majority of '''''Separation Providers''''' are "Text-Based" providers. That means they require readable data from ~~a document~~ to work. OCR must be performed ~~on documentation~~ prior to any Text-Based provider being used. The following are Text-Based providers:		It is important to note that the majority of '''''Separation Providers''''' are "Text-Based" providers. That means they require readable data from your pages to work. OCR must be performed prior to any Text-Based provider being used. The following are Text-Based providers:

	* Change in Value Separation		* Change in Value Separation
Line 89:		Line 77:
	* Pattern-Based Separation		* Pattern-Based Separation

	"Scan Supported" providers do not need readable data ~~from documents~~ to work. That means it is possible to run these providers as early as when you scan in ~~documents~~. OCR is not required prior to running a Scan Supported provider. The following are Scan Supported Providers:		"Scan Supported" providers do not need readable data to work. That means it is possible to run these providers as early as when you scan in pages. OCR is not required prior to running a Scan Supported provider. The following are Scan Supported Providers:

	* Control Sheet Separation		* Control Sheet Separation
	* Event-Based Separation		* Event-Based Separation

Rpatton at 15:14, 15 January 2024

2024-01-15T15:14:48Z

← Older revision		Revision as of 10:14, 15 January 2024
Line 40:		Line 40:

	There are two ways to bring documents into Grooper. You can scan physical copies of documents directly into a '''Batch''' or you can import digital documents into Grooper. After you have your documents in your '''Batch''', whether or not you need to separate depends on whether your documents are "Discreet" or "Packeted" documents.		There are two ways to bring documents into Grooper. You can scan physical copies of documents directly into a '''Batch''' or you can import digital documents into Grooper. After you have your documents in your '''Batch''', whether or not you need to separate depends on whether your documents are "Discreet" or "Packeted" documents.


	'''Discreet Documents'''		'''Discreet Documents'''
	<br>"Discreet" documents are digital documents where each file containes one document. When a file is imported into Grooper, it is automatically put in its own document folder. If the file only contains one individual document, then it will already be in its own document folder and there is no need to separate.		<br>"Discreet" documents are digital documents where each file containes one document. When a file is imported into Grooper, it is automatically put in its own document folder. If the file only contains one individual document, then it will already be in its own document folder and there is no need to separate.


	'''Packeted Documents'''		'''Packeted Documents'''

Rpatton at 15:13, 15 January 2024

2024-01-15T15:13:52Z

← Older revision		Revision as of 10:13, 15 January 2024
Line 49:		Line 49:
	When you scan physical documents into Grooper, they come into the '''Batch''' as loose pages. Scanned documents will ALWAYS need to be separated.		When you scan physical documents into Grooper, they come into the '''Batch''' as loose pages. Scanned documents will ALWAYS need to be separated.

	[[File:2023 Separation Mockup 01 About 01 When 02.png\|center]]		[[File:2023 Separation Mockup 01 About 01 When 02.png\|center\|800px]]

Rpatton: Flowchart Resize // Edit via Wikitext Extension for VSCode

2024-01-15T15:12:39Z

Flowchart Resize // Edit via Wikitext Extension for VSCode

← Older revision		Revision as of 10:12, 15 January 2024
Line 49:		Line 49:
	When you scan physical documents into Grooper, they come into the '''Batch''' as loose pages. Scanned documents will ALWAYS need to be separated.		When you scan physical documents into Grooper, they come into the '''Batch''' as loose pages. Scanned documents will ALWAYS need to be separated.

	[[File:2023 Separation Mockup 01 About 01 When 02.png\|center~~\|500px~~]]		[[File:2023 Separation Mockup 01 About 01 When 02.png\|center]]

Rpatton: Flow Chart // Edit via Wikitext Extension for VSCode

2024-01-15T15:11:53Z

Flow Chart // Edit via Wikitext Extension for VSCode

← Older revision		Revision as of 10:11, 15 January 2024
Line 1:		Line 1:
	<blockquote>		<blockquote>
	Separation is the process of taking an unorganized batch of loose pages and organizing them into document folders. This is done so Grooper can later assign a '''Document Type''' to each document in a process known as Classification.		Separation is the process of taking an unorganized batch of loose pages and organizing them into document folders. This is done so Grooper can later assign a '''Document Type''' to each document folder in a process known as Classification.
	</blockquote>		</blockquote>

Line 12:		Line 12:
	#* This involves running Recognize and OCR on the '''Batch''' to allow Grooper to read the text and clean up the document if needed.		#* This involves running Recognize and OCR on the '''Batch''' to allow Grooper to read the text and clean up the document if needed.
	# Organize		# Organize
	#* '''This is where you separate the documents in the Batch into individual folders. '''		#* '''This is where you separate the documents in the Batch into individual document folders. '''
	#* After the documents have been separated, then the documents need to go through Classification.		#* After the documents have been separated, then the documents need to go through Classification.
	# Collect		# Collect
Line 21:		Line 21:
	=== What is Separation? ===		=== What is Separation? ===

	Imagine you have a ~~box~~ of ~~documents, but they are all just in a box. You might want to go through that box and organize them. So, first you get a filing cabinet~~ and you put ~~all of the pages~~ in ~~that filing cabinet~~. This is similar to importing documents into a '''Batch'''.		Imagine you have a bunch of pages and you put them in a box. This is similar to importing documents into a '''Batch'''.

	Now, let's say you need to look for a specific type of document in the ~~file cabinet~~. It would be difficult to just go through all of the loose pages to find the documents. It's difficult to determine where one document ends and another begins~~. So, you take those pages and you sort them into folders. Each folder contains one document which is comprised of one or more pages. Now, it is much easier to tell the documents apart~~.		Now, let's say you need to look for a specific type of document in the box. It would be difficult to just go through all of the loose pages to find the documents you are looking for. It's difficult to determine where one document ends and another begins.

	This is ~~essentially~~ how separation works. It is organizing the documents so that Grooper can identify one document from another.		So, you take those pages and you sort them into folders. Each folder contains one document which is comprised of one or more pages. Now, it is much easier to tell the documents apart.

			This is how separation works. It is organizing the documents so that Grooper can identify one document from another.

	[[File:2023 Separation Mockup 01 About 01 When 01.png\|500px\|center]]		[[File:2023 Separation Mockup 01 About 01 When 01.png\|500px\|center]]
Line 31:		Line 33:
	=== Why do we need to separate documents? ===		=== Why do we need to separate documents? ===

	~~When you bring~~ documents ~~into~~ Grooper, ~~many times they will come~~ in ~~as just~~ a ~~group of~~ pages. ~~If you scan~~ the documents, ~~they come in the order the pages were scanned~~. ~~Odds~~ are ~~that when~~ you ~~bring~~ in a '''Batch''', you ~~will be bringing in more than just~~ one document. When Grooper ~~gets a fresh set of pages~~, it ~~has~~ no ~~way~~ to ~~know what the~~ documents are, ~~where one~~ document ~~starts and/or stops~~, ~~or how~~ they ~~should~~ be ~~organized~~.		The point of separating documents is ultimately so Grooper can later classify them. Classification is the process of assigning '''Document Types''' to the document folders. Classification can only be applied to a document folder, not loose pages. So, even if you are only bringing in a single document into Grooper, you would need to make sure the loose pages are contained within a document folder in order to classify the document.

			The point of Classification is to let Grooper know what to do with the documents. For more information on Classification, please take a look at our [[Classification]] wiki article.

			=== When do we need to separate documents? ===

			There are two ways to bring documents into Grooper. You can scan physical copies of documents directly into a '''Batch''' or you can import digital documents into Grooper. After you have your documents in your '''Batch''', whether or not you need to separate depends on whether your documents are "Discreet" or "Packeted" documents.

			'''Discreet Documents'''
			<br>"Discreet" documents are digital documents where each file containes one document. When a file is imported into Grooper, it is automatically put in its own document folder. If the file only contains one individual document, then it will already be in its own document folder and there is no need to separate.

			'''Packeted Documents'''
			<br>Sometimes when you import digital documents, each file might contain multiple documents. These are considered "Packeted" documents. In this case, Grooper will bring the file in as a document folder, but it will need to be separated so that each document is contained within its own document folder.

			When you scan physical documents into Grooper, they come into the '''Batch''' as loose pages. Scanned documents will ALWAYS need to be separated.

			[[File:2023 Separation Mockup 01 About 01 When 02.png\|center\|500px]]

	We must find a way to tell Grooper where a document begins and ends. Once Grooper can determine that, it can separate the '''Batch''' into '''Folders''' and be able to tell one document from another. This is important to be able to later assign '''Document Types''' to documents in a process called Classification.

	~~To tell~~ Grooper ~~how~~ documents ~~need to be separated~~, ~~we configure~~ '''~~''Separation Providers''~~''' to ~~automatically separate~~ documents ~~through a '''Batch Process'''~~.		<!--
			When you bring documents into Grooper, many times they will come in as just a group of pages. If you scan the documents, they come in the order the pages were scanned. Odds are that when you bring in a '''Batch''', you will be bringing in more than just one document. When Grooper gets a fresh set of pages, it has no way to know what the documents are, where one document starts and/or stops, or how they should be organized.

	~~=== When do we need~~ to separate ~~documents? ===~~		We must find a way to tell Grooper where a document begins and ends. Once Grooper can determine that, it can separate the '''Batch''' into document folders and be able to tell one document from another.

	There are some times you need to separate document, and others that you don't. How do you tell the difference? Essentially the difference lies in whether or not your documents are already separated or not.		There are some times you need to separate document, and others that you don't. How do you tell the difference? Essentially the difference lies in whether or not your documents are already separated or not.

	*If you bring in a '''Batch''' that is essentially just a bunch of loose pages and not organized by document, then you will need to separate the pages into folders ~~by document~~.		*If you bring in a '''Batch''' that is essentially just a bunch of loose pages and not organized by document, then you will need to separate the pages into document folders.
	*If you bring in a '''Batch''' that already has individual documents contained in their own folders, then there is no need to perform separation.		*If you bring in a '''Batch''' that already has individual documents contained in their own document folders, then there is no need to perform separation.
			-->
	~~{\|class="fyi~~-~~box"~~
	\|-
	\|
	~~'''FYI'''~~
	\|
	Scanned documents come in as loose pages into the '''Batch''' and will always need to be separated. Imported documents may or may not need to be separated depending on how they are brought into Grooper and if the documents are already in separate folders within the '''Batch'''.
	\|}

	=== How do we separate? ===		=== How do we separate? ===

	Separation is a process that happens as part of a '''Batch Process'''. You will need to add a ~~separation~~ '''Batch Process ~~Step~~''' and configure it with a '''''Separation Provider'''''.		Separation is a process that happens as part of a '''Batch Process'''. You will need to add a '''Separate Step''' to your '''Batch Process''' and configure it with a '''''Separation Provider'''''.

	There are 8 different '''''Separation Providers''''' you can configure. Here we are going to give a brief explanation of the provider, but for a deeper understanding you will need to visit each of their articles individually:		There are 8 different '''''Separation Providers''''' you can configure. Here we are going to give a brief explanation of the provider, but for a deeper understanding you will need to visit each of their articles individually:
Line 67:		Line 78:
	* [[Undo Separation]] - This provider actually turns separated documents back into loose pages.		* [[Undo Separation]] - This provider actually turns separated documents back into loose pages.

	=== ~~Lexical~~ vs. ~~Real-Time~~ ===		=== Text-Based vs. Scan Supported ===

	It is important to note that the majority of '''''Separation Providers''''' are "~~Lexical~~" providers. That means they require readable data from a document to work. ~~The ''Recognize'' activity~~ must be performed on documentation prior to any ~~Lexical~~ provider being used. The following are ~~Lexical~~ providers:		It is important to note that the majority of '''''Separation Providers''''' are "Text-Based" providers. That means they require readable data from a document to work. OCR must be performed on documentation prior to any Text-Based provider being used. The following are Text-Based providers:

	* Change in Value Separation		* Change in Value Separation
Line 76:		Line 87:
	* Pattern-Based Separation		* Pattern-Based Separation

	"~~Real-Time~~" providers do not need readable data from documents to work. That means it is possible to run these providers as early as when you scan in documents. ~~The ''Recognize'' activity~~ is not required prior to running a ~~Real-Time~~ provider. The following are ~~Real-Time~~ Providers:		"Scan Supported" providers do not need readable data from documents to work. That means it is possible to run these providers as early as when you scan in documents. OCR is not required prior to running a Scan Supported provider. The following are Scan Supported Providers:

	* Control Sheet Separation		* Control Sheet Separation
	* Event-Based Separation		* Event-Based Separation

Rpatton: New picture // Edit via Wikitext Extension for VSCode

2024-01-12T15:03:00Z

New picture // Edit via Wikitext Extension for VSCode

← Older revision		Revision as of 10:03, 12 January 2024
Line 1:		Line 1:
	<blockquote>		<blockquote>
	Separation is the process of taking an unorganized batch of loose pages and organizing them into folders~~. Each folder contains one document~~. This is done so Grooper can later assign a '''Document Type''' to each document in a process known as Classification.		Separation is the process of taking an unorganized batch of loose pages and organizing them into document folders. This is done so Grooper can later assign a '''Document Type''' to each document in a process known as Classification.
	</blockquote>		</blockquote>

	== About ==		== About ==

	Let's revisit ~~the first three of~~ the five phases of Grooper.		Let's revisit the five phases of Grooper.

	# Acquire		# Acquire
Line 12:		Line 12:
	#* This involves running Recognize and OCR on the '''Batch''' to allow Grooper to read the text and clean up the document if needed.		#* This involves running Recognize and OCR on the '''Batch''' to allow Grooper to read the text and clean up the document if needed.
	# Organize		# Organize
	#* This is where ~~separation takes place~~.		#* '''This is where you separate the documents in the Batch into individual folders. '''
			#* After the documents have been separated, then the documents need to go through Classification.
			# Collect
			#* Data is extracted from the documents.
			# Deliver
			#* Data is exported from Grooper to the destination of your choice.

	=== What is Separation? ===		=== What is Separation? ===
Line 22:		Line 27:
	This is essentially how separation works. It is organizing the documents so that Grooper can identify one document from another.		This is essentially how separation works. It is organizing the documents so that Grooper can identify one document from another.

	[[File:2023 Separation Mockup 01 About 01 When 01.png\|500px]]		[[File:2023 Separation Mockup 01 About 01 When 01.png\|500px\|center]]

	=== Why do we need to separate documents? ===		=== Why do we need to separate documents? ===

Rpatton: Final Final // Edit via Wikitext Extension for VSCode

2024-01-10T19:53:32Z

Final Final // Edit via Wikitext Extension for VSCode

← Older revision		Revision as of 14:53, 10 January 2024
Line 58:		Line 58:
	* [[ESP Auto Separation]] - One of the more complicated separation techniques involving Lexical training.		* [[ESP Auto Separation]] - One of the more complicated separation techniques involving Lexical training.
	* [[Event-Based Separation]] - Grooper will separate based on an "event" such as after X number of pages or any time Grooper ecounters a blank page.		* [[Event-Based Separation]] - Grooper will separate based on an "event" such as after X number of pages or any time Grooper ecounters a blank page.
	* [[Multi-Separator]] - This provider allows you to use multiple '''''Separation Providers''''' at once.		* [[Multi Separator]] - This provider allows you to use multiple '''''Separation Providers''''' at once.
	* [[Pattern Based Separation]] - Grooper will separate based on text patterns, such as a document title or label.		* [[Pattern-Based Separation]] - Grooper will separate based on text patterns, such as a document title or label.
	* [[Undo Separation]] - This provider actually turns separated documents back into loose pages.		* [[Undo Separation]] - This provider actually turns separated documents back into loose pages.

Rpatton: Final // Edit via Wikitext Extension for VSCode

2024-01-10T19:52:00Z

Final // Edit via Wikitext Extension for VSCode

@@ Line 49: / Line 49: @@
 === How do we separate? ===
-There are 8 different Separation Providers you can configure:
+There are 8 different '''''Separation Providers''''' you can configure. Here we are going to give a brief explanation of the provider, but for a deeper understanding you will need to visit each of their articles individually:
 * Change in Value Separation
 * EPI Separation
 * ESP Auto Separation
 * Event-Based Separation

Rpatton: Graphic Inserted // Edit via Wikitext Extension for VSCode

2024-01-10T15:49:21Z

Graphic Inserted // Edit via Wikitext Extension for VSCode

← Older revision		Revision as of 10:49, 10 January 2024
Line 4:		Line 4:

	== About ==		== About ==

			Let's revisit the first three of the five phases of Grooper.

			# Acquire
			#* This involves bringing in a '''Batch''' into Grooper. Usually, documents are scanned into Grooper and the initial '''Batch''' looks like just one long document with individual pages.
			# Condition
			#* This involves running Recognize and OCR on the '''Batch''' to allow Grooper to read the text and clean up the document if needed.
			# Organize
			#* This is where separation takes place.

			=== What is Separation? ===

			Imagine you have a box of documents, but they are all just in a box. You might want to go through that box and organize them. So, first you get a filing cabinet and you put all of the pages in that filing cabinet. This is similar to importing documents into a '''Batch'''.

			Now, let's say you need to look for a specific type of document in the file cabinet. It would be difficult to just go through all of the loose pages to find the documents. It's difficult to determine where one document ends and another begins. So, you take those pages and you sort them into folders. Each folder contains one document which is comprised of one or more pages. Now, it is much easier to tell the documents apart.

			This is essentially how separation works. It is organizing the documents so that Grooper can identify one document from another.

			[[File:2023 Separation Mockup 01 About 01 When 01.png\|500px]]

			=== Why do we need to separate documents? ===

			When you bring documents into Grooper, many times they will come in as just a group of pages. If you scan the documents, they come in the order the pages were scanned. Odds are that when you bring in a '''Batch''', you will be bringing in more than just one document. When Grooper gets a fresh set of pages, it has no way to know what the documents are, where one document starts and/or stops, or how they should be organized.

			We must find a way to tell Grooper where a document begins and ends. Once Grooper can determine that, it can separate the '''Batch''' into '''Folders''' and be able to tell one document from another. This is important to be able to later assign '''Document Types''' to documents in a process called Classification.

			To tell Grooper how documents need to be separated, we configure '''''Separation Providers''''' to automatically separate documents through a '''Batch Process'''.

			=== When do we need to separate documents? ===

			There are some times you need to separate document, and others that you don't. How do you tell the difference? Essentially the difference lies in whether or not your documents are already separated or not.

			*If you bring in a '''Batch''' that is essentially just a bunch of loose pages and not organized by document, then you will need to separate the pages into folders by document.
			*If you bring in a '''Batch''' that already has individual documents contained in their own folders, then there is no need to perform separation.

			{\|class="fyi-box"
			\|-
			\|
			'''FYI'''
			\|
			Scanned documents come in as loose pages into the '''Batch''' and will always need to be separated. Imported documents may or may not need to be separated depending on how they are brought into Grooper and if the documents are already in separate folders within the '''Batch'''.
			\|}

			=== How do we separate? ===


			There are 8 different Separation Providers you can configure:

			* Change in Value Separation
			* Control Sheet Separation
			* EPI Separation
			* ESP Auto Separation
			* Event-Based Separation
			* Multi-Separator
			* Pattern Based Separation
			* Undo Separation