2023.1:Correct (Activity) - Revision history

Dgreenwood at 21:28, 27 August 2025

2025-08-27T21:28:58Z

← Older revision		Revision as of 16:28, 27 August 2025
Line 103:		Line 103:

	#<li value=3> Back in the ''Correct'' '''Batch Process Step''', set the '''''Removal Extractor''''' property by clicking the hamburger icon to the right of the property.		#<li value=3> Back in the ''Correct'' '''Batch Process Step''', set the '''''Removal Extractor''''' property by clicking the hamburger icon to the right of the property.
	# In our example, we set the '''''Removal Extractor''''' to a ''Reference''. You can set it to any ~~extractor type~~ you wish to collect the information you want removed.		# In our example, we set the '''''Removal Extractor''''' to a ''Reference'' extractor. You can set it to any Value Extractor you wish to collect the information you want removed.

	[[File:2023.1 Correct-(Activity) 02 04 Removal 02.png]]		[[File:2023.1 Correct-(Activity) 02 04 Removal 02.png]]

Dgreenwood at 21:09, 4 March 2025

2025-03-04T21:09:58Z

← Older revision		Revision as of 16:09, 4 March 2025
Line 15:		Line 15:
	== About ==		== About ==

	When running OCR on a document, you don't always get perfect results. The OCR Engine makes mistakes. You can use [[Fuzzy RegEx ~~(Concept)~~\|~~Fuzzy Matching~~]] to still extract the information that you want, but the original OCRed text data attached to the document file will still reflect that bad OCR. The ''Correct'' '''Batch Process Step''' will change the text data attached to the document so when you export your files, the digital text will be more accurate.		When running OCR on a document, you don't always get perfect results. The OCR Engine makes mistakes. You can use [[Fuzzy RegEx\|fuzzy matching]] to still extract the information that you want, but the original OCRed text data attached to the document file will still reflect that bad OCR. The ''Correct'' '''Batch Process Step''' will change the text data attached to the document so when you export your files, the digital text will be more accurate.

	You can also remove sections of text from the digital text of the document using the ''Correct'' '''Batch Process Step'''. However, the ''Correct'' '''Batch Process Step''' will not remove the information from the document image or PDF. To do that, you would need to add a [[Redact (Activity)\|Redact]] '''Batch Process''' step.		You can also remove sections of text from the digital text of the document using the ''Correct'' '''Batch Process Step'''. However, the ''Correct'' '''Batch Process Step''' will not remove the information from the document image or PDF. To do that, you would need to add a [[Redact (Activity)\|Redact]] '''Batch Process''' step.

Randallkinard at 17:57, 21 November 2024

2024-11-21T17:57:51Z

← Older revision		Revision as of 12:57, 21 November 2024
Line 117:		Line 117:

	[[File:2023.1 Correct-(Activity) 02 04 Removal 04.png]]		[[File:2023.1 Correct-(Activity) 02 04 Removal 04.png]]


	</div>		</div>

	~~== Glossary ==~~

	~~<u><big>'''Activity'''</big></u>: {{#lst:Glossary\|Activity}}~~

	~~<u><big>'''Batch'''</big></u>: {{#lst:Glossary\|Batch}}~~

	~~<u><big>'''Batch Folder'''</big></u>: {{#lst:Glossary\|Batch Folder}}~~

	~~<u><big>'''Batch Process Step'''</big></u>: {{#lst:Glossary\|Batch Process Step}}~~

	~~<u><big>'''Batch Process'''</big></u>: {{#lst:Glossary\|Batch Process}}~~

	~~<u><big>'''Correct'''</big></u>: {{#lst:Glossary\|Correct}}~~

	~~<u><big>'''Data Element'''</big></u>: {{#lst:Glossary\|Data Element}}~~

	~~<u><big>'''Data Type'''</big></u>: {{#lst:Glossary\|Data Type}}~~

	~~<u><big>'''Document Viewer'''</big></u>: {{#lst:Glossary\|Document Viewer}}~~

	~~<u><big>'''Extract'''</big></u>: {{#lst:Glossary\|Extract}}~~

	~~<u><big>'''List Match'''</big></u>: {{#lst:Glossary\|List Match}}~~

	~~<u><big>'''OCR'''</big></u>: {{#lst:Glossary\|OCR}}~~

	~~<u><big>'''OCR Engine'''</big></u>: {{#lst:Glossary\|OCR Engine}}~~

	~~<u><big>'''Reference'''</big></u>: {{#lst:Glossary\|Reference}}~~

	~~<u><big>'''Scope'''</big></u>: {{#lst:Glossary\|Scope}}~~

	~~<u><big>'''Value Reader'''</big></u>: {{#lst:Glossary\|Value Reader}}~~

Randallkinard: Randallkinard moved page Correct (Activity) to 2023.1:Correct (Activity)

2024-08-28T13:17:31Z

Randallkinard moved page Correct (Activity) to 2023.1:Correct (Activity)

← Older revision	Revision as of 08:17, 28 August 2024
(No difference)

Randallkinard at 14:20, 26 August 2024

2024-08-26T14:20:19Z

@@ Line 12: / Line 12: @@
 * [[Media:2023.1 Wiki Correct-(Activity) Project.zip]]
 |}
 == About ==
@@ Line 154: / Line 120: @@
 </div>

Rpatton: // via Wikitext Extension for VSCode

2024-07-09T13:41:17Z

// via Wikitext Extension for VSCode

← Older revision		Revision as of 08:41, 9 July 2024
Line 96:		Line 96:

	# Now you should have a ''Correct'' '''Batch Process Step''' in your node tree.		# Now you should have a ''Correct'' '''Batch Process Step''' in your node tree.
	# ~~You can set~~ the ~~scope to either correct~~ the ~~whole document or only specific fields~~. ~~It is recommended most of~~ the ~~time~~ to ~~set~~ to ~~correct the whole document~~. So we are going to set the '''''Scope''''' to ''~~Document~~''.		# Click the hamburger icon tot he right of the '''''Scope''''' property in the "Step Properties" grid.
			# Generally you will want to set the '''''Scope''''' property to ''Page'' because ''Recognize'' is usually run at a ''page'' level and ''Correct'' needs text data to run. So, we are going to set the '''''Scope''''' to a ''page'' level.

	[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 01.png]]		[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 01.png]]


	#<li value=3> Set the '''''~~Enable Spell Correction~~''''' to ''~~True~~''.		# <li value=4> Set the '''''Scope''''' in the "Activities Properties" grid by clicking the hamburger icon to the right of the property.
			# You can set the scope to either correct the whole document or only specific fields. It is recommended most of the time to set to correct the whole document. So, we are going to set the '''''Scope''''' to ''Document''.

	[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 02.png]]		[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 02.png]]


	#<li value=4> Set ~~your~~ '''''Correction ~~Extractor~~'''''~~. We are going~~ to ~~set it to a reference in this tutorial.~~		#<li value=6> Set the '''''Enable Spell Correction''''' to ''True''.
	~~# We are going to set the reference to the "Field Labels" '''Value Reader''' that has '''''Fuzzy Matching'~~'''' ~~enabled~~.

	[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 03.png]]		[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 03.png]]


	#<li value=6> ~~Once you have finished configuring~~ your ~~step, click~~ the ~~save icon at~~ the ~~top of the property grid to save your changes~~.		# <li value=7> Set your '''''Correction Extractor'''''. We are going to set it to a ''Reference'' in this tutorial.
			# We are going to set the reference to the "Field Labels" '''Value Reader''' that has '''''Fuzzy Matching''''' enabled.

	[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 04.png]]		[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 04.png]]


			#<li value=9> Once you have finished configuring your step, click the save icon at the top of the property grid to save your changes.

			[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 05.png]]

	</div>		</div>

Rpatton: // via Wikitext Extension for VSCode

2024-07-08T16:37:56Z

// via Wikitext Extension for VSCode

← Older revision		Revision as of 11:37, 8 July 2024
Line 1:		Line 1:
	{{AutoVersion}}		{{AutoVersion}}

	{\|class="~~wip~~-box"
			<blockquote>{{#lst:Glossary\|Correct}}</blockquote>

			{\|class="download-box"
	\|		\|
	~~'''WIP'''~~		[[File:Asset 22@4x.png]]
	\|		\|
	~~This~~ article ~~is a work~~-in-~~progress or created as a placeholder for testing purposes~~. ~~This article is subject to change and~~/~~or expansion. It may be incomplete, inaccurate, or stop abruptly.~~		You may download the ZIP(s) below and upload it into your own Grooper environment (version 2023.1). The first contains one or more '''Batches''' of sample documents. The second contains one or more '''Projects''' with resources used in examples throughout this article.
			* [[Media:2023.1 Wiki Correct-(Activity) Batch.zip]]
			* [[Media:2023.1 Wiki Correct-(Activity) Project.zip]]
			\|}

			== Glossary ==

			<u><big>'''Activity'''</big></u>: {{#lst:Glossary\|Activity}}

			<u><big>'''Batch'''</big></u>: {{#lst:Glossary\|Batch}}

			<u><big>'''Batch Folder'''</big></u>: {{#lst:Glossary\|Batch Folder}}

			<u><big>'''Batch Process Step'''</big></u>: {{#lst:Glossary\|Batch Process Step}}

			<u><big>'''Batch Process'''</big></u>: {{#lst:Glossary\|Batch Process}}

			<u><big>'''Correct'''</big></u>: {{#lst:Glossary\|Correct}}

			<u><big>'''Data Element'''</big></u>: {{#lst:Glossary\|Data Element}}

			<u><big>'''Data Type'''</big></u>: {{#lst:Glossary\|Data Type}}

			<u><big>'''Document Viewer'''</big></u>: {{#lst:Glossary\|Document Viewer}}

	~~This tag will be removed upon draft completion.~~		<u><big>'''Extract'''</big></u>: {{#lst:Glossary\|Extract}}
	\|}
			<u><big>'''List Match'''</big></u>: {{#lst:Glossary\|List Match}}

			<u><big>'''OCR'''</big></u>: {{#lst:Glossary\|OCR}}

			<u><big>'''OCR Engine'''</big></u>: {{#lst:Glossary\|OCR Engine}}

			<u><big>'''Reference'''</big></u>: {{#lst:Glossary\|Reference}}

	<~~blockquote~~>{{#lst:Glossary\|~~Correct~~}}~~</blockquote>~~		<u><big>'''Scope'''</big></u>: {{#lst:Glossary\|Scope}}

	== Glossary ==		<u><big>'''Value Reader'''</big></u>: {{#lst:Glossary\|Value Reader}}

	== About ==		== About ==
Line 27:		Line 60:
	=== Correcting OCR ===		=== Correcting OCR ===

	Using the ''Correct'' '''Batch Process Step''' changes the text data attached to the document. When you have an extractor with '''''Fuzzy Matching''''' enabled, it is extracting the correct information even with bad OCR. The ''Correct'' step will take the ~~correct extraction~~ and replace the original OCR ~~in the text~~. ~~So, the~~ first thing we need to do is have an extractor using Fuzzy Logic collecting what we want to correct.		Using the ''Correct'' '''Batch Process Step''' changes the text data attached to the document. When you have an extractor with '''''Fuzzy Matching''''' enabled, it is capable of extracting the correct information even with bad OCR. The ''Correct'' step will take the extracted text and replace the original OCR. The first thing we need to do is have an extractor using Fuzzy Logic collecting what we want to correct.
	<div style="padding-left: 1.5em";>		<div style="padding-left: 1.5em";>

Line 96:		Line 129:


	#<li value=3> Back in ~~teh~~ ''Correct'' '''Batch Process Step''', set the '''''Removal Extractor''''' property by clicking the hamburger icon to the right of the property.		#<li value=3> Back in the ''Correct'' '''Batch Process Step''', set the '''''Removal Extractor''''' property by clicking the hamburger icon to the right of the property.
	# In our example, we set the '''''Removal Extractor''''' to a ''Reference''. You can set it to any extractor type you wish to collect the information you want removed.		# In our example, we set the '''''Removal Extractor''''' to a ''Reference''. You can set it to any extractor type you wish to collect the information you want removed.

Rpatton: // via Wikitext Extension for VSCode

2024-07-08T15:49:32Z

// via Wikitext Extension for VSCode

← Older revision		Revision as of 10:49, 8 July 2024
Line 83:		Line 83:
	[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 04.png]]		[[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 04.png]]

			</div>
			=== Using A Correct Step for Removal ===

	~~<b><big>Configuring for~~ Removal~~</big></b>~~		Often you may have sensitive information on a document such as personal contact information, social security numbers (SSNs), account information, etc. The [[Redact (Activity)\|Redact Activity]] can black out this extracted information on the document itself so it cannot be read. However, the ''Redact Activity'' does not change the text data of the document. If someone were to look at the text data attached to a redacted PDF, they would see the original information intact. To fully remove the information from the text data, we need to use the '''''Removal Extractor''''' property in the ''Correct'' '''Batch Process Step'''.

	# In this tutorial we have already put together a '''Data Type''' that is extracting the sensitive information on our document that we want to remove from the text data.		In this example we are going to configure the '''''Removal Extractor''''' on the same ''Correct'' '''Step''' that is already correcting bad OCR. You don't necessarily need to configure both for the step to function. If you only need the text data deleted and no corrections made, you can just configure the '''''Removal Extractor''''' by itself (or vice versa).

			# For this tutorial we have already put together a '''Data Type''' that is extracting the sensitive information on our document that we want to remove from the text data.
	# Two SSNs or account numbers are being returned by the extractor on this document.		# Two SSNs or account numbers are being returned by the extractor on this document.

Line 108:		Line 112:
	[[File:2023.1 Correct-(Activity) 02 04 Removal 04.png]]		[[File:2023.1 Correct-(Activity) 02 04 Removal 04.png]]

	~~</div>~~

	</div>		</div>

Rpatton: // via Wikitext Extension for VSCode

2024-07-08T15:33:58Z

// via Wikitext Extension for VSCode

@@ Line 82: / Line 82: @@
 [[File:2023.1 Correct-(Activity) 02 03 Correction-Extractor 04.png]]
 </div>
 </div>

Rpatton: // via Wikitext Extension for VSCode

2024-07-03T18:23:49Z

// via Wikitext Extension for VSCode

@@ Line 22: / Line 22: @@
 == How To ==
 <div style="padding-left: 1.5em";>
@@ Line 46: / Line 52: @@
 <b><big>Adding the Correct Batch Process Step</big></b>
 </div>

← Older revision		Revision as of 12:57, 21 November 2024
Line 117:		Line 117:

	[[File:2023.1 Correct-(Activity) 02 04 Removal 04.png]]		[[File:2023.1 Correct-(Activity) 02 04 Removal 04.png]]


	</div>		</div>

	~~== Glossary ==~~

	~~<u><big>'''Activity'''</big></u>: {{#lst:Glossary\|Activity}}~~

	~~<u><big>'''Batch'''</big></u>: {{#lst:Glossary\|Batch}}~~

	~~<u><big>'''Batch Folder'''</big></u>: {{#lst:Glossary\|Batch Folder}}~~

	~~<u><big>'''Batch Process Step'''</big></u>: {{#lst:Glossary\|Batch Process Step}}~~

	~~<u><big>'''Batch Process'''</big></u>: {{#lst:Glossary\|Batch Process}}~~

	~~<u><big>'''Correct'''</big></u>: {{#lst:Glossary\|Correct}}~~

	~~<u><big>'''Data Element'''</big></u>: {{#lst:Glossary\|Data Element}}~~

	~~<u><big>'''Data Type'''</big></u>: {{#lst:Glossary\|Data Type}}~~

	~~<u><big>'''Document Viewer'''</big></u>: {{#lst:Glossary\|Document Viewer}}~~

	~~<u><big>'''Extract'''</big></u>: {{#lst:Glossary\|Extract}}~~

	~~<u><big>'''List Match'''</big></u>: {{#lst:Glossary\|List Match}}~~

	~~<u><big>'''OCR'''</big></u>: {{#lst:Glossary\|OCR}}~~

	~~<u><big>'''OCR Engine'''</big></u>: {{#lst:Glossary\|OCR Engine}}~~

	~~<u><big>'''Reference'''</big></u>: {{#lst:Glossary\|Reference}}~~

	~~<u><big>'''Scope'''</big></u>: {{#lst:Glossary\|Scope}}~~

	~~<u><big>'''Value Reader'''</big></u>: {{#lst:Glossary\|Value Reader}}~~