2.90:Confidence Multiplier and Output Confidence (Property) - Revision history

Randallkinard at 16:37, 29 April 2024

2024-04-29T16:37:55Z

← Older revision		Revision as of 11:37, 29 April 2024
Line 1:		Line 1:
	{{AutoVersion}}		{{AutoVersion}}

	[[File:weighted_rules_00.png\|right\|thumb\|250px\|Graphic depicting the notion of Weighted Rules.]]		[[File:weighted_rules_00.png\|right\|thumb\|250px\|Graphic depicting the notion of Weighted Rules.]]

	<blockquote ~~style="font-size~~:~~14pt">~~		<blockquote>{{#lst:Glossary\|Confidence Multiplier and Output Confidence}}</blockquote>
	~~Some results carry more weight than others.~~
	</blockquote>

	==About==		==About==

Randallkinard: Randallkinard moved page 2.90:Confidence Multiplier and Output Confidence to 2.90:Confidence Multiplier and Output Confidence (Property) without leaving a redirect: new naming convention

2024-04-16T16:06:15Z

Randallkinard moved page 2.90:Confidence Multiplier and Output Confidence to 2.90:Confidence Multiplier and Output Confidence (Property) without leaving a redirect: new naming convention

← Older revision	Revision as of 11:06, 16 April 2024
(No difference)

Dgreenwood: Dgreenwood moved page Confidence Multiplier and Output Confidence - 2.90 to 2.90:Confidence Multiplier and Output Confidence without leaving a redirect

2023-12-22T18:47:14Z

Dgreenwood moved page Confidence Multiplier and Output Confidence - 2.90 to 2.90:Confidence Multiplier and Output Confidence without leaving a redirect

← Older revision	Revision as of 13:47, 22 December 2023
(No difference)

Dgreenwood at 18:47, 22 December 2023

2023-12-22T18:47:00Z

← Older revision		Revision as of 13:47, 22 December 2023
Line 145:		Line 145:
	==Version Differences==		==Version Differences==
	Prior to '''Grooper''' 2.9 the '''''Confidence Multiplier''''' property did not exist.		Prior to '''Grooper''' 2.9 the '''''Confidence Multiplier''''' property did not exist.

	~~[[Category:Articles]]~~
	~~[[Category:Version 2.90]]~~

Dgreenwood at 18:46, 22 December 2023

2023-12-22T18:46:52Z

← Older revision		Revision as of 13:46, 22 December 2023
Line 1:		Line 1:
			{{AutoVersion}}
	[[File:weighted_rules_00.png\|right\|thumb\|250px\|Graphic depicting the notion of Weighted Rules.]]		[[File:weighted_rules_00.png\|right\|thumb\|250px\|Graphic depicting the notion of Weighted Rules.]]

Dgreenwood at 18:20, 9 December 2022

2022-12-09T18:20:12Z

← Older revision		Revision as of 13:20, 9 December 2022
Line 144:		Line 144:
	==Version Differences==		==Version Differences==
	Prior to '''Grooper''' 2.9 the '''''Confidence Multiplier''''' property did not exist.		Prior to '''Grooper''' 2.9 the '''''Confidence Multiplier''''' property did not exist.

			[[Category:Articles]]
			[[Category:Version 2.90]]

Dgreenwood: Dgreenwood moved page Confidence Multiplier and Output Confidence to Confidence Multiplier and Output Confidence - 2.90: To be consistent with current naming conventions

2022-12-09T18:19:45Z

Dgreenwood moved page Confidence Multiplier and Output Confidence to Confidence Multiplier and Output Confidence - 2.90: To be consistent with current naming conventions

← Older revision	Revision as of 13:19, 9 December 2022
(No difference)

Randallkinard at 18:04, 24 November 2020

2020-11-24T18:04:31Z

@@ Line 113: / Line 113: @@
 Similarly, if higher confidence hits are inappropriately classifying documents and ''shouldn't'' be returned, the '''''Confidence Multiplier''''' property can be reduced so that those '''Data Types''' only exceed the '''''Minimum Confidence''''' when they are very high confidence.
 ==Version Differences==
 Prior to '''Grooper''' 2.9 the '''''Confidence Multiplier''''' property did not exist.

Randallkinard at 14:33, 23 November 2020

2020-11-23T14:33:08Z

← Older revision		Revision as of 09:33, 23 November 2020
Line 20:		Line 20:
	Modifying the '''''Output Confidence''''' property of a '''Data Type''' or '''Data Format''' is also done by clicking on the ellipses in the '''''Result Options''''' property which opens the '''''Result Options''''' submenu.		Modifying the '''''Output Confidence''''' property of a '''Data Type''' or '''Data Format''' is also done by clicking on the ellipses in the '''''Result Options''''' property which opens the '''''Result Options''''' submenu.

	The '''''Output Confidence''''' property defaults to ''0%'' and can be changed in this submenu. The default of ''0%'' will not alter the results' confidence scores. Changing this number will override whatever the result's original confidence is and replace it with this value.		The '''''Output Confidence''''' property defaults to ''0%'' and can be changed in this submenu. The default of ''0%'' will not alter the results confidence scores. Changing this number will override whatever the result's original confidence is and replace it with this value.

	For example, a value of ''75%'' will change the confidence of output results to 75%. If the output confidence was 100%, now it will be 75%. If the output confidence was 50%, now it will be 75%. If it was 75%, it will now be (you guessed it) 75%. It doesn't matter what the original confidence was, it will be transformed to the '''''Output Confidence''''' value.		For example, a value of ''75%'' will change the confidence of output results to 75%. If the output confidence was 100%, now it will be 75%. If the output confidence was 50%, now it will be 75%. If it was 75%, it will now be (you guessed it) 75%. It doesn't matter what the original confidence was, it will be transformed to the '''''Output Confidence''''' value.

	==~~Use Cases~~==		==How To==

	===Waterfall Extraction===		===Waterfall Extraction===
	''Weighted Rules'' can be used in cases where one is trying to find a data element appearing on many similar types of forms but multiple extraction approaches are required to identify the element.		''Weighted Rules'' can be used in cases where one is trying to find a data element appearing on many similar types of forms but multiple extraction approaches are required to identify the element.
Line 37:		Line 36:
	# '''Field Classes''', by design leverage trained/weighted features and should not return results at 100% confidence.		# '''Field Classes''', by design leverage trained/weighted features and should not return results at 100% confidence.
	Considering this, a properly configured extractor can, and does, return results below 100%, and can break the logical approach of organizing results by confidence. A result returned at 90% confidence ''could'' be more desirable than one returned at 100%.		Considering this, a properly configured extractor can, and does, return results below 100%, and can break the logical approach of organizing results by confidence. A result returned at 90% confidence ''could'' be more desirable than one returned at 100%.

	~~We will explore how and why in the [[#How To\|How To]] section of this article.~~

	~~===Waterfall Classification===~~
	Setting the '''''Classification Method''''' property on a '''Content Model''' to ''Lexical'' or ''Rules-Based'', one can set up 'Positive Extractors'' on '''Document Types'''. If this extractor returns a result above the '''''Minimum Similarity''''' set on the '''Content Model''', the document will be assigned that '''Document Type''' during classification.

	This extractor could be a "Waterfall Extractor", taking advantage of the Waterfall Extraction technique. However, for classification, the system is just looking for some result to be returned above the '''''Minimum Similarity''''' confidence threshold.

	In the ''Waterfall Classification'' method, the '''''Minimum Confidence''''' property can be set in the '''Result Filter''' property window of a '''Data Type''' which will eliminate any results less than that confidence. This may eliminate the results of some referenced extractors which technically matched, but at a low percent.

	If we happen to know that those lower confidence hits are valid and ''should'' count for classifying the document, then the '''Confidence Multipliers''' on those referenced '''Data Types''' can be set to a higher value in order to make them hit the '''Minimum Confidence''' required.

	Similarly, if higher confidence hits are inappropriately classifying documents and ''shouldn't'' be returned, the '''''Confidence Multiplier''''' property can be reduced so that those '''Data Types''' only exceed the Minimum Confidence when they are very high confidence.

	~~==How To==~~
	~~Here we'll explore a use case using a mortgage document.~~

	<tabs style="margin:20px">		<tabs style="margin:20px">
	<tab name="OCR Misread" style="margin:25px">		<tab name="OCR Misread" style="margin:25px">
	===OCR Misread===		====OCR Misread====

	In this example, an OCR error produced a misread the words “final loan” by not recognizing the space between them.		In this example, an OCR error produced a misread the words “final loan” by not recognizing the space between them.
Line 63:		Line 46:
	</tab>		</tab>
	<tab name="Child Data Type Setup" style="margin:25px">		<tab name="Child Data Type Setup" style="margin:25px">
	=== Child Data Type Setup ===		====Child Data Type Setup====
	Three '''Data Types''' were established to find variations of a result.		Three '''Data Types''' were established to find variations of a result.
	{\| class="wikitable"		{\| class="wikitable"
Line 86:		Line 69:
	</tab>		</tab>
	<tab name="Waterfall Extractor" style="margin:25px">		<tab name="Waterfall Extractor" style="margin:25px">
	===Waterfall Extractor===		====Waterfall Extractor====

	The ''Waterfall Extractor'' is a '''Data Type''' that is a parent or references all of the unique extractors for a piece of data and then determines which one should be given as a final output to a '''Data Field'''.		The ''Waterfall Extractor'' is a '''Data Type''' that is a parent or references all of the unique extractors for a piece of data and then determines which one should be given as a final output to a '''Data Field'''.
Line 92:		Line 75:
	</tab>		</tab>
	<tab name="Default Output" style="margin:25px">		<tab name="Default Output" style="margin:25px">
			====Default Output====
	Using '''Order By''' set to ''Confidence'' and '''Direction''' set to ''Descending'' as the sort criteria, two extractors match with the highest confidence result given first. The ''FinalLoan'' extractor matched because it found “finalloan” with no spaces and it is not leveraging ''FuzzyRegEx'', so it matched at 100%. The ''Final Loan'' extractor did not match, because it is not using ''FuzzyRegEx'' and it did not find a space between the two words so it did not consider it a match. The ''Fuzzy: Final Loan'', leveraging ''FuzzyRegEx'', matched because it was able to make the word “finalloan” into “final loan” by inserting a space and so it was a 90% match.		Using '''Order By''' set to ''Confidence'' and '''Direction''' set to ''Descending'' as the sort criteria, two extractors match with the highest confidence result given first. The ''FinalLoan'' extractor matched because it found “finalloan” with no spaces and it is not leveraging ''FuzzyRegEx'', so it matched at 100%. The ''Final Loan'' extractor did not match, because it is not using ''FuzzyRegEx'' and it did not find a space between the two words so it did not consider it a match. The ''Fuzzy: Final Loan'', leveraging ''FuzzyRegEx'', matched because it was able to make the word “finalloan” into “final loan” by inserting a space and so it was a 90% match.
	[[File:weighted_rules_07.png\|center]]		[[File:weighted_rules_07.png\|center]]
Line 101:		Line 85:
	</tab>		</tab>
	<tab name="Getting the Desired Result" style="margin:25px">		<tab name="Getting the Desired Result" style="margin:25px">
	=== Getting the Desired Result ===		====Getting the Desired Result====
	Let's change some settings to set this extractor up to return the results in the desired way; that being with the most right result ''weighted'' the highest.		Let's change some settings to set this extractor up to return the results in the desired way; that being with the most right result ''weighted'' the highest.
	{\| class="wikitable"		{\| class="wikitable"
Line 110:		Line 94:
	\| style="padding:25px; width:50%" \|		\| style="padding:25px; width:50%" \|
	Set the '''''Confidence Multiplier''''' property in the '''Result Options''' property window for the '''FinalLoan''' '''Data Type''' to 0.75. The results on the parent '''Data Type''' will now show the ''un-weighted'' '''Data Type''' '''Fuzzy: Final Loan''' at a confidence of 90% (again, because a space was inserted), and the '''FinalLoan''' '''Data Type''' will show 75%.		Set the '''''Confidence Multiplier''''' property in the '''Result Options''' property window for the '''FinalLoan''' '''Data Type''' to 0.75. The results on the parent '''Data Type''' will now show the ''un-weighted'' '''Data Type''' '''Fuzzy: Final Loan''' at a confidence of 90% (again, because a space was inserted), and the '''FinalLoan''' '''Data Type''' will show 75%.



	In the event another document is OCRed correctly with a space between the words, the '''Final Loan''' '''Data Type''' would return the exact match at 100%. The '''Fuzzy: Final Loan''' '''Data Type''' would also return 100% because the expression matched 100% with no substitutions.		In the event another document is OCRed correctly with a space between the words, the '''Final Loan''' '''Data Type''' would return the exact match at 100%. The '''Fuzzy: Final Loan''' '''Data Type''' would also return 100% because the expression matched 100% with no substitutions.
Line 120:		Line 102:
	</tab>		</tab>
	</tabs>		</tabs>

			===Waterfall Classification===
			Setting the '''''Classification Method''''' property on a '''Content Model''' to ''Lexical'' or ''Rules-Based'', one can set up ''Positive Extractors'' on '''Document Types'''. If this extractor returns a result above the '''''Minimum Similarity''''' set on the '''Content Model''', the document will be assigned that '''Document Type''' during classification. By default a result from an extractor is returned at 100% confidence (unless '''[[Fuzzy RegEx]]''' is leveraged to return a result, in which case the confidence will be affected by the fuzzy algorithm.) Given this fact positive extractors are almost certain to be above the '''''Minimum Similarity'''''.

			This extractor could be a "Waterfall Extractor", taking advantage of the Waterfall Extraction technique. However, for classification, the system is just looking for some result to be returned above the '''''Minimum Similarity''''' confidence threshold.

			In the ''Waterfall Classification'' method, the '''''Minimum Confidence''''' property can be set in the '''Result Filter''' property window of a '''Data Type''' which will eliminate any results less than that confidence. This may eliminate the results of some referenced extractors which technically matched, but at a low percent.

			If we happen to know that those lower confidence hits are valid and ''should'' count for classifying the document, then the '''Confidence Multipliers''' on those referenced '''Data Types''' can be set to a higher value in order to make them hit the '''Minimum Confidence''' required.

			Similarly, if higher confidence hits are inappropriately classifying documents and ''shouldn't'' be returned, the '''''Confidence Multiplier''''' property can be reduced so that those '''Data Types''' only exceed the '''''Minimum Confidence''''' when they are very high confidence.

	==Version Differences==		==Version Differences==
	Prior to '''Grooper''' 2.9 the '''''Confidence Multiplier''''' property did not exist.		Prior to '''Grooper''' 2.9 the '''''Confidence Multiplier''''' property did not exist.

Dgreenwood: /* General Usage - Output Confidence */

2020-08-10T21:27:57Z

General Usage - Output Confidence

← Older revision		Revision as of 16:27, 10 August 2020
Line 22:		Line 22:
	The '''''Output Confidence''''' property defaults to ''0%'' and can be changed in this submenu. The default of ''0%'' will not alter the results' confidence scores. Changing this number will override whatever the result's original confidence is and replace it with this value.		The '''''Output Confidence''''' property defaults to ''0%'' and can be changed in this submenu. The default of ''0%'' will not alter the results' confidence scores. Changing this number will override whatever the result's original confidence is and replace it with this value.

	For example, a value of ''75%'' will change the confidence of output results to 75%. If the output confidence was 100%, now it will be 75%. If the output confidence was 90%, now it will be 75%. If it was 75%, it will now be (you guessed it) 75%. It doesn't matter what the original confidence was, it will be transformed to the '''''Output Confidence''''' value.		For example, a value of ''75%'' will change the confidence of output results to 75%. If the output confidence was 100%, now it will be 75%. If the output confidence was 50%, now it will be 75%. If it was 75%, it will now be (you guessed it) 75%. It doesn't matter what the original confidence was, it will be transformed to the '''''Output Confidence''''' value.

	==Use Cases==		==Use Cases==