Main Page: Difference between revisions

From Grooper Wiki
No edit summary
No edit summary
(28 intermediate revisions by 3 users not shown)
Line 8: Line 8:
Grooper empowers rapid innovation for organizations processing and integrating large quantities of difficult data. Created by a team of courageous developers frustrated by limitations in existing solutions, Grooper is an intelligent document and digital data integration platform. Grooper combines patented and sophisticated image processing, capture technology, machine learning, and natural language processing. Grooper – intelligent document processing; limitless, template-free data integration.
Grooper empowers rapid innovation for organizations processing and integrating large quantities of difficult data. Created by a team of courageous developers frustrated by limitations in existing solutions, Grooper is an intelligent document and digital data integration platform. Grooper combines patented and sophisticated image processing, capture technology, machine learning, and natural language processing. Grooper – intelligent document processing; limitless, template-free data integration.


|Introduction to Grooper
|[https://xchange.grooper.com/discussion/57/read-me-getting-started Getting Started]
|-style="background-color:#fde6cb" valign="top"
|-style="background-color:#fde6cb" valign="top"
|[[Install and Setup]]
|[[Install and Setup]]
|-style="background-color:#fde6cb" valign="top"
|-style="background-color:#fde6cb" valign="top"
|[http://grooper.bisok.com/Documentation/2.80/Main/HTML5/index.htm#t=Start_Page.htm 2.80 Reference Documentation]
|[https://grooper.bisok.com/Documentation/2.90/Main/HTML5/index.htm#t=Start_Page.htm 2.90 Reference Documentation]
|}
|}


Line 18: Line 18:
{|cellpadding="15" cellspacing="10"
{|cellpadding="15" cellspacing="10"
|-style="background-color:#36b0a7; color:white; font-size:16pt"
|-style="background-color:#36b0a7; color:white; font-size:16pt"
|style="width:50%"|'''Featured Article'''||'''Did you know?'''
|style="width:50%"|'''Featured Articles'''||'''Did you know?'''
|-style="background-color:#d8f3f1" valign="top"
|-style="background-color:#d8f3f1" valign="top"
|
|
<blockquote>
<blockquote style="font-size:14pt">
<span style="font-size:14pt">'''[[Data Type]]'''</span>
[[Data Context]]
</blockquote>
</blockquote>
[[file:data type 1.png|frame|A sample Data Type extractor in the Node Tree]]


Data Types are [[Data Extractor]]s that use [[Regular Expression|regular expression]] to match text on a document, returning and collating the results.   
Data without context is meaningless.  Context is critical to understanding and modeling the relationships between pieces of information on a document.  Without context, it’s impossible to distinguish one data element from another.  Context helps us understand what data refers to or “means”.   


The matching pattern or patterns will return as a list of values.  The returned values can be further collated, isolated, and manipulated by configuring the properties of the Data Type.  Data Types have a variety of uses in Grooper.  Not only are they used to extract individual fields or information, but can be used to separate pages into document folders, classify documents, and more.
This allows us to build an extraction logic using '''[[Data Type]]''' and '''[[Field Class]]''' extractors in order to build and populate a '''[[Data Model]]'''.
|When fuzzy matching a pattern in Grooper, the regex in the lookahead and lookbehind patterns are also fuzzy matched.


Using standard RegEx, this pattern only matches the word "grooper" if it starts at the beginning of a new line (Using the lookahead pattern <code>\n</code>) and ends at the end of a line (using the lookbehind pattern <code>\r</code>).
There are three fundamental data context relationships:


{|style="margin:auto"
* '''Syntactic''' - Context given by the syntax of data.
|[[File:Fuzzy lookbehind 1.png|border|250px]]||[[File:Fuzzy lookbehind 2.png|border|250px]]
* '''Semantic''' - Context given by the lexical content associated with the data.
|}
* '''Spatial''' - Context given by where the data exists on the page, in relationship with other data.


However, if you use FuzzyRegEx mode, the characters in the lookahead and lookbehind are also included as potential character swaps.   
Using the context these relationships provide allows us to understand how to target data with extractors.
 
|
[[File:Fuzzy lookbehind 3.png|center|border|250px]]
You can now manually manipulate the confidence of an extraction resultThe '''''[[Confidence Multiplier and Output Confidence]]''''' properties of '''[[Data Type]]''' and '''[[Data Format]]''' extractors allow you to change the confidence score of extraction results.  No longer are you forced to accept the score Grooper provides.  These properties give you more control when it comes to what confidence a result ''should'' be.


In this case, the <code>\r</code> in the lookbehind was swaped for the colon character after "grooper".
This allows you to prioritize certain results over others.  You can create a kind of "fall back" or "safety net" result by using this property.  You can even ''increase'' the confidence of an extractor's result, allowing you to give more weight to a fuzzy extractor's result over a non-fuzzy one, for example.


In other words, it's not just the value pattern <code>grooper</code> that is fuzzy matched, but <code>\ngrooper\r</code> with the characters in the lookahead and lookbehind patterns included.
For more information visit, the [[Confidence Multiplier and Output Confidence]] article.
|}
|}


{|cellpadding="15" cellspacing="10"
{|cellpadding="15" cellspacing="10"
|-style="background-color:#f89420; color:white; font-size:16pt"
|-style="background-color:#f89420; color:white; font-size:16pt"
|style="width:50%"|'''New in 2.8'''||'''Featured Use Case'''
|style="width:50%"|'''New in 2.9'''||'''Featured Use Case'''
|-style="background-color:#fde6cb" valign="top"
|-style="background-color:#fde6cb" valign="top"
|
|
New [[Microfiche Processing]] capabilities including
{|cellpadding=5 cellspacing=2 style="margin:auto"
* Three new batch activities specifically designed for microfiche processing
!colspan="4" style="padding: 25px" | <blockquote style="font-size:14pt">Welcome to '''Grooper 2.9'''!<br/>Below you will find helpful links to all the articles about the new/changed functionality in this version of '''Grooper'''.</blockquote>
** [[Initialize Card]]
|-
** [[Detect Frames]]
|[[Image:Compile_stats_02.png|center|200px|link=Compile Stats]]
** [[Clip Frames]]
|[[Image:Microsoft_office_integration_000.png|center|200px|link=Microsoft Office Integration]]
* Two new IP commands. While these are not strictly limited to microfiche processing they were created with microfiche processing in mind.
|[[Image:document_viewer_00.png|center|150px|link=Document Viewer]]
** [[Extract Page]]
|[[Image:Separation_and_review_18.png|center|175px|link=Separation and Separation Review]]
** [[Scratch Removal]]
|-
|style="text-align:center"|'''[[Compile Stats]]'''
|style="text-align:center"|'''[[Microsoft Office Integration]]'''
|style="text-align:center"|'''[[Document Viewer]]'''
|style="text-align:center"|'''[[Separation and Separation Review]]'''
|-
|[[Image:data_review_00.png|center|200px|link=Data Review]]
|[[Image:Weighted_rules_00.png|center|200px|link=Confidence Multiplier]]
|[[Image:Data_element_overrides_000.png|center|150px|link=Data Element Overrides]]
|[[Image:Database_export_002.png|center|200px|link=Database Export]]
|-
|style="text-align:center"|'''[[Data Review]]'''
|style="text-align:center"|'''[[Confidence Multiplier]]'''
|style="text-align:center"|'''[[Data Element Overrides]]'''
|style="text-align:center"|'''[[Database Export]]'''
|-
|[[Image:Cmis_lookup_002.png|center|200px|link=CMIS Lookup]]
|[[Image:Content_type_filter_000.png|center|100px|link=Content Type Filter]]
|[[Image:Output_extractor_key_000.png|center|200px|link=Output Extractor Key]]
|[[Image:box_cmis_binding_000.png|center|200px|link=Box (CMIS Binding)]]
|-
|style="text-align:center"|'''[[CMIS Lookup]]'''
|style="text-align:center"|'''[[Content Type Filter]]'''
|style="text-align:center"|'''[[Output Extractor Key]]'''
|style="text-align:center"|'''[[Box (CMIS Binding)]]'''
|-
|colspan="4"|[[Image:Linq_to_grooper_objects_001.png|center|200px|link=LINQ to Grooper Objects]]
|-
|colspan="4" style="text-align:center"|'''[[LINQ to Grooper Objects]]'''
|}


Two additional batch activities
|
* [[Recognize]] - Combining the old OCR and PDF Extract activities.
[[File:American-airlines-credit-union-financial-services-document-data-capture-integration-grooper.jpg|400px|right|link=https://www.bisok.com/case-studies/electronic-data-discovery-case-study/]]
* [[Generate PDF]] - Generating PDF content from processed documents, including native-PDF element creation (such as signature widgets).


Two additional IP commands
<blockquote style="font-size:14pt">
* [[Shape Removal]]
'''They’re Saving Over 5,000 Hours Every Year in Data Discovery and Processing'''
* [[Shade Removal]]
</blockquote>
 
New extraction methods available to data fields
* [[Anchored Extract]]
* [[Anchored OMR]]
* [[Find Barcode]]
* [[Read Barcode]]
* [[Zonal Extract]]


Simpler and expanded [[Database Lookup]] capabilities.


Expression based [[Field Mapping]] between data elements and their locations in external storage platforms, allowing for easier data formatting and exporting of batch processing metadata.
American Airlines Credit Union has transformed their data workflows, quickly saving thousands of hours in electronic data discovery , resulting in much greater efficiency and improved member services.
|
<blockquote style="font-size:14pt">
Data Extraction In Action: Saving Hundreds of Thousands of Dollars in 6 Months
</blockquote>


Slowed by expensive and tedious data workflows with its current capture
Discover how they:
system, Oklahoma State University chose Grooper. They saw a quick
return on investment, modernized data applications, streamlined student
record processing in many ways, and can communicate with prospective
students faster.


Key Outcomes
* Quickly found 40,000 specific files among one billion
* Reduced Months of Work in Admissions
* Easily integrated with data silos and content management systems when no other solution would
* Fully Automated Transcript Processing
* Have cut their mortgage processing time in half (and they process mortgages for 47 branch offices!)
* Increased Enrollment Possibilities
* Learn from the document and electronic data discovery experts at BIS!
* Software Flexibility Leads to Cost Savings
* Meet Project Deadlines
* Increased Workflow Efficiency with Smart Document Classification
* Easy Multi-Campus Deployment
* Simplified, Economical Data Migration
* Protection of Sensitive Information


[https://www.bisok.com/case-studies/database-extraction-case-study/ You can access the full case study clicking this link].
[https://www.bisok.com/case-studies/electronic-data-discovery-case-study/ You can access the full case study clicking this link].
|}
|}


Line 115: Line 119:
* [http://grooper.bisok.com/Documentation/2.80/Main/HTML5/index.htm#t=Start_Page.htm 2.80 Reference Documentation]
* [http://grooper.bisok.com/Documentation/2.80/Main/HTML5/index.htm#t=Start_Page.htm 2.80 Reference Documentation]
* [http://grooper.bisok.com/Documentation/2.80/SDK/HTML5/index.htm#t=Developer_Reference.htm 2.80 SDK Documentation]
* [http://grooper.bisok.com/Documentation/2.80/SDK/HTML5/index.htm#t=Developer_Reference.htm 2.80 SDK Documentation]
* [https://grooper.bisok.com/Documentation/2.90/Main/HTML5/index.htm#t=Start_Page.htm 2.90 Reference Documentation]
|style="width:25%"|
|style="width:25%"|
* [https://go.bisok.com/summer-of-grooper-2019-events-overview Summer of Grooper Webinars]
* [https://blog.bisok.com/webinars Webinars and Video]
* [https://www.bisok.com/white-papers/ BIS White Papers]
* [https://www.bisok.com/white-papers/ BIS White Papers]
* [https://www.bisok.com/case-studies/ Case Studies]
* [https://www.bisok.com/case-studies/ Case Studies]

Revision as of 10:02, 23 September 2020

Getting Started

Grooper is a software application that helps organizations innovate workflows by integrating difficult data.

Grooper empowers rapid innovation for organizations processing and integrating large quantities of difficult data. Created by a team of courageous developers frustrated by limitations in existing solutions, Grooper is an intelligent document and digital data integration platform. Grooper combines patented and sophisticated image processing, capture technology, machine learning, and natural language processing. Grooper – intelligent document processing; limitless, template-free data integration.

Getting Started
Install and Setup
2.90 Reference Documentation


Featured Articles Did you know?

Data Context

Data without context is meaningless. Context is critical to understanding and modeling the relationships between pieces of information on a document. Without context, it’s impossible to distinguish one data element from another. Context helps us understand what data refers to or “means”.

This allows us to build an extraction logic using Data Type and Field Class extractors in order to build and populate a Data Model.

There are three fundamental data context relationships:

  • Syntactic - Context given by the syntax of data.
  • Semantic - Context given by the lexical content associated with the data.
  • Spatial - Context given by where the data exists on the page, in relationship with other data.

Using the context these relationships provide allows us to understand how to target data with extractors.

You can now manually manipulate the confidence of an extraction result. The Confidence Multiplier and Output Confidence properties of Data Type and Data Format extractors allow you to change the confidence score of extraction results. No longer are you forced to accept the score Grooper provides. These properties give you more control when it comes to what confidence a result should be.

This allows you to prioritize certain results over others. You can create a kind of "fall back" or "safety net" result by using this property. You can even increase the confidence of an extractor's result, allowing you to give more weight to a fuzzy extractor's result over a non-fuzzy one, for example.

For more information visit, the Confidence Multiplier and Output Confidence article.

New in 2.9 Featured Use Case

Welcome to Grooper 2.9!
Below you will find helpful links to all the articles about the new/changed functionality in this version of Grooper.

Compile Stats Microsoft Office Integration Document Viewer Separation and Separation Review
Data Review Confidence Multiplier Data Element Overrides Database Export
CMIS Lookup Content Type Filter Output Extractor Key Box (CMIS Binding)
LINQ to Grooper Objects

They’re Saving Over 5,000 Hours Every Year in Data Discovery and Processing


American Airlines Credit Union has transformed their data workflows, quickly saving thousands of hours in electronic data discovery , resulting in much greater efficiency and improved member services.

Discover how they:

  • Quickly found 40,000 specific files among one billion
  • Easily integrated with data silos and content management systems when no other solution would
  • Have cut their mortgage processing time in half (and they process mortgages for 47 branch offices!)
  • Learn from the document and electronic data discovery experts at BIS!

You can access the full case study clicking this link.


Other Resources