2024:Grooper and AI

Grooper version 2024 is GrooperAI!

Version 2024 contains a slew of features incorporating cutting edge AI technologies into Grooper. That's why we're calling this version GrooperAI. These AI based features accelerate Grooper's design and development. GrooperAI makes deployment easier, gets results with less setup, and incorporates a document search and retrieval mechanism for the first time.

GrooperAI's features include:

• Large Language Model (LLM) based data extraction at scale
• Document assistants allowing users to chat with their documents
• A robust and speedy document search and retrieval mechanism

OpenAI and Azure account setup

For Azure OCR connectivity

GrooperAI can implement Azure AI Vision's Read engine for OCR. "Read" is machine learning based OCR engine used to recognize text from images with superior accuracy.

Azure OCR Quickstart

In Azure:

1. If not done so already, create an Azure account.
2. Go to your Azure portal
3. If not done so already, create a "Subscription" and "Resource Group."
4. Click the "Create a resource" button
5. Search for "Computer Vision"
6. Find "Computer Vision" in the list click the "Create" button.
7. Follow the prompts to create the Computer Vision resource.
8. Go to the resource.
9. Under "Keys and endpoint", copy the API key.

In Grooper

1. Go to an OCR Profile in Grooper.
2. For the OCR Engine property, select Azure OCR.
3. Paste the API key in the API Key property.
4. Adjust the API Region property to match your Computer Vision resource's Region value
   • You can find this by going to the resource in the Azure portal and inspecting its "Location" value.

Additional resources

• Azure AI Vision overview
• Azure AI Vision full documentation
• Azure OCR (Read) documentation
• Deploy Azure OCR (Read) on prem

For Azure Document Intelligence OCR connectivity

Azure Document Intelligence is a variation on Azure OCR. It is designed to extract text, key/value pairs and tables from documents. Be aware, Grooper's integration with Document Intelligence is still in beta development.

Azure Document Intelligence Quickstart

In Azure:

1. If not done so already, create an Azure account.
2. Go to your Azure portal
3. If not done so already, create a "Subscription" and "Resource Group."
4. Click the "Create a resource" button
5. Search for "Document Intelligence"
6. Find "Document Intelligence (form recognizer)" in the list click the "Create" button.
7. Follow the prompts to create the Document Intelligence resource.
8. Go to the resource.
9. Copy the resource's name (You will need this in Grooper)
10. Under "Keys and endpoint", copy the API key (You will need this in Grooper).

In Grooper

1. Go to an OCR Profile in Grooper.
2. For the OCR Engine property, select Azure Document Intelligence OCR.
3. Paste the API key in the API Key property.
4. Paste the resource's name in the Resource Name property.

Additional resources

• Azure Document Intelligence overview
• Azure Document Intelligence full documentation

For Azure AI Search connectivity

GrooperAI uses Azure AI Search's API to create a document search and retrieval mechanism.

Azure AI Search Quickstart

In Azure:

1. If not done so already, create an Azure account.
2. Go to your Azure portal
3. If not done so already, create a "Subscription" and "Resource Group."
4. Click the "Create a resource" button
5. Search for "Azure AI Search"
6. Find "Azure AI Search" in the list click the "Create" button.
7. Follow the prompts to create the Azure AI Search resource.
   • The pricing tier defaults to "Standard". There is a "Free" option if you're just wanting to try this feature out.
8. Go to the resource.
9. In the "Essentials" panel, copy the "Url" value. You will need this in Grooper.
10. In the left-hand navigation panel, expand "Settings" and select "Keys"
11. Copy the "Primary admin key" or "Secondary admin key." You will need this in Grooper.

In Grooper:

1. Connect to the Azure AI Search service by adding the "AI Search" option to your Grooper Repository.
2. From the Design page, go to the Grooper Root node.
3. Select the Options property and open its editor.
4. Add the AI Search option.
5. Paste the AI Search service's URL in the API Key property.
6. Paste the AI Search service's API key in the API Key property.
7. Full documentation on Grooper's AI Search capabilities can be found in the Azure AI Search article.

Additional resources

• Create an AI Search service in the Azure portal
• Azure AI Search full documentation

For LLM connectivity

GrooperAI can integrate with OpenAI and Microsoft Azure's LLM models to implement various LLM-based functionality. Before you are able to connect Grooper to these resources, you will need accounts setup with these providers. For information on how to set up these accounts/resources, refer to the following links:

OpenAI LLM Quickstart

In OpenAI:

1. If you have not done so already, create an OpenAI account.
2. Go to the API keys section of the OpenAI Platform.
3. Press the "Crate new secret key" button.
4. Follow the prompts to create a new key.
5. Copy the API key. You will not be able to view/copy it again.

In Grooper:

1. Connect to the OpenAI API by adding an "LLM Connector" option to your Grooper Repository.
2. From the Design page, go to the Grooper Root node.
3. Select the Options property and open its editor.
4. Add the LLM Connector option.
5. Select the Service Providers property and open its editor.
6. Add an OpenAI provider.
7. Paste the OpenAI API key in the API Key property.
8. Refer to the following articles for more information on functionality enabled by the LLM Connector:
   • Ask AI
   • AI Extract
   • Clause Detection
   • AI Analyst
   • AI Generator

Additional resources

• OpenAI full documentation

Azure LLM Quickstart

This documentation is a work in progress. It will be finished pending research from the author.

In Azure:

1. If not done so already, create an Azure account.
2. Go to your Azure portal
3. If not done so already, create a "Subscription" and "Resource Group."
4. Click the "Create a resource" button
5. Search for "Azure Machine Learning"
6. Find "Azure Machine Learning" in the list click the "Create" button.
7. Follow the prompts to create the Azure Machine Learning resource.
8. Go to the resource.
9. Launch "Machine Learning Studio"
   • Once you've created an Azure Machine Learning resource, you can launch Azure Machine Learning Studio by going to ml.azure.com
10. In the left-hand navigation panel, select "Model catalog"
11. Select the model you wish to use from the list.
    • Grooper's integration with Azure's Model Catalog uses either "chat completion" or "embeddings" models depending on the feature. To better narrow down your list of options, expand the "Inference tasks" dropdown and select "Chat completion" and/or "Embeddings."
    • Embeddings models are only required when using Clause Detection or the "Semantic" Document Quoting method in Grooper.

In Grooper:

1. Connect to a model in the Azure Model Catalog by adding an "LLM Connector" option to your Grooper Repository.
2. From the Design page, go to the Grooper Root node.
3. Select the Options property and open its editor.
4. Add the LLM Connector option.
5. Select the Service Providers property and open its editor.
6. Add an Azure Provider.
7. Select the Deployments property and open its editor.
8. Add one or more Chat Services and/or Embeddings Services.
   • Embeddings Services are only required when using Clause Detection or the "Semantic" Document Quoting method.
9. Refer to the following articles for more information on functionality enabled by the LLM Connector:
   • Ask AI
   • AI Extract
   • Clause Detection
   • AI Analyst
   • AI Generator

Additional resources

• Azure Machine Learning overview
• Azure AI model catalog
• Azure AI model documentation