GPT Integration (Concept) - Revision history

Dgreenwood at 21:42, 27 August 2025

2025-08-27T21:42:49Z

← Older revision		Revision as of 16:42, 27 August 2025
Line 1:		Line 1:
			__NOINDEX__
	{\|class="important-box"		{\|class="important-box"
	\|		\|

Dgreenwood at 19:47, 27 August 2025

2025-08-27T19:47:23Z

Dgreenwood at 21:29, 12 May 2025

2025-05-12T21:29:23Z

← Older revision		Revision as of 16:29, 12 May 2025
Line 31:		Line 31:
	GPT (Generative Pre-trained Transformer) integration can be used for three things in '''Grooper''':		GPT (Generative Pre-trained Transformer) integration can be used for three things in '''Grooper''':
	* '''[[#GPT Complete (Extractor Type)\|Extraction]]''' - Prompt the GPT model to return information it finds in a document.		* '''[[#GPT Complete (Extractor Type)\|Extraction]]''' - Prompt the GPT model to return information it finds in a document.
	* '''[[#GPT Embeddings (~~Classification~~ Method)\|Classification]]''' - GPT has been trained against a massive corpus of information, which allows for a lot of potential when it comes to classifying documents. The idea here is that because it's seen so much, the amount of training required in '''Grooper''' should be less.		* '''[[#GPT Embeddings (Classify Method)\|Classification]]''' - GPT has been trained against a massive corpus of information, which allows for a lot of potential when it comes to classifying documents. The idea here is that because it's seen so much, the amount of training required in '''Grooper''' should be less.
	* '''[[#GPT Lookup (Lookup Specification)\|Lookup]]''' - With a GPT lookup you can provide information collected from a model in '''Grooper''' as <code><span style="color:#ff00ff">@</span></code> variables in a prompt to have GPT generate data.		* '''[[#GPT Lookup (Lookup Specification)\|Lookup]]''' - With a GPT lookup you can provide information collected from a model in '''Grooper''' as <code><span style="color:#ff00ff">@</span></code> variables in a prompt to have GPT generate data.

Line 81:		Line 81:
	Please visit the '''''[[GPT Complete (Extractor Type)\|GPT Complete]]''''' article for more information.		Please visit the '''''[[GPT Complete (Extractor Type)\|GPT Complete]]''''' article for more information.

	=== GPT Embeddings (~~Classification~~ Method) ===		=== GPT Embeddings (Classify Method) ===
	{{#lst:Glossary\|GPT Embeddings}}		{{#lst:Glossary\|GPT Embeddings}}
	Please visit the '''''[[GPT Embeddings (~~Classification~~ Method)\|GPT Embeddings]]''''' article for more information.		Please visit the '''''[[GPT Embeddings (Classify Method)\|GPT Embeddings]]''''' article for more information.

	=== GPT Lookup (Lookup Specification) ===		=== GPT Lookup (Lookup Specification) ===
	{{#lst:Glossary\|GPT Lookup}}		{{#lst:Glossary\|GPT Lookup}}
	Please visit the '''''[[GPT Lookup]]''''' article for more information.		Please visit the '''''[[GPT Lookup]]''''' article for more information.

Dgreenwood at 21:22, 4 March 2025

2025-03-04T21:22:56Z

← Older revision		Revision as of 16:22, 4 March 2025
Line 1:		Line 1:
	{{~~Migrated~~}}		{\|class="important-box"
	{{~~2023~~:{{~~PAGENAME~~}}}}		\|
			'''!!'''
			\|
			'''LEGACY TECHNOLOGY DETECTED!!'''

			"GPT Integration" refers to Grooper's early attempts at integrating OpenAI's GPT models into the product. The information in this article is largely obsolete.

			For more current information on Grooper's integration with AI technologies, refer to the following resources:
			* [[Grooper and AI]] - An overview of Grooper's AI integrations.
			* [[Ask AI]] - An LLM-based extractor type.
			* [[AI Extract]] - A "Fill Method" using LLMs for large scale data extraction with minimal setup.
			* [[Clause Detection]] - An LLM embeddings based Data Section extract method.
			\|}
			[[File:OpenAI Logo.svg.png\|right\|thumb\|500px\|Enhancing Grooper by integrating with modern AI technology.]]

			<blockquote>{{#lst:Glossary\|GPT Integration}}</blockquote>

			OpenAI's GPT model has made waves in the world of computing. Our '''Grooper''' developers recognized the potential for this to grow '''Grooper's''' capabilities. Adding its functionality will allow for users to explore and find creative solutions for processing their documents using this advanced technology.

			{\|class="download-box"
			\|
			[[File:Asset 22@4x.png]]
			\|
			You may download the ZIP(s) below and upload it into your own Grooper environment (version 2023). The first contains one or more '''Batches''' of sample documents. The second contains one or more '''Projects''' with resources used in examples throughout this article.
			* [[Media:2023_Wiki_GPT-Integration_Batch.zip]]
			* [[Media:2023_Wiki_GPT-Integration_Project.zip]]
			\|}

			== ABOUT ==
			GPT (Generative Pre-trained Transformer) integration can be used for three things in '''Grooper''':
			* '''[[#GPT Complete (Extractor Type)\|Extraction]]''' - Prompt the GPT model to return information it finds in a document.
			* '''[[#GPT Embeddings (Classification Method)\|Classification]]''' - GPT has been trained against a massive corpus of information, which allows for a lot of potential when it comes to classifying documents. The idea here is that because it's seen so much, the amount of training required in '''Grooper''' should be less.
			* '''[[#GPT Lookup (Lookup Specification)\|Lookup]]''' - With a GPT lookup you can provide information collected from a model in '''Grooper''' as <code><span style="color:#ff00ff">@</span></code> variables in a prompt to have GPT generate data.

			In this article you will be shown how '''Grooper''' leverages GPT for the aforementioned methods. Some example use cases will be given to demonstrate a basic approach. Given the nature of the way this technology works, it will be up to the user to get creative about how this can be used for their needs.

			== Things to Consider ==
			Before moving forward it would be prudent to mention a few things about GPT and how to use it.

			=== Prompt Engineering ===
			This first thing to consider is how to structure a good prompt so that you get the results you are expecting. There is a bit of an art to knowing how to do this. GPT can tell bad jokes and write accidentally hilarious poems about your life, but it can also help you do your job better. The catch: you need to help it do its job better, too. At its most basic level, OpenAI's GPT-3 and GPT-4 predict text based on an input called a prompt. But to get the best results, you need to write a clear prompt with ample context. Further on in this article when the GPT Complete Value Extractor is being demonstrated you will see an example of prompt engineering.

			Follow [https://www.allabtai.com/prompt-engineering/ this link], or perhaps even [https://zapier.com/blog/gpt-prompt/ this one], for more information on prompt engineering.

			=== Tokens and Pricing ===
			Another consideration is the way GPT pricing works. You are going to be charged for the "tokens" used when interacting with GPT. To that end, the prompt that you write, the text that you leverage to get a result, and the result that is returned to you are all considered part of the token consumption. You will need to be considerate of this as you build and use GPT in your models.

			Follow [https://help.openai.com/en/articles/4936856-what-are-tokens-and-how-to-count-them this link] for more information on what tokens are.

			Follow [https://openai.com/pricing this link] for more information on GPT pricing.

			=== Location Data for Data Extraction ===
			The final thing to consider is in regards to the ''GPT Complete'' '''''Value Extractor''''' type (more on this soon.) If you have used '''Grooper''' before then you are probably familiar with how a returned value is highlighted with a green box in the document viewer. One of the main strengths of '''Grooper's''' text synthesis is that it collects location information for each character which allows this highlighting to occur. The GPT model does not consider location information when generating its results which means there will be no highlighting on the document for values collected with this method. The main impact this will have is on your ability to validate information returned by the GPT model.

			== How To ==
			With the discussion of concepts out of the way, it is time to get into Grooper and see how and where to use the GPT integration.

			=== Obtain an API Key ===
			Grooper is able to integrate with OpenAI's GPT model because they have provided a web API. All we need in order use the Grooper GPT functionality is an API key. Here you will learn how to obtain an API key for yourself so you can start using GPT with Grooper.

			# The first thing you should do is visit [https://platform.openai.com/ OpenAI API site] and login or create an account.
			# Once logged in, click the "Personal" menu in the top right.
			# Within in this menu click the "View API Keys" option, which will take you to the "API keys" page.

			[[Image:GPT Integration 001.png]]


			# <li value=4> On the "API keys" page, click the "+ Create new secret key" button, which will make an "API key generated" pop-up.

			[[Image:GPT Integration 002.png]]


			# <li value=5> Highlight and copy, or click the copy button to copy the key string to your clipboard.
			#* A word of warning here. You '''WILL NOT''' get another chance to copy this string. You can always create a new one, but once you close this pop-up, you will not have another chance to copy the key string out.

			[[Image:GPT Integration 003.png]]

			=== GPT Complete (Extractor Type) ===
			{{#lst:Glossary\|GPT Complete}}
			Please visit the '''''[[GPT Complete (Extractor Type)\|GPT Complete]]''''' article for more information.

			=== GPT Embeddings (Classification Method) ===
			{{#lst:Glossary\|GPT Embeddings}}
			Please visit the '''''[[GPT Embeddings (Classification Method)\|GPT Embeddings]]''''' article for more information.

			=== GPT Lookup (Lookup Specification) ===
			{{#lst:Glossary\|GPT Lookup}}
			Please visit the '''''[[GPT Lookup]]''''' article for more information.

Randallkinard at 16:04, 28 August 2024

2024-08-28T16:04:28Z

← Older revision		Revision as of 11:04, 28 August 2024
Line 1:		Line 1:
	{{~~Migrated2023~~}}		{{Migrated}}
	{{2023:{{PAGENAME}}}}		{{2023:{{PAGENAME}}}}

Randallkinard: Randallkinard moved page GPT Integration to GPT Integration (Concept): new naming convention

2024-04-17T16:53:15Z

Randallkinard moved page GPT Integration to GPT Integration (Concept): new naming convention

← Older revision	Revision as of 11:53, 17 April 2024
(No difference)

Dgreenwood: Removed redirect to GPT Integration - 2023

2023-12-28T17:51:15Z

Removed redirect to GPT Integration - 2023

← Older revision		Revision as of 12:51, 28 December 2023
Line 1:		Line 1:
	~~#REDIRECT [[GPT Integration -~~ 2023]]		{{Migrated2023}}
			{{2023:{{PAGENAME}}}}

Randallkinard: Randallkinard moved page GPT Integration to GPT Integration - 2023

2023-04-14T15:53:02Z

Randallkinard moved page GPT Integration to GPT Integration - 2023

New page

#REDIRECT [[GPT Integration - 2023]]

← Older revision		Revision as of 14:47, 27 August 2025
Line 9:		Line 9:
	For more current information on Grooper's integration with AI technologies, refer to the following resources:		For more current information on Grooper's integration with AI technologies, refer to the following resources:
	* [[Grooper and AI]] - An overview of Grooper's AI integrations.		* [[Grooper and AI]] - An overview of Grooper's AI integrations.
	* [[Ask AI]] - An LLM-based extractor ~~type~~.		* [[Ask AI]] - An LLM-based extractor.
	* [[AI Extract]] - A "Fill Method" using LLMs for large scale data extraction with minimal setup.		* [[AI Extract]] - A "Fill Method" using LLMs for large scale data extraction with minimal setup.
	* [[Clause Detection]] - An LLM embeddings based Data Section extract method.		* [[Clause Detection]] - An LLM embeddings based Data Section extract method.
Line 30:		Line 30:
	== ABOUT ==		== ABOUT ==
	GPT (Generative Pre-trained Transformer) integration can be used for three things in '''Grooper''':		GPT (Generative Pre-trained Transformer) integration can be used for three things in '''Grooper''':
	* '''[[#GPT Complete (Extractor ~~Type~~)\|Extraction]]''' - Prompt the GPT model to return information it finds in a document.		* '''[[#GPT Complete (Value Extractor)\|Extraction]]''' - Prompt the GPT model to return information it finds in a document.
	* '''[[#GPT Embeddings (Classify Method)\|Classification]]''' - GPT has been trained against a massive corpus of information, which allows for a lot of potential when it comes to classifying documents. The idea here is that because it's seen so much, the amount of training required in '''Grooper''' should be less.		* '''[[#GPT Embeddings (Classify Method)\|Classification]]''' - GPT has been trained against a massive corpus of information, which allows for a lot of potential when it comes to classifying documents. The idea here is that because it's seen so much, the amount of training required in '''Grooper''' should be less.
	* '''[[#GPT Lookup (Lookup Specification)\|Lookup]]''' - With a GPT lookup you can provide information collected from a model in '''Grooper''' as <code><span style="color:#ff00ff">@</span></code> variables in a prompt to have GPT generate data.		* '''[[#GPT Lookup (Lookup Specification)\|Lookup]]''' - With a GPT lookup you can provide information collected from a model in '''Grooper''' as <code><span style="color:#ff00ff">@</span></code> variables in a prompt to have GPT generate data.
Line 77:		Line 77:
	[[Image:GPT Integration 003.png]]		[[Image:GPT Integration 003.png]]

	=== GPT Complete (Extractor ~~Type~~) ===		=== GPT Complete (Value Extractor) ===
	{{#lst:Glossary\|GPT Complete}}		{{#lst:Glossary\|GPT Complete}}
	Please visit the '''''[[~~GPT Complete (Extractor Type)\|~~GPT Complete]]''''' article for more information.		Please visit the '''''[[GPT Complete]]''''' article for more information.

	=== GPT Embeddings (Classify Method) ===		=== GPT Embeddings (Classify Method) ===