Clause Detection (Section Extract Method) - Revision history

Dgreenwood at 13:33, 27 August 2025

2025-08-27T13:33:19Z

Randallkinard at 17:48, 21 November 2024

2024-11-21T17:48:05Z

← Older revision		Revision as of 12:48, 21 November 2024
Line 55:		Line 55:

	[[image: 2024_Clause-Detection_01_04.png]]		[[image: 2024_Clause-Detection_01_04.png]]

	~~== Glossary ==~~
	~~<u><big>'''AI Extract'''</big></u>: {{#lst:Glossary\|AI Extract}}~~

	~~<u><big>'''Batch'''</big></u>: {{#lst:Glossary\|Batch}}~~

	~~<u><big>'''Data Field'''</big></u>: {{#lst:Glossary\|Data Field}}~~

	~~<u><big>'''Data Model'''</big></u>: {{#lst:Glossary\|Data Model}}~~

	~~<u><big>'''Data Section'''</big></u>: {{#lst:Glossary\|Data Section}}~~

	~~<u><big>'''Document Viewer'''</big></u>: {{#lst:Glossary\|Document Viewer}}~~

	~~<u><big>'''Extract'''</big></u>: {{#lst:Glossary\|Extract}}~~

	~~<u><big>'''Fill Method'''</big></u>: {{#lst:Glossary\|Fill Method}}~~

	~~<u><big>'''Preprocessing'''</big></u>: {{#lst:Glossary\|Preprocessing}}~~

	~~<u><big>'''Project'''</big></u>: {{#lst:Glossary\|Project}}~~

	~~<u><big>'''Section Extract Method'''</big></u>: {{#lst:Glossary\|Section Extract Method}}~~

Randallkinard at 13:26, 28 August 2024

2024-08-28T13:26:33Z

← Older revision		Revision as of 08:26, 28 August 2024
Line 1:		Line 1:
	{{~~beta~~}}		{{AutoVersion}}

	<blockquote>{{#lst:Glossary\|Clause Detection}}</blockquote>		<blockquote>{{#lst:Glossary\|Clause Detection}}</blockquote>

Randallkinard at 14:24, 26 August 2024

2024-08-26T14:24:10Z

@@ Line 11: / Line 11: @@
 * [[Media:2024_Wiki_Clause-Detection_Project.zip]]
 |}
 == About ==
@@ Line 78: / Line 55: @@
 [[image: 2024_Clause-Detection_01_04.png]]

Randallkinard at 13:57, 3 August 2024

2024-08-03T13:57:47Z

← Older revision		Revision as of 08:57, 3 August 2024
Line 1:		Line 1:
	{{~~AutoVersion~~}}		{{beta}}

	<blockquote>{{#lst:Glossary\|Clause Detection}}</blockquote>		<blockquote>{{#lst:Glossary\|Clause Detection}}</blockquote>

Randallkinard: /* Glossary */

2024-07-31T19:16:31Z

Glossary

← Older revision		Revision as of 14:16, 31 July 2024
Line 13:		Line 13:

	== Glossary ==		== Glossary ==
			<u><big>'''AI Extract'''</big></u>: {{#lst:Glossary\|AI Extract}}

			<u><big>'''Batch'''</big></u>: {{#lst:Glossary\|Batch}}

			<u><big>'''Data Field'''</big></u>: {{#lst:Glossary\|Data Field}}

			<u><big>'''Data Model'''</big></u>: {{#lst:Glossary\|Data Model}}

			<u><big>'''Data Section'''</big></u>: {{#lst:Glossary\|Data Section}}

			<u><big>'''Document Viewer'''</big></u>: {{#lst:Glossary\|Document Viewer}}

			<u><big>'''Extract'''</big></u>: {{#lst:Glossary\|Extract}}

			<u><big>'''Fill Method'''</big></u>: {{#lst:Glossary\|Fill Method}}

			<u><big>'''Preprocessing'''</big></u>: {{#lst:Glossary\|Preprocessing}}

			<u><big>'''Project'''</big></u>: {{#lst:Glossary\|Project}}

			<u><big>'''Section Extract Method'''</big></u>: {{#lst:Glossary\|Section Extract Method}}

	== About ==		== About ==

Randallkinard: /* How To */

2024-07-31T19:13:42Z

How To

← Older revision		Revision as of 14:13, 31 July 2024
Line 27:		Line 27:

	In so doing we will not only be leveraging AI to easily extract the data we are after, but we will also be using AI to make ''using'' AI more efficient.		In so doing we will not only be leveraging AI to easily extract the data we are after, but we will also be using AI to make ''using'' AI more efficient.


			# Select the "Granting Clause" '''Data Section''' from the provided '''Project'''.
			# Click the drop-down for the '''''Extract Method''''' property.
			# Select ''Clause Detection'' from the drop-down menu.

			[[image: 2024_Clause-Detection_01_01.png]]


			# <li value=4>Expand the sub-properties and click the ellipsis button for the '''''Model''''' property.</li>
			# In the "Model" window select ''text-embedding-3-large''. Feel free to experiment with the other models.

			[[image: 2024_Clause-Detection_01_02.png]]


			# <li value=6>Click the ellipsis button on the '''''Queries''''' property.</li>
			# In the "Queries" window click the "Add" button.
			# This will add an entry to the "Sample Content".
			# Click the ellipsis button on the '''''Sample Content''''' property.
			# In the "Sample Content" window add the provided sample clause.<pre>AGREEMENT, Made and entered into this [Effective Date] , by and between[Lessor Name] whose address is [Lessor Address] hereinafter called Lessor and [Lessee Name] whose address is [Lessee Address] hereinafter called Lessee.Lessor hereby grants, leases, and lets unto Lessee, for the purpose of investigating, exploring, drilling, developing, and producing oil, gas, and other hydrocarbons, and storing, handling, and transporting the same, all the oil and gas rights and interests in and under the land described as follows: [Legal Description of Property], containing approximately [Number of Acres] acres, more or less (hereinafter referred to as the "Leased Premises").</pre>

			[[image: 2024_Clause-Detection_01_03.png]]


			# <li value=11>Click the "Tester" tab.</li>
			# Be sure to select the document from the supplied '''Batch''' in the '''Batch Viewer'''.
			# Click the "Test" button.
			# View the extracted results in the '''Data Model Preview''' and see the highlighting in the '''Document Viewer".

			[[image: 2024_Clause-Detection_01_04.png]]

Randallkinard at 18:19, 31 July 2024

2024-07-31T18:19:01Z

← Older revision		Revision as of 13:19, 31 July 2024
Line 9:		Line 9:
	You may download the ZIP(s) below and upload it into your own Grooper environment (version 2024). The first contains one or more '''Batches''' of sample documents. The second contains one or more '''Projects''' with resources used in examples throughout this article.		You may download the ZIP(s) below and upload it into your own Grooper environment (version 2024). The first contains one or more '''Batches''' of sample documents. The second contains one or more '''Projects''' with resources used in examples throughout this article.
	* [[Media:2024_Wiki_Clause-Detection_Batch.zip]]		* [[Media:2024_Wiki_Clause-Detection_Batch.zip]]
	* [[Media:2024_Wiki_Clause-~~Detection~~.zip]]		* [[Media:2024_Wiki_Clause-Detection_Project.zip]]
	\|}		\|}

Randallkinard: /* How To */

2024-07-31T18:12:27Z

How To

← Older revision		Revision as of 13:12, 31 July 2024
Line 20:		Line 20:

	== How To ==		== How To ==
			In the following walkthrough we are going to setup '''''Clause Detection''''' on the '''Data Section''' of a provided project. The '''Data Section''' being a "container" of several descendant '''Data Fields''' will leverage the '''''AI Extract''''' '''''Fill Method''''' to collect the data for those fields.

			The document we will be extracting against from the provided '''Batch''' consists of several pages with quite a few words in total. Given that fact, it would be costly to run '''''AI Extract''''' against the entire text of the document. To solve this problem we will use the '''Data Section''' for one of its key functions which is to define a subset of data within the document. In so doing we will drastically reduce the amount of text given to the LLM AI and as such greately reduce the tokens consumed and the time taken to run extraction.

			Because we do not know the exact wording of the clause we will define as the structure of our '''Data Section''' it can prove quite challenging to attempt to define the structure of the '''Data Section''' via pattern matching. This is where '''''Clause Detection''''' will come into play. We can provide a sample of what the language of the clause we are looking for may be like. This sample will be leveraged within a text embeddings model (which we learned above is faster and cheaper than standard chatbot queries) to find a clause within the text of the document that is of high similarity to the sample.

			In so doing we will not only be leveraging AI to easily extract the data we are after, but we will also be using AI to make ''using'' AI more efficient.

Randallkinard: /* About */

2024-07-31T17:08:51Z

About

← Older revision		Revision as of 12:08, 31 July 2024
Line 15:		Line 15:

	== About ==		== About ==
			[[image: 2024_Clause-Detection_00_01.png]]

			{{#lst:Document Quoting\|Semantic}}

	== How To ==		== How To ==

← Older revision		Revision as of 12:48, 21 November 2024
Line 55:		Line 55:

	[[image: 2024_Clause-Detection_01_04.png]]		[[image: 2024_Clause-Detection_01_04.png]]

	~~== Glossary ==~~
	~~<u><big>'''AI Extract'''</big></u>: {{#lst:Glossary\|AI Extract}}~~

	~~<u><big>'''Batch'''</big></u>: {{#lst:Glossary\|Batch}}~~

	~~<u><big>'''Data Field'''</big></u>: {{#lst:Glossary\|Data Field}}~~

	~~<u><big>'''Data Model'''</big></u>: {{#lst:Glossary\|Data Model}}~~

	~~<u><big>'''Data Section'''</big></u>: {{#lst:Glossary\|Data Section}}~~

	~~<u><big>'''Document Viewer'''</big></u>: {{#lst:Glossary\|Document Viewer}}~~

	~~<u><big>'''Extract'''</big></u>: {{#lst:Glossary\|Extract}}~~

	~~<u><big>'''Fill Method'''</big></u>: {{#lst:Glossary\|Fill Method}}~~

	~~<u><big>'''Preprocessing'''</big></u>: {{#lst:Glossary\|Preprocessing}}~~

	~~<u><big>'''Project'''</big></u>: {{#lst:Glossary\|Project}}~~

	~~<u><big>'''Section Extract Method'''</big></u>: {{#lst:Glossary\|Section Extract Method}}~~

← Older revision		Revision as of 14:16, 31 July 2024
Line 13:		Line 13:

	== Glossary ==		== Glossary ==
			<u><big>'''AI Extract'''</big></u>: {{#lst:Glossary\|AI Extract}}

			<u><big>'''Batch'''</big></u>: {{#lst:Glossary\|Batch}}

			<u><big>'''Data Field'''</big></u>: {{#lst:Glossary\|Data Field}}

			<u><big>'''Data Model'''</big></u>: {{#lst:Glossary\|Data Model}}

			<u><big>'''Data Section'''</big></u>: {{#lst:Glossary\|Data Section}}

			<u><big>'''Document Viewer'''</big></u>: {{#lst:Glossary\|Document Viewer}}

			<u><big>'''Extract'''</big></u>: {{#lst:Glossary\|Extract}}

			<u><big>'''Fill Method'''</big></u>: {{#lst:Glossary\|Fill Method}}

			<u><big>'''Preprocessing'''</big></u>: {{#lst:Glossary\|Preprocessing}}

			<u><big>'''Project'''</big></u>: {{#lst:Glossary\|Project}}

			<u><big>'''Section Extract Method'''</big></u>: {{#lst:Glossary\|Section Extract Method}}

	== About ==		== About ==