2023:Training Batch (Concept)

This article is about an older version of Grooper. Information may be out of date and UI elements may have changed.
2025	2023	2.90

This is a snippet of the Grooper Design Studio UI showing the Training Set batch.

The Training Batch is a special inventory_2 Batch created when training document examples using the Lexical classification method. The Training Batch service two purposes: (1) It is a Batch that holds all previously trained folder Batch Folders. Designers can go to this Batch to view these documents and copy and paste them into other Batches if needed. (2) Batch Folders in the Training Batch will be used to re-train the Content Model's classification data when the Rebuild Training command is executed.

You may download the ZIP(s) below and upload it into your own Grooper environment (version 2023). The first contains a Project with resources used in examples throughout this article. The second contains one or more Batches of sample documents. Media:2023 Wiki Training-Batch Project.zip Media:2023 Wiki Training-Batch Batch.zip

About

During the development and training of TF-IDF Classification in a Grooper Content Model, it can be challenging to keep track of all of the samples that are used during training. In previous versions, each trained sample was stored under each content type in the Grooper Design Studio node tree. In 2.9, the trained samples are stored both under each content type and in the Training Set batch.

How To

Following is an example of how to perform TF-IDF classification that creates the Training Set batch. In the example content model, there are five different content types from three different batches.

⚠	Some of the tabs in this tutorial are longer than the others. Please scroll to the bottom of each step's tab before going to the step.

PrerequisitesTrain Content TypesReview the Training Set batch

Prerequisites

Following these steps assumes you already have a content model created up with Lexical set as the Classification Method and the appropriate Text Feature Extractor selected. In the example content model, this property is set to Words(Stemmed)

Train Content Types

You will need to create a Batch Process with a "Classify" Batch Process Step. Go to the "Classification Tester" tab. Right click on the folder you wish to train and hover over "Classification". Click on "Train As..." to train the document. Repeat these steps for remaining Content Types. In the example Content Model provided, train all five Content Types from all three example batches

Review the Training Set batch

As you train your content types you will see a Training Set batch begin to populate under the Local Resources folder. A Grooper Designer can review and keep track off all of the documents that have been used for TF-IDF Classification training. As the development cycle of Classification continues and more content types are training, the Grooper Designer now has a single place to review, test and perform regression testing for Classification

⚠

It is important to understand that the Training Set is not tied to the actual TF-IDF Weightings that is associated with the Content Type or Content Category. Purging the training from a Content Model does not delete any or all of the documents in the Training Set. Conversely, deleting a document from the Training Set does not remove or purge anyTF-IDF Weightings from a Content Type or Content Category.