Downloading and maintaining new samples

While TotalAgility performs Online Learning, the samples that are trained are collected in a folder in the database.

Download samples

You must occasionally download these folders into the project and review them to do the following:

  • Delete bad quality samples.

  • Resolve any conflicts.

  • Delete samples flagged by TotalAgility to keep the project as small as possible.

Once the new samples are included with the existing ones in the project, TotalAgility may detect and flag some that are not needed.

There is a maximum number of new samples that TotalAgility collects at runtime (as defined in the General tab of the Project Settings). When these samples are downloaded and added to the project, the counter is reset and TotalAgility continues with more “learning.”

The new samples appear in a special staging document set called New Samples.

New samples

You can perform an initial screening of the documents in the New Samples document set.

Once the initial screening is done, you can import the documents into your main training set where they are stored in a new subset, as they represent a new "generation" of samples.

Import samples

Here you can do an initial screening. When done, you can import the documents into your main training set where they end up in a new subset, as they represent a new "generation" of samples:

If you want to use these samples along with the others, you can select Use for all of them and rebuild the Machine Learning model by training the project.