Incremental Training

Incremental Training

Adding new data to your training set or making minor changes to its annotations may require several iterations of model re-training. Incremental Training helps you build upon your existing identification model without losing previously acquired information.

The system recommends one of the following options, based on internal dataset analysis. The recommended option is automatically selected.

You can override the selected option, but the recommendation will remain the same. Note that this won’t be valid for imported models.

Train from scratch

This option is recommended if your current model’s existing knowledge of your documents is not sufficient. It starts the training process from the beginning, using all eligible documents. Learn more about document eligibility in Document Eligibility Filtering.

Examples:

Note that if you change the data type of a field the system will recommend you to train from scratch.

Train from last training

This option is recommended when you want to enrich the training data of your existing model by adding more examples or if you’ve addressed anomalies after the last training iteration.

Do NOT use this option if the model performance is low due to inconsistent annotations or poorly represented data. This option leverages the existing knowledge of your model. That’s why, in these cases, it results in longer training times or worse-performing models.

Examples:

Incremental Training isn’t available if you’re training a brand-new model that’s never been trained before.

Using Incremental Training

To choose one of the available training options:

  1. Go to Library > Models.
  2. Click on the name of a layout to access its Model Management page.
  3. Click on the Field Model or Table Model tab, depending on the type of model you want to train.
  4. Select your candidate model and click Deploy Model.

A dialog box appears, asking if you want to deploy the model.

  1. Click Confirm.

  2. Analyze your data and address any potential anomalies. Learn more in Detecting and Correcting Anomalies in Field Annotations and Detecting and Correcting Anomalies in Table Annotations.

  3. Click Re-train

  4. A dialog box showing the options for re-training appears:

  5. Click Run training.

Keep Current Model

After your training is completed, you’ll see the Current model and the Candidate one, along with the details for each. Learn more about model results in Evaluating Model Training Results.

Based on internal analysis and the last date your training ground truth data was modified, the system will automatically recommend one of the two options described above.

If you want to keep your current model, then:

  1. Select Current
  2. Click Keep Model.

A dialog box appears, indicating that the candidate model will be deleted:

  1. Click Keep.
  2. If you still need to improve your model, follow steps 6-9 under Using Incremental Training.

Incremental Training and imported models