[v42.3] TDM for ORCA VLMs

[v42.3] TDM for ORCA VLMs

Training Data Management (TDM) is where you prepare and manage the data used to train your models. In TDM, you review and annotate documents, build your training dataset, and improve model performance for your specific use case.

Prerequisites

Before you start, ensure the following requirements are met:

Learn how to navigate TDM for ORCA VLMs and understand its key sections below.

Model details page

The Model details page is where you manage and evaluate your model. It includes three main tabs:

Overview

The Overview tab provides a summary of the deployed model, the candidate model, the health of the training data, and projected automation.

The sections below explain the key information shown in the Overview tab.

Model summary card

The Model summary card provides insights into all models trained for a specific model definition. See the table below to learn about the displayed details:

Field Description Notes
State Shows the model’s state. - A Live model is a deployed model.

- A Candidate model is an undeployed model. It allows you to review model performance and decide whether the model should be deployed or retrained with additional data.

- An Inactive model is a candidate or an undeployed model.
Projected automation Displays the performance of the model that’s currently live. The predicted automation based on the desired target accuracy. The projection is derived from the model’s training data. The system automatically ensures that the same data is not used for both projections and training.
Test Target Accuracy The accuracy percentage used to calculate the projected automation. Indicates the desired overall system accuracy.
Trained Date the model was trained.
Layout version The layout version used for this model definition. Always use the latest locked layout version.

Training data card

The Training data card displays information about your dataset. See the table below for more information:

Field Description Notes
Training status Indicates the status of your model based on the training data. - Ready to train

- Reqs not met

- To meet the requirements for training a specialized model on top of a base model, you must:

- Install the base model. Learn how to do this in [v42.3] Installing ORCA VLMs.

- Annotate at least 120 documents to start training. Learn how to train a specialized model in our [v42.3] Training a Specialized Model article.
- Training failed — the model training process failed.

- Training in progress— model is currently training.
Total documents The number of annotated documents for this model.

Projected Automation

The Projected Automation chart displays the performance of the currently live model, compared to the candidate one.

The chart displays how the target accuracy affects the automation. The lower the accuracy, the higher the automation, and vice versa.

Training data

The Training Data tab lists all training documents and allows you to annotate and manage them.

VLM Annotation

VLM annotation experience

While the ORCA VLM works out of the box, you can improve its performance by training it on your specific data, using annotated documents. Learn how to annotate documents.

History

The History tab displays all models trained for that model definition. This tab allows you to deploy, undeploy, and reject your models. You can also see detailed information for each model.

Training results

After training completes:

You can retrain the model by adding more annotated documents and running training again.

Deploying the candidate model

To start using the trained model:

Next steps

Train a specialized model for your specific use case on top of the ORCA base model and evaluate it, by following the instructions in [v42.3] Training a Specialized Model.

A foundational model that provides core general-purpose capabilities and is not directly trained on customer-specific examples. Use-case specialization is achieved through additional training on top of the base model using customer-specific data.