Semi-structured Document Classification

Semi-structured Document Classification

Classification models in Hyperscience

Classification models are a crucial part of document processing as they help the system determine which layout should be used to process each page you upload. In Hyperscience, we have two types of document classification:

Semi-structured Document Classification - Automatically classifies documents that don’t follow a consistent layout pattern (e.g., invoices, bank statements, etc.).

Structured Document Classification - Automatically classifies documents that follow a consistent layout pattern (e.g., tax forms, standardized applications) by assigning them to the correct layout in Hyperscience. To learn more, see Structured Document Classification.

In this article, you’ll learn when and how to use Semi-structured document classification.

How it works

Semi-structured classification is handled by the Non-Structured Layout Classifier (NLC), which relies on the words in the document to predict the most likely layout group. Note that the NLC works on a page-level.

For each page, the model outputs a confidence score that reflects its certainty about the classification. This score is then compared against the configured Target Accuracy Threshold:

This approach ensures that high-confidence predictions are automated, while low-confidence cases get the necessary human validation to maintain Accuracy. To learn more about target accuracy, see our Accuracy article.

Semi-structured Classification Grouping Logic

When classifying Semi-structured documents, the system needs to decide how to group consecutive pages that are matched to the same layout. This behavior is controlled by the Semi-structured Classification Grouping Logic setting in your flow. Learn more in Document Processing Subflow Settings.

You can choose between three options:

By default, the flow-level grouping logic inherits the grouping configuration defined at the layout level. To learn more, see Auto-Splitting.

Releases and Classification models

Each release in Hyperscience contains a set of layouts. Learn more in our What is a Release? article.

When you create a new release, the system automatically generates a new for all Semi-structured and Additional layouts in that release.

Over time, as you add layouts and retrain, your Semi-structured Classification model evolves to handle a wider range of documents.

Training the Classification model

To classify Semi-structured and Additional layouts accurately, the system needs to be trained on examples of these documents. Training Data comes from three sources:

Model performance depends on how close new submissions are to the training data:

To maintain accuracy, a percentage of classified documents is sampled for Classification QA. These tasks ask users to confirm that the model’s predictions are correct and are required for reporting automation and accuracy.

Well-trained models reduce manual workload. If the model isn’t trained enough, more pages fall below the threshold and generate Supervision tasks.

In rare cases, the model may make high-confidence mistakes, which can be flagged as incorrect during any ID or Transcription Supervision task. To learn more, see the Reprocessing section of Structured Document Classification article.

Learn more about improving the model’s performance in Model Validation Tasks.