Table Identification

Table Identification

A table is a data structure used to organize and present information in rows and columns. It is used to present values in a readable format.

Each table consists of the following elements:

Hyperscience provides a solution for extracting the data from tables by using Table Identification models in Semi-Structured layouts.

We support extraction for the following tables:

In this article, you will learn how to annotate and train a Table ID model.

Table Identification Task

Table ID tasks are specific to Semi-structured documents with table columns. To see these tasks, you must define table columns on a Semi-structured layout.

Prerequisites

Follow the steps below to define a table and start the annotation process:

Annotating Tables

The Table Identification task is available in Training Data Management and it’s similar to annotating in Supervision.

Follow the steps described in the Table ID Supervision tab to annotate your documents.

Navigating the Table ID task in TDM

Be sure to click the Continue to Review (CMD+ENTER) button for each available table.

Use Anomaly Detection to ensure high-quality annotations. Learn more in Detecting and Correcting Anomalies in Table Annotations.

Follow the steps below to annotate your table in Supervision:

1. Select a row from the table to be a Template row

A Template Row is the lead row in your table. It is not necessary to be the first one. Hyperscience uses the copycat tool to populate the annotation to the rest of the rows in Step II. The copycat is not always accurate, so make sure to double-check the annotations.

In this step, you will define the template row of your table.

2. Make sure to capture the cell and follow the tips below if necessary

| If... | Then... | | The bounding box includes all of the cell's content. | Move on to the next step. | | The box is in the right place but doesn't include all of the cell's content (e.g., parts of letters fall outside of the box). | Click and drag the box's corners until it contains all of the content that should be transcribed. | | Neighboring text segments should also be included in the cell's transcription. | With a click-and-drag motion, draw a bounding box that includes all of the cell's content. | | The box doesn’t include any of the cell’s content OR no bounding box appears around the cell’s content when hovering over it. | Press the spacebar, and with a click-and-drag motion, draw a bounding box that includes all of the cell's content. |

3. Review your annotations

  1. De-select all columns by pressing the ESC button to have a better preview of the annotations. The labels will indicate all cells annotated in the respective column with different colors. Hide all labels by pressing CMD+I.

If you have more rows in the table, use the Split button to identify them faster:

Use the action buttons on the labels to adjust the annotations of your cells:

a. Find Missing Cells: This button allows you to auto-annotate missing cells. The target button can help auto-annotate any cells that may have been left unidentified in a particular column.

b. Select all column cells on page: This button will select all cells from the column you’re currently working with.

c. Delete all column cells on page: This button allows you to delete all column cells on the page.

Other actions

Right-click on the row for additional options:

If you have a nested table, follow the appropriate steps as described above.