Summary

Outputs an error when input data scheme changes (position, name, or data type of a column).

Outputs an error or deletes a column that is added to input data scheme.

This operator is useful as an intermediate step before applying operators that rely on the table schema, such as Merge data 5.0, Delete columns, or Write TIS Table 5.0.

Configuration

Settings

Name

Value

Opt.

Description

Example

Check number and type of columns

System.Boolean

opt.

If this checkbox is set, the number of columns of the input table and the column types are compared with those of the frozen table.

-

Checking column name (heading)

System.Boolean

opt.

If this checkbox is set, the column headings of the input table are compared with those of the frozen table.

-

@Settings

System.String

-

-

-

If additional columns exist

System.String

  • Error
  • Remove columns
  • Remove columns + Warning
  • Append columns

-

Determines behaviour if more columns are available in the input table than in the frozen table.

  • Error: Outputs an error
  • Remove columns: Removes the additional column(s)
  • Remove columns: Removes the additional column(s) and sets the data node into Warning status
  • Appends columns: Appends the additional column(s)

Note: If this parameter is set to "Remove columns" and "Checking column name (heading)" is set to true, then a renamed column is also removed.

-

If columns match, but order is different

System.String

  • Error
  • Sort columns to desired order + warning
  • Sort columns to desired order

-

-

-

Want to learn more?

Screenshot

Examples

Example: Freeze number of columns and column types

Situation

Data node A01_raw-data_1 is created using Create table and contains four columns. The number of columns and their types have to be verified before further processing. This will be done by freezing the number of columns and the types in data node A02_freeze-columns-number-and-type.


Settings

On data node A02_freeze-columns-number-and-type, operator "Freeze columns 2.0" is applied to A01_raw-data_1 with the following settings.

The frozen columns equal the current columns in A01_raw-data_1, so no error is reported in the "Operations" view of A02_freeze-columns-number-and-type.

Then the column "Value" is deleted from A01_raw-data_1 by changing the Create table operator.

Result

Now data node A02_freeze-columns-number-and-type throws an error.

Error details in the "Operations" view of A02_freeze-columns-number-and-type.

Project File

Confluence op freeze columns.gzip

Example: Freeze complete schema

Situation

Data node A01_raw-data_2 is created as a copy of A01_raw-data_1. The complete table schema has to be verified before further processing. This will be done by freezing the number of columns, the types, and the headings in data node A03_freeze-all.

Settings

On data node A03_freeze-all, operator "Freeze columns 2.0" is applied to A01_raw-data_2 with the following settings.

 

The frozen columns equal the current columns in A01_raw-data_2, so no error is reported in the "Operations" view of A03_freeze-all.

 Then, in data node A01_raw-data_2, the column "Identifier" type is changed to "Integer" and the heading of column "To" is changed to "Until" by changing the Create table operator.

Result

Now data node A03_freeze-all throws several errors in its "Operations" view.

 Project File

 Confluence op freeze columns.gzip

Example: Delete additional columns

Situation

Data node A01_raw-data_3 is created as a copy of A01_raw-data_2. Before further processing, added columns are to be removed.


Settings

On data node A04_delete-additional-columns, operator "Freeze columns 2.0" is applied to A01_raw-data_3 with the following settings.

 

The frozen columns equal the current columns in A01_raw-data_3, so no error is reported in the "Operations" view of A04_delete-additional-columns.

 Then, in data node A01_raw-data_3, the heading of column "Until" type is changed to "Foobar" and the column "Note" is added by changing the Create table operator.

Result

Now data node A04_delete-additional-columns is a copy of A01_raw-data_3 with columns "Foobar" and "Note" removed.

Note that column "Foobar" is also removed, even though it is an original column where the heading has been changed. 


A04_delete-additional-columns "Operations" view 


A04_delete-additional-columns "Details" view 

 Project File

 Confluence op freeze columns.gzip


Troubleshooting

Nothing known up to now.


Related topics