Extraction condition fields

This section explains the fields of the extraction condition settings. Up to 256 conditions (extraction, custom error, pre-processing, and post-processing conditions) can be registered in total.

If you do not want to always unmatch comparisons of the same value in different data types (e.g., the string "123" and the numeric value "123"), and you want to convert the values for comparison instead, select the Allow field type differences during data comparison check box in the General tab of the System Environment Settings screen.

  • If the comparison source is a string and the comparison target is a numeric value, the string value will be converted to a numeric value for comparison.

  • If the comparison source is a numeric value and the comparison target is a string, the numeric value will be converted to a string for comparison.

(1) Extraction condition (Common fields)

Extraction condition No.

The number of the extraction condition that is created. The extraction condition number is displayed in Extraction condition n (n is the extraction condition number) format.

Comment

Comment about the extraction condition to be set.

Format

The key for multi format and format information specified in the input settings.

The field is displayed only if the input format is Multi Format.

Comment

Comment on a multi-format group.

Group or record

The group for hierarchy format and record information specified in the input settings.

The field is displayed only if the input format is Hierarchy Format.

Record unit element name

The element name of the XML that was specified at the time of adding the extraction condition.

The field is displayed only if the input format is XML and the XML record unit is Element.

Conditions

The list of registered conditions.

The maximum number of conditions that you can specify is 400. The combination of a comparison source, a comparison operator, and a comparison target is counted as one condition.

If Multi format is specified in the input settings, key information are automatically set to the No.1 condition in the Conditions list. This condition cannot be deleted.

If Hierarchy format is specified in the input settings, group or record information is automatically set to the condition No.1 in the Conditions list. This condition cannot be deleted.

If XML is specified and Element is set to XML record unit, elements are automatically set to the No.1 condition in the Conditions list. This condition cannot be deleted.

No.

Serial number.

Condition

The condition formula that is specified.

Conditional logic formula

Inputs the number (numerical value) of the condition specified in the condition list.

If you specified multiple conditions, you can combine conditions by using logical operators such as "AND", "OR", "!" (NOT), "(" (left parenthesis), ")" (right parenthesis), and SPACE.

Automatically combine AND conditions

Selects if the condition input to extraction condition is automatically AND coupled or not.

If a condition is met, do not evaluate any subsequent conditions

This is a continuity condition that you can set for each extraction condition.

Determination of extraction condition hereafter will not be performed when this condition gets a hit.

Processing of the length of compared character strings and values

The processing performed when the length of the character string in the comparison source does not match the comparison target.

You can select either Pad with null values or Pad with spaces.

Pad with null values: 0x00 is added.

Pad with spaces: Halfwidth spaces of kanji code type are added.

Note

If the kanji code for the input data is an EBCDIC-type encoding, shift codes are internally added before and after multi-byte strings in the comparison target value before comparison. Therefore, the length is also compared using the size after the shift code has been added. Padding characters are used to compensate for the length disparity after all shift codes have been added.

(2) Extraction condition (Condition Setting Details)

Comparison source type

The comparison source of the extraction condition.

You can select Record, Input fields, Matching field, or Variable.

The type of field to be set varies depending on the specified value.

The comparison source setting field is described later.

Comparison target type

The comparison target of the extraction condition.

You can select Fixed value, Runtime argument, Input fields, Matching field, or Variable. The type of field to be set varies depending on the specified value.

Matching number

Specify the matching number.

Type

The type of the extraction condition.

This field is not required to be set if Variable is selected for the Comparison target type.

When Fixed value is selected as Comparison target type for the comparison target:

Character string

Character string: Select this to process as a character string type.

Numeric values

Select this to process as a numeric type. Specify the value using 19 digits or fewer, excluding the minus sign (-) and decimal point (.). Specify a value from 1 to 2147483647 if the field value is a record number.

Dates

: Select this to process as a date type. The range of values is from 1900 to 3000. If an operation is specified as out-of-bounds, it is not supported. Also, today indicates the date conversion started. For details about how to specify date data, see DataMagic Operation Manual.

Character string (Hexadecimal)

: Select this if the target is hexadecimal character string data.

Null

: Select this if the target is null. You can use this field if Field No., Field name, or Variable is selected in Comparison source setting field.

When Runtime argument is selected as Comparison target type for the comparison target:

$DSTR

: Select this if the character string is specified dynamically.

$DSTR (Hexadecimal)

: Select this if the hexadecimal character string is specified dynamically. Specify this if an external character code exists in the extraction condition.

$DSTR (Date)

: Select this if the date is specified dynamically. For details about how to specify the date data, see DataMagic Operation Manual.

$DNUM (Numeric value)

: Select this if the numeric value is specified dynamically.

When Input fields is selected as Comparison target type for the comparison target:

Character string

: Processed as a character string type.

Numeric values

: Processes as a numeric type.

Dates

: Processes as a date type.

When Matching field is selected as Comparison target type for the comparison target:

Same as Input fields.

Value

If Fixed is selected as Comparison target type for the comparison target, specify the fixed value to be compared by using a value of 1024 bytes or fewer in length.

If Type is Character string, you can use a hexadecimal expression and a control character. If you want to use a control character, set 1 (enable use) for Use control characters inside a fixed value (ed_fixvalue_ctrlchar_flag) in the system environment settings file (huledenv.conf).

Number

Specify the number of a runtime argument to be compared.

Perform the setting when Runtime argument is selected as Comparison target type for the comparison target.

Specify a value from 01 to 20.

Field name

Specify the field name. Click the Browse button to display the Select Field screen, and then select the custom field name.

Field No.

Select this to specify a field number. Specify a numeric value from 1 to 1000.

If the matching file is already set, display the Select Field screen by clicking the Browse button, and then select any field number.

Field information (Comparison target)

Displays the details of the field selected from the tree view that can be used when Input fields, Matching field, or Variable with an ID is specified in Comparison target type. However, when Variable is selected, the list consists of the following fields: Variable Name, Variable Type, and Initial Value.

Specification of the comparison source

When "Record" is selected for "Comparison source type"

Matching number

Specify this field only if you selected Matching field in the input settings.

Specify the matching number using a numeric value from 1 through 101.

Target records

The of records of the input file.

Number of grouped records

The number of grouped records for hierarchy format.

Total number of input records

The number of records of input data including the records that has matched plurally with the matching file.

You can select this only if matching settings are specified.

Number of input records hit

The number of records in the matching file that got a hit in the matching process for each record of the input file. You can select this only if matching settings are specified.

You must specify the matching number.

When "Input fields" is selected for "Comparison source type"

Specification method will automatically be considered as Field No. when there is no CSVID, so the field number must be input directly.

Specification method

Select the specification method of the input field. You can select either Field No. or Field name.

Output method

Select Skip processing, Function, or Common Components.

When "Matching field" is selected for "Comparison source type"

Matching number

Specify this item only when Matching field is selected for Input Field.

Specify the matching using a numeric value from 1 through 101.

Output method (with an ID specified)

Select Skip processing, Function, or Common Components.

Field No.

Specify a field number.

When Variable is selected for Comparison source type

Variable name

Specify the variable to be the comparison source.

Click the Browse button to display the Select Variable screen, and then select the custom variable name.

Output method

Select Skip processing, Function, or Common Components.

Specification of operators

When "Fixed value", "Runtime argument", or "Variable" is selected for the comparison target

<

: Less than the comparison target value

>

: Greater than the comparison target value

<=

: Equal to or less than the comparison target value

>=

: Equal to or greater than the comparison target value

==

: Equal to the comparison target value

!=

Not equal to the comparison target value

INCLUDE

: Contains the comparison target value

= Remarks =

If Numeric value, Date, $DSTR (Date), or $DNUM (Numeric value) is specified for the type, you cannot specify INCLUDE.

When "Input fields" or "Matching field" is selected for the comparison target

When the type is Character string:

Equals

: The value of the comparison target field is an exact match of the value of the comparison source field.

Begins with

: This means that the value in the comparison source field matches the beginning portion of the value in the comparison target field.

Ends with

: This means that the value in the comparison source field matches the end portion of the value in the comparison target field.

Not equal

: The value of the comparison target field does not match the value of the comparison source field.

Contains

: The value of the comparison target field is contained in the value of the comparison source field.

When the type is Numeric value or Date:

<

: The value of the comparison target field is less than the value of the comparison source field.

>

: The value of the comparison target field ends with the value of the comparison source field.

<=

: The value of the comparison target field is less than or equal to the value of the comparison source field.

>=

: The value of the comparison target field is greater than or equal to the value of the comparison source field.

==

: The value of the comparison target field is equal to the value of the comparison source field.

!=

: The value of the comparison target field is not equal to the value of the comparison source field.

Note

  • If the kanji code for the input data is an EBCDIC-type encoding, shift codes are internally added before and after multi-byte strings in the comparison target value before comparison.

  • If the operator is either Begins with or Ends with, it does not result in a match when the source data is longer than the target data. Specify the length of the data based on the following:

    The target data (on the left) is shorter than the target data (on the right).

Specification of the comparison target

When "Fixed value" is selected for "Comparison target type"

Type

Input field type.

You can select Character string, Numeric value, Date, Character string (Hexadecimal), or Null.

Value

Specify a fixed value.

When "Runtime argument" is selected for "Comparison target type"

Type

Runtime argument type.

You can select $DSTR, $DSTR (Hexadecimal), $DSTR (Date), or $DNUM (Numeric value).

Number

Runtime argument number.

You can select from 01 through 20.

When "Input fields" is selected for "Comparison target type"

Type

Input field type.

You can select Character string, Numeric value, or Date.

Specification method

The specification method of the field

Specify this item only if an Input field that has an ID specification is selected for Comparison target type.

The field name input field is displayed when Field name is selected, and the field number input field is displayed when Field No. is selected.

When Variable is selected for Comparison target type

Variable name

Specify the variable to be the comparison target.

Click the Browse button to display the Select Variable screen, and then select the custom variable name.

When "Matching field" is selected for "Comparison target type"

Matching number

A matching number. This field is displayed if Matching field is selected for the field of comparison target.

Type

Input field type.

You can select Character string, Numeric value, or Date.

Field No.

Specify a field.

Note

  • If the kanji code for the input data is an EBCDIC-type encoding, shift codes are internally added before and after multi-byte strings in the comparison target value before comparison.

  • Take one of the following measures so the comparison target value will not become shorter than the field length of the field type N when the comparison target is Character string for Fixed value and $DSTR for Runtime argument, and the format field for input file is field type N:

    • Make the length of the comparison target value same as the field length of the field type N by adding specified fullwidth space after the comparison target value.

    • Specify INCLUDE as the comparative operator.

  • When you specify the date, if you omit the time, "00:00:00" is assumed.

    Example: Case where the time can be set to any value if the date is 2007/10/26.

    Wrong: item1 = 2007/10/26 (equal to item1 = 2007/10/26 00:00:00)

    Correct: item1 >= 2007/10/26 AND item1 < 2007/10/27

  • If a field of type I is specified, upon execution, a conversion error occurs. Do not set a field of field type I.

  • Extraction might not perform correctly if the data type set in the field is different from the type of the comparison target. When comparing a character data (field types X, N, M, etc.), set the type of comparison target as a character string, and when comparing a numeric value data (field types 9, S, P, etc.), set the type of comparison target as a numeric value.

    To allow comparisons between values of different data types without resulting in an error, specify 1 (Convert for comparison) for the Allow field type differences during data comparison (compare_different_type_data) field in the system environment settings file (huledenv.conf).