Output settings

You can specify a maximum of 101 output settings.

 

Note

All the files specified in the data processing information setting are opened simultaneously. Note that depending on the environment, number of the file descriptor might not be enough and might cause file open error (such as in cases where there are 101 output files).

Take measure by changing the setting of the OS in such case.

(1) Main fields

Format

The output file format screen will change depending on the selection.

CSV

: CSV data

Format

: Format data

Multi Format

: Multi format data

Hierarchy Format

: Hierarchy format data

XML

: XML data

Excel

: Excel format

TEXT

: Text data

Database Table

: Database table data

Comment

Comment about the registered output settings

 

(2) Output file fields

ID

CSV

FMT

MFMT

HFMT

XML

Excel

DB

ID for identifying the output file.

Specify the Format ID, multi format ID, CSVID, XMLID, hierarchy format ID, or database table ID depending on Format. If Format is neither CSV nor Text, make sure that you specify this item.

Numeric value byte order

FMT

MFMT

HFMT

DB

The numeric value byte order for output file.

Output location

CSV

FMT

MFMT

HFMT

XML

Excel

TEXT

Specify the type of output location of the data

Fixed

: You can specify a custom file name.

Use field values

: You can select the output location from an existing field. Click the Settings button to display the Output File Name Settings screen.

Standard output

: $STDOUT is set as the file name.

In the case of Excel, standard output cannot be specified.

File name

CSV

FMT

MFMT

HFMT

XML

Excel

TEXT

The output file name used with the data processing process.

Specify with absolute path or relative path.

Specify as $STDOUT for standard output.

If the same output file name is specified for multiple output settings, an error will occur upon conversion.

Enable output file changeover

CSV

FMT

MFMT

HFMT

Excel

TEXT

Sets to perform the enable output file changeover or not.

If you select this item, the Settings button will become active. Click this item to display the Output Location Changeover Settings screen.

Delete 0-byte output files

CSV

FMT

MFMT

HFMT

XML

Excel

TEXT

Sets whether to delete the output file when the operation terminates normally but nothing is output.

Note
  • At the time of conversion, if Output file creation mode is set to Add in the output settings and the output file is not 0 bytes before the conversion, the output file is not deleted even when the file is 0 bytes after being converted.

  • In an Excel or XML format, even when nothing is output, the file size is not 0 bytes. However, the output file will be deleted when no record is output.

Omit ID

CSV

You can omit ID. If you select this, Delimiter and Enclosure character are active.

Delimiter

CSV

The delimiter for each field of the CSV format file.

Specify from the pull down list.

You can specify it when you select Omit ID.

Delimiter (hexadecimal)

CSV

If Enter hexadecimal value is selected for Delimiter, specify a delimiter. Enter the value by using hexadecimal characters.

Enclosure character

CSV

The enclosure character for character data in the CSV format file.

Specify from the pull down list.

You can specify it when you select Omit ID.

Enclosure character (hexadecimal)

CSV

If Enter hexadecimal value is selected for Enclosure character, specify an enclosure character. Enter the value by using hexadecimal characters.

Add enclosed characters to numeric data

CSV

Set this to ON to add enclosure characters to numeric data as well as character string data.

Handling of trailing spaces after character data

CSV

XML

Specify how to handle trailing spaces after character data.

Trim

: Processes with trimming the space after.

Do not trim

: Processes without trimming the space after.

Compress

: Processes with trimming the space after. Processes by compressing to single-byte halfwidth space code if the data is space only.

Handling of leading zeroes in numeric data

CSV

XML

Specify how to handle leading zeros in numeric data.

Trim

: Processes with trimming leading zeros.

Do not trim

: Processes without trimming leading zeros.

Add a zero (0)

: If the numeric value data is a positive value, a zero (0) is added to the front of the numeric value data, and then the numeric data is processed.

Add a plus sign (+)

: If the numeric value data is a positive value, a plus sign (+) is added to the front of the numeric value data, and then the numeric data is processed.

Output a title line

CSV

Specify to output the field name in the CSV information specified in ID as a title line or not.

Zoned decimal

MFMT

HFMT

The sign for external decimal number of conversion data for multi format output or hierarchy format output. You can select a value from 0 to F.

Note

This setting value is adopted for whole record at the time of multi format or hierarchy format output. The zoned decimal setting for each format information specified in the multi format or hierarchy format information is not used.

Packed decimal

MFMT

HFMT

Sign for internal decimal number of conversion data for multi format output or hierarchy format output. You can select a value from 0 to F.

Note

This setting value is adopted for whole record at the time of multi format or hierarchy format output. The packed decimal setting for each format information specified in the multi format or hierarchy format information is not used.

XML Schema instance attributes

XML

Select to output the schema instance attribute for XML route node or not.

Output

: Outputs the schema instance attribute.

Output only the default namespace

: The schema instance attribute is output only for the default namespace.

Do not output

: Does not output the schema instance attribute.

Note

If Add prefixes is set, specify Output.

Schema location

XML

The path to the schema that will be output into the output XML file.

This field will be ignored when the Category of XML information is DTD and DTD handling is Internal.

Multiple paths can be specified for Schema location by halfwidth space delimiter. The path specified first will become the schema location for the target namespace. Specify namespace and path in set for subsequent ones.

Example: When describing a namespace and a path as a set

namespace-A path-A namespace-B path-B

XML version

XML

XML version at time of XML output.

If this is omitted, 1.0 is output.

Standalone declaration

XML

Standalone declaration at time of XML output.

You can select whether or not to output the standalone attribute with the following:

・Output: standalone="yes"

・Output: standalone="no"

・Do not output both standalone="yes" and standalone="no"

DTD handling

XML

DTD handling at time of XML output.

This field is ignored when the Category of XML information is XML Schema.

Internal

: DTD is output as internal subset of output XML file.

External

: Outputs external reference declaration to the path specified with the Schema location to the output XML file.

Output empty-element tags

XML

Handling of NULL data output at the time of XML output.

Select to output the empty-element tag (tag indicating empty element without any content) or not.

 

Do not output

: Outputs with start tag and exit tag.

Output

: Outputs with empty-element tag.

Output sample:

When output with an empty-element tag

Without an attribute: <XXX/>

With an attribute: <XXX yyy="zzz"/>

When not outputting with an empty-element tag

Without an attribute: <XXX></XXX>

With an attribute: <XXX yyy="zzz"></XXX>

XML record unit

XML

Specify how to handle 1 record at the time of XML output.

Custom

: Custom node can be specified as record at the time of mapping.

1

: Handles the route node as 1 record.

2

: Handles the setting node 1 level under the route as 1 record.

3

: Handles the setting node 2 level under the route as 1 record.

For details about the differences in the conversion result for each setting, see DataMagic Operation Manual.

Indentation

XML

Specify whether to indent at the time of XML output.

Indent is possible only if Insert a line break after each record is selected.

Do not indent

: The output XML file is output without indentation.

Indent

: The output XML file is output with indentation.

Add prefixes

XML

Specify whether prefix is added at the time of XML output.

Note

Set XML schema instance attributes to Output to add the prefix.

Date (D)

DB

Specify the conversion method of the null (0 bytes) inside the input data when the data type for input file is date type.

Default value

: Converts to default value.

NULL

: Converts to Null value.

= Remarks =

The table below indicates the default value for each data type.

Table 2.48 Default Value for Each Data Type

Data type

Default value

N

Fullwidth space padding (#1)

M

Halfwidth space padding (#1)

D

SYSDATE (date of execution) (#2)

Z

0

W

Halfwidth space (Unicode) padding (#1)

#1

:

Value when it is fixed length. It will be a data with size 0 in case of variable length.

#2

:

YYYY/MM/DD format

Character string (M, N, or W)

DB

Specify the conversion method of the null (0 bytes) inside the input data when the data type for input file is character type.

For details, see Date (D).

Numeric character (Z)

DB

Specify the conversion method of the null (0 bytes) inside the input data when the data type for input file is numeric value character type.

For details, see Date (D).

Line break after final record

TEXT

Specify whether the line break code is added at the terminal record of the output file when there is no line break code in the terminal record of the input file when converting to text.

Do not output is specified when the Insert a line break after each record in the Code conversion tab is set to OFF.

Output

: A line break code is added to the terminal record.

Do not output

: A line break code is not added to the terminal record.

Added line break code will be the code set in the Line break code of the output settings.

(3) Code conversion fields

Kanji code type

All

The kanji code type for output file

Select form Shift JIS, JEF, EUC, IBM kanji, KEIS, NEC kanji, UTF-8, UTF-16, or JIS.

If Format in the output settings is CSV or XML, set Shift JIS, EUC, UTF-8, or UTF-16.

For Excel, this is fixed to UTF-8.

= Remarks =

In the case of DataMagic Desktop grade, this field is displayed but cannot be changed.

Note
  • If "Format" in the output settings is "CSV", "XML", or "Text", and if "UTF-8" is selected and "BOM addition" is set to "Add BOM", the byte order mark "0xEFBBBF" is output at the start of the file.

  • In the data processing information settings to connect to Oracle, specify the same character set as NLS_LANG for <b>Kanji code type</b> in the input settings and the output settings. If the settings are different, an error occurs in data processing.

Insert a line break after each record

FMT

MFMT

HFMT

XML

TEXT

A flag to add a line break code on each record

If Format is XML, this flag indicates whether to add a line break for each XML tag.

If Format is CSV, you cannot set this item, because line breaks are automatically added.

Line break code

CSV

FMT

MFMT

HFMT

XML

TEXT

Specify the line break code by using a hexadecimal value.

Up to specified line break code will be determined as a record.

If Kanji code type is UTF-16, enter this value as either 4 bytes or 8 bytes. If Kanji code type is anything other than UTF-16, enter this value as either 2 bytes or 4 bytes.

Path of the EBCDIC user table

All

The EBCDIC user table storage folder.

Specify with absolute path or relative path.

If this path is not specified, the shared data storage folder (Windows) or $DMPATH (UNIX) is used.

= Remarks =
  • In the case of DataMagic Desktop grade, this field is not displayed.

  • The shared data storage folder stores system operation information, which is specified during installation of DataMagic. For details, see DataMagic Operation Manual.

Fullwidth and halfwidth character conversion

All

Specify the fullwidth and halfwidth character conversion method for the character string.

You can select Convert halfwidth to fullwidth, Convert fullwidth to halfwidth, or Do not convert.

Kana conversion

: Specify the fullwidth and halfwidth character conversion method for the Kana character string.

Alphanumeric conversion

: Specify the fullwidth and halfwidth character conversion method for the alphanumeric.

Symbol conversion

: Specify the fullwidth and halfwidth character conversion method for the symbol.

 

Fields to be set if Kanji code type is UTF-8 or UTF-16

Unicode byte order

CSV

FMT

MFMT

HFMT

XML

DB

TEXT

UTF-16 byte order.

Specify the byte order mark output at the head of the file when UTF-16 is selected for Kanji code type for the CSV format, XML format, or text format output.

= Remarks =

In the case of DataMagic Desktop grade, this field is not displayed.

Big-endian

: 0xfeff is output.

Little-endian

: 0xfffe is output.

Same as host

: Depends on the byte order of the connected hardware (Windows or UNIX).

Unicode table

All

The conversion method of character depending on the model.

If a type of kanji code type other than UTF-8 or UTF-16 is specified, you cannot specify this field.

For details about conversion method of character depending on the model, see DataMagic Operation Manual.

Same as host

: Converts to the code used at the connected hardware (Windows or UNIX).

Windows

: Converts to the code used with the Windows.

UNIX

: Converts to the code used with the UNIX.

BOM addition

CSV

XML

TEXT

Selection of BOM addition for UTF-8 and UTF-16.

This can be specified if Format in the output settings is CSV, XML, or Text and UTF-8 or UTF-16 is selected for the Kanji code type.

= Remarks =

In DataMagic Desktop grade, this field is not displayed when cs4file (encoding of input and output files) is Shift JIS.

Add BOM

: BOM is added.

Do not add BOM

: BOM is not added.

Added BOM is as follows:

UTF-8

:0xEFBBBF

UTF-16(Little-endian)

:0xFFFE

UTF-16(Big-endian)

:0xFEFF

BOM for Little-endian or Big-endian will follow the setting of the Unicode byte order.

If a type of kanji code type other than UTF-8 or UTF-16 is specified, you cannot specify this field.

Fields to be set if Kanji code type is IBM kanji, JEF, NEC kanji, KEIS, or JIS

EBCDIC set

FMT

MFMT

HFMT

DB

TEXT

= Remarks =

In the case of DataMagic Desktop, this field is not displayed.

The 1-byte code set type.

If Kanji code type for output file is an EBCDIC type, or JIS encoding, specify this item.

The code set types that you can specify are as follows.

Table 2.49 1-byte Code Set Type for Output File (EBCDIC Type, JIS)

EBCDIC type

JIS

EBCDIC kana

EBCDIC lowercase

EBCDIC ASCII

EBCDIC ASPEN

Japan (Latin) for IBM

Japan (Latin) Extended for IBM

NEC Katakana

Japan (Katakana) Extended for IBM

 

EBCDIC kana

EBCDIC lowercase

EBCDIC ASCII

EBCDIC ASPEN

Japan (Latin) for IBM

Japan (Latin) Extended for IBM

NEC Katakana

Japan (Katakana) Extended for IBM

ASCII

Note
  • The conversion between UTF-8/UTF-16 and EBCDIC code, EBCDIC user table cannot be selected as EBCDIC set.

  • When the kanji code type for output setting is JIS, EBCDIC user table cannot be selected as EBCDIC set.

Shift code

FMT

MFMT

HFMT

DB

TEXT

= Remarks =

In the case of DataMagic Desktop grade, this field is not displayed.

Specify how to handle a shift code for input file.

If Kanji code type for the input file is either ASCII or Unicode encoding (Shift JIS, EUC, UTF-8, or UTF-16), you can select either Add or Do not add. Alternatively, if Kanji code type for the input file is an EBCDIC type (JEF, IBM kanji, KEIS, or NEC kanji), you can select either Trim or Replace to spaces.

You can specify this field if IBM kanji, JEF, NEC kanji, or KEIS is selected for Kanji code type for output settings.

Note

This cannot be set if "Kanji code type" for input settings is "JIS".

Trim

: Trims the shift code when converting from EBCDIC encoding to ASCII or Unicode encoding.

Replace with spaces

: Converts the shift code to single-byte space when converting from EBCDIC encoding to ASCII or Unicode encoding.

Add

:Shift code is added if the data requires when converting from ASCII or Unicode encoding to EBCDIC encoding.

Do not add

:Shift code is not added when converting from ASCII or Unicode encoding to EBCDIC encoding.

The pattern for this field to be applied is as follows:

Table 2.50 Application Pattern of the Shift Code

Input/Output

ASCII/Unicode

EBCDIC

M

N

M

N

ASCII/
Unicode

M

Ignored

Ignored

Converted

Ignored

N

Ignored

Ignored

Converted

Ignored

EBCDIC

M

Converted

Ignored

(Always trim)

Ignored

Ignore

(Always trim)

N

Ignored

Ignored

Ignored

(Always add)

Ignored

Converted: Converted in accordance with the setting value.

Ignored: This field will be ignored.

 

In DataMagic, shift codes are defined as follows.

Table 2.51 Definition of Shift Codes in DataMagic

Character code

Shift out (hexadecimal)

Shift in (hexadecimal)

JEF

0x29

0x28 or 0x38

KEIS

0x0A41

0x0A42

IBM Kanji

0x0F

0x0E

NEC Kanji

0x3F76

0x3F75

 

Fields to be set if Kanji code type is KEIS

KEIS fullwidth space

FMT

MFMT

HFMT

DB

TEXT

= Remarks =

In the case of DataMagic Desktop grade, this field is not displayed.

Selection of KEIS fullwidth space code.

If KEIS is selected as Kanji code type, specify this item. Select fullwidth space code of KEIS when converting Shift JIS, EUC, IBM kanji, and JEF to KEIS code. For details, see DataMagic Operation Manual.

A1A1

: Converts to 0xA1A1.

4040

: Converts to 0x4040.

Fields to be set if Kanji code type is Shift JIS, IBM Kanji, UTF-16 or UTF-8

Convert characters other than of JIS Level 1 or JIS Level 2 as well

CSV

FMT

MFMT

HFMT

XML

DB

= Remarks =

In the case of DataMagic Desktop grade, this field is not displayed.

This enables the conversion of characters other than JIS Level 1 and JIS Level 2 characters. For example, this enables the conversion of widely used JIS Level 3 and JIS Level 4 characters such as circled characters and ㈱, without requiring you to register such characters in the external character table.

This takes effect if Shift JIS, IBM kanji, UTF-8, and UTF-16 are specified for Kanji code.

(4) External characters fields

Conversion table for external characters

All

Whether to use the conversion table for external characters.

Select from the following when the kanji code type is different between input side and output sides.

Do not use

: Without using the conversion table for external characters, convert all external characters to default code.

Use

: Using the conversion table for external characters, convert the external character in accordance to the conversion table for external characters.

Use preferentially

: Using the conversion table for external characters preferentially, and convert the code other than the external character code in accordance to the contents of the table if it is registered in the table.

Select from the following when the kanji code types are same between input side and output side.

Do not use

: Without using the conversion table for external characters, output the input data without conversion.

Use preferentially

: Using the conversion table for external characters preferentially, and convert the code other than the external character code in accordance to the contents of the table if it is registered in the table.

Note
  • The conversion table for external characters is referenced regardless of existence of external character in the input data when this field is set to Use or Use preferentially.

    In doing so, a conversion error will occur if corresponding file for external character table expansion does not exist.

  • External character is supported when the character code for the input XML file is UTF-8 or UTF-16, but it is not supporting to the external character of other character code. A conversion error will occur when an external character is in the input XML file other than UTF-8 or UTF-16.

  • When there is a type W at the output side, the external character table used by the type W field will be input code UTF-16. Also, for the case that the input side is UTF-16 and the output side is not UTF-16, only the type W will operate in Use preferentially even if it is set to Use.

Handling of external characters that are not registered

All

How an external character code not registered in the conversion table for external characters is handled.

Select from the following when the kanji code type is different between input side and output sides.

Use default value

: Converts to default code.

Treat as an error

: Make it a conversion error.

If the kanji code type of the input side and of the output side are the same, the following values are fixed and cannot be changed.

Do not convert

: Outputs without conversion.

Path of the external character conversion table

All

The path to the external character conversion table folder gtf.

Specify with absolute path or relative path.

The path that will be reference at the time of execution will be the gtf folder inside the specified path.

If this path is not specified, the shared data storage folder (Windows) or $DMPATH (UNIX) is used.

= Remarks =

The shared data storage folder stores system operation information, which is specified during installation of DataMagic. For details, see DataMagic Operation Manual.