Output settings
You can specify a maximum of 101 output settings.
All the files specified in the data processing information setting are opened simultaneously. Note that depending on the environment, number of the file descriptor might not be enough and might cause file open error (such as in cases where there are 101 output files).
Take measure by changing the setting of the OS in such case.
(1) Main fields
Format
The output file format screen will change depending on the selection.
- CSV
-
: CSV data
- Format
-
: Format data
- Multi Format
-
: Multi format data
- Hierarchy Format
-
: Hierarchy format data
- XML
-
: XML data
- Excel
-
: Excel format
- TEXT
-
: Text data
- Database Table
-
: Database table data
Comment
Comment about the registered output settings
(2) Output file fields
ID
|
|
|
|
|
|
|
ID for identifying the output file.
Specify the Format ID, multi format ID, CSVID, XMLID, hierarchy format ID, or database table ID depending on Format. If Format is neither CSV nor Text, make sure that you specify this item.
Numeric value byte order
|
|
|
|
The numeric value byte order for output file.
Output location
|
|
|
|
|
|
|
Specify the type of output location of the data
- Fixed
-
: You can specify a custom file name.
- Use field values
-
: You can select the output location from an existing field. Click the Settings button to display the Output File Name Settings screen.
- Standard output
-
: $STDOUT is set as the file name.
In the case of Excel, standard output cannot be specified.
File name
|
|
|
|
|
|
|
The output file name used with the data processing process.
Specify with absolute path or relative path.
Specify as $STDOUT for standard output.
If the same output file name is specified for multiple output settings, an error will occur upon conversion.
Enable output file changeover
|
|
|
|
|
|
Sets to perform the enable output file changeover or not.
If you select this item, the Settings button will become active. Click this item to display the Output Location Changeover Settings screen.
Delete 0-byte output files
|
|
|
|
|
|
|
Sets whether to delete the output file when the operation terminates normally but nothing is output.
-
At the time of conversion, if Output file creation mode is set to Add in the output settings and the output file is not 0 bytes before the conversion, the output file is not deleted even when the file is 0 bytes after being converted.
-
In an Excel or XML format, even when nothing is output, the file size is not 0 bytes. However, the output file will be deleted when no record is output.
Omit ID
|
You can omit ID. If you select this, Delimiter and Enclosure character are active.
Delimiter
|
The delimiter for each field of the CSV format file.
Specify from the pull down list.
You can specify it when you select Omit ID.
Delimiter (hexadecimal)
|
If Enter hexadecimal value is selected for Delimiter, specify a delimiter. Enter the value by using hexadecimal characters.
Enclosure character
|
The enclosure character for character data in the CSV format file.
Specify from the pull down list.
You can specify it when you select Omit ID.
Enclosure character (hexadecimal)
|
If Enter hexadecimal value is selected for Enclosure character, specify an enclosure character. Enter the value by using hexadecimal characters.
Add enclosed characters to numeric data
|
Set this to ON to add enclosure characters to numeric data as well as character string data.
Handling of trailing spaces after character data
|
|
Specify how to handle trailing spaces after character data.
- Trim
-
: Processes with trimming the space after.
- Do not trim
-
: Processes without trimming the space after.
- Compress
-
: Processes with trimming the space after. Processes by compressing to single-byte halfwidth space code if the data is space only.
Handling of leading zeroes in numeric data
|
|
Specify how to handle leading zeros in numeric data.
- Trim
-
: Processes with trimming leading zeros.
- Do not trim
-
: Processes without trimming leading zeros.
- Add a zero (0)
-
: If the numeric value data is a positive value, a zero (0) is added to the front of the numeric value data, and then the numeric data is processed.
- Add a plus sign (+)
-
: If the numeric value data is a positive value, a plus sign (+) is added to the front of the numeric value data, and then the numeric data is processed.
Output a title line
|
Specify to output the field name in the CSV information specified in ID as a title line or not.
Zoned decimal
|
|
The sign for external decimal number of conversion data for multi format output or hierarchy format output. You can select a value from 0 to F.
This setting value is adopted for whole record at the time of multi format or hierarchy format output. The zoned decimal setting for each format information specified in the multi format or hierarchy format information is not used.
Packed decimal
|
|
Sign for internal decimal number of conversion data for multi format output or hierarchy format output. You can select a value from 0 to F.
This setting value is adopted for whole record at the time of multi format or hierarchy format output. The packed decimal setting for each format information specified in the multi format or hierarchy format information is not used.
XML Schema instance attributes
|
Select to output the schema instance attribute for XML route node or not.
- Output
-
: Outputs the schema instance attribute.
- Output only the default namespace
-
: The schema instance attribute is output only for the default namespace.
- Do not output
-
: Does not output the schema instance attribute.
If Add prefixes is set, specify Output.
Schema location
|
The path to the schema that will be output into the output XML file.
This field will be ignored when the Category of XML information is DTD and DTD handling is Internal.
Multiple paths can be specified for Schema location by halfwidth space delimiter. The path specified first will become the schema location for the target namespace. Specify namespace and path in set for subsequent ones.
Example: When describing a namespace and a path as a set
namespace-A path-A namespace-B path-B
XML version
|
XML version at time of XML output.
If this is omitted, 1.0 is output.
Standalone declaration
|
Standalone declaration at time of XML output.
You can select whether or not to output the standalone attribute with the following:
・Output: standalone="yes"
・Output: standalone="no"
・Do not output both standalone="yes" and standalone="no"
DTD handling
|
DTD handling at time of XML output.
This field is ignored when the Category of XML information is XML Schema.
- Internal
-
: DTD is output as internal subset of output XML file.
- External
-
: Outputs external reference declaration to the path specified with the Schema location to the output XML file.
Output empty-element tags
|
Handling of NULL data output at the time of XML output.
Select to output the empty-element tag (tag indicating empty element without any content) or not.
- Do not output
-
: Outputs with start tag and exit tag.
- Output
-
: Outputs with empty-element tag.
Output sample:
When output with an empty-element tag
Without an attribute: <XXX/>
With an attribute: <XXX yyy="zzz"/>
When not outputting with an empty-element tag
Without an attribute: <XXX></XXX>
With an attribute: <XXX yyy="zzz"></XXX>
XML record unit
|
Specify how to handle 1 record at the time of XML output.
- Custom
-
: Custom node can be specified as record at the time of mapping.
- 1
-
: Handles the route node as 1 record.
- 2
-
: Handles the setting node 1 level under the route as 1 record.
- 3
-
: Handles the setting node 2 level under the route as 1 record.
For details about the differences in the conversion result for each setting, see DataMagic Operation Manual.
Indentation
|
Specify whether to indent at the time of XML output.
Indent is possible only if Insert a line break after each record is selected.
- Do not indent
-
: The output XML file is output without indentation.
- Indent
-
: The output XML file is output with indentation.
Add prefixes
|
Specify whether prefix is added at the time of XML output.
Set XML schema instance attributes to Output to add the prefix.
Date (D)
|
Specify the conversion method of the null (0 bytes) inside the input data when the data type for input file is date type.
- Default value
-
: Converts to default value.
- NULL
-
: Converts to Null value.
The table below indicates the default value for each data type.
Data type |
Default value |
---|---|
N |
Fullwidth space padding (#1) |
M |
Halfwidth space padding (#1) |
D |
SYSDATE (date of execution) (#2) |
Z |
0 |
W |
Halfwidth space (Unicode) padding (#1) |
#1 |
: |
Value when it is fixed length. It will be a data with size 0 in case of variable length. |
#2 |
: |
YYYY/MM/DD format |
Character string (M, N, or W)
|
Specify the conversion method of the null (0 bytes) inside the input data when the data type for input file is character type.
For details, see Date (D).
Numeric character (Z)
|
Specify the conversion method of the null (0 bytes) inside the input data when the data type for input file is numeric value character type.
For details, see Date (D).
Line break after final record
|
Specify whether the line break code is added at the terminal record of the output file when there is no line break code in the terminal record of the input file when converting to text.
Do not output is specified when the Insert a line break after each record in the Code conversion tab is set to OFF.
- Output
-
: A line break code is added to the terminal record.
- Do not output
-
: A line break code is not added to the terminal record.
Added line break code will be the code set in the Line break code of the output settings.
(3) Code conversion fields
Kanji code type
|
The kanji code type for output file
Select form Shift JIS, JEF, EUC, IBM kanji, KEIS, NEC kanji, UTF-8, UTF-16, or JIS.
If Format in the output settings is CSV or XML, set Shift JIS, EUC, UTF-8, or UTF-16.
For Excel, this is fixed to UTF-8.
In the case of DataMagic Desktop grade, this field is displayed but cannot be changed.
-
If "Format" in the output settings is "CSV", "XML", or "Text", and if "UTF-8" is selected and "BOM addition" is set to "Add BOM", the byte order mark "0xEFBBBF" is output at the start of the file.
-
In the data processing information settings to connect to Oracle, specify the same character set as NLS_LANG for <b>Kanji code type</b> in the input settings and the output settings. If the settings are different, an error occurs in data processing.
Insert a line break after each record
|
|
|
|
|
A flag to add a line break code on each record
If Format is XML, this flag indicates whether to add a line break for each XML tag.
If Format is CSV, you cannot set this item, because line breaks are automatically added.
Line break code
|
|
|
|
|
|
Specify the line break code by using a hexadecimal value.
Up to specified line break code will be determined as a record.
If Kanji code type is UTF-16, enter this value as either 4 bytes or 8 bytes. If Kanji code type is anything other than UTF-16, enter this value as either 2 bytes or 4 bytes.
Path of the EBCDIC user table
|
The EBCDIC user table storage folder.
Specify with absolute path or relative path.
If this path is not specified, the shared data storage folder (Windows) or $DMPATH (UNIX) is used.
-
In the case of DataMagic Desktop grade, this field is not displayed.
-
The shared data storage folder stores system operation information, which is specified during installation of DataMagic. For details, see DataMagic Operation Manual.
Fullwidth and halfwidth character conversion
|
Specify the fullwidth and halfwidth character conversion method for the character string.
You can select Convert halfwidth to fullwidth, Convert fullwidth to halfwidth, or Do not convert.
- Kana conversion
-
: Specify the fullwidth and halfwidth character conversion method for the Kana character string.
- Alphanumeric conversion
-
: Specify the fullwidth and halfwidth character conversion method for the alphanumeric.
- Symbol conversion
-
: Specify the fullwidth and halfwidth character conversion method for the symbol.
Fields to be set if Kanji code type is UTF-8 or UTF-16
Unicode byte order
|
|
|
|
|
|
|
UTF-16 byte order.
Specify the byte order mark output at the head of the file when UTF-16 is selected for Kanji code type for the CSV format, XML format, or text format output.
In the case of DataMagic Desktop grade, this field is not displayed.
- Big-endian
-
: 0xfeff is output.
- Little-endian
-
: 0xfffe is output.
- Same as host
-
: Depends on the byte order of the connected hardware (Windows or UNIX).
Unicode table
|
The conversion method of character depending on the model.
If a type of kanji code type other than UTF-8 or UTF-16 is specified, you cannot specify this field.
For details about conversion method of character depending on the model, see DataMagic Operation Manual.
- Same as host
-
: Converts to the code used at the connected hardware (Windows or UNIX).
- Windows
-
: Converts to the code used with the Windows.
- UNIX
-
: Converts to the code used with the UNIX.
BOM addition
|
|
|
Selection of BOM addition for UTF-8 and UTF-16.
This can be specified if Format in the output settings is CSV, XML, or Text and UTF-8 or UTF-16 is selected for the Kanji code type.
In DataMagic Desktop grade, this field is not displayed when cs4file (encoding of input and output files) is Shift JIS.
- Add BOM
-
: BOM is added.
- Do not add BOM
-
: BOM is not added.
Added BOM is as follows:
- UTF-8
-
:0xEFBBBF
- UTF-16(Little-endian)
-
:0xFFFE
- UTF-16(Big-endian)
-
:0xFEFF
BOM for Little-endian or Big-endian will follow the setting of the Unicode byte order.
If a type of kanji code type other than UTF-8 or UTF-16 is specified, you cannot specify this field.
Fields to be set if Kanji code type is IBM kanji, JEF, NEC kanji, KEIS, or JIS
EBCDIC set
|
|
|
|
|
In the case of DataMagic Desktop, this field is not displayed.
The 1-byte code set type.
If Kanji code type for output file is an EBCDIC type, or JIS encoding, specify this item.
The code set types that you can specify are as follows.
EBCDIC type |
JIS |
---|---|
EBCDIC kana EBCDIC lowercase EBCDIC ASCII EBCDIC ASPEN Japan (Latin) for IBM Japan (Latin) Extended for IBM NEC Katakana Japan (Katakana) Extended for IBM
|
EBCDIC kana EBCDIC lowercase EBCDIC ASCII EBCDIC ASPEN Japan (Latin) for IBM Japan (Latin) Extended for IBM NEC Katakana Japan (Katakana) Extended for IBM ASCII |
-
The conversion between UTF-8/UTF-16 and EBCDIC code, EBCDIC user table cannot be selected as EBCDIC set.
-
When the kanji code type for output setting is JIS, EBCDIC user table cannot be selected as EBCDIC set.
Shift code
|
|
|
|
|
In the case of DataMagic Desktop grade, this field is not displayed.
Specify how to handle a shift code for input file.
If Kanji code type for the input file is either ASCII or Unicode encoding (Shift JIS, EUC, UTF-8, or UTF-16), you can select either Add or Do not add. Alternatively, if Kanji code type for the input file is an EBCDIC type (JEF, IBM kanji, KEIS, or NEC kanji), you can select either Trim or Replace to spaces.
You can specify this field if IBM kanji, JEF, NEC kanji, or KEIS is selected for Kanji code type for output settings.
This cannot be set if "Kanji code type" for input settings is "JIS".
- Trim
-
: Trims the shift code when converting from EBCDIC encoding to ASCII or Unicode encoding.
- Replace with spaces
-
: Converts the shift code to single-byte space when converting from EBCDIC encoding to ASCII or Unicode encoding.
- Add
-
:Shift code is added if the data requires when converting from ASCII or Unicode encoding to EBCDIC encoding.
- Do not add
-
:Shift code is not added when converting from ASCII or Unicode encoding to EBCDIC encoding.
The pattern for this field to be applied is as follows:
Input/Output |
ASCII/Unicode |
EBCDIC |
|||
---|---|---|---|---|---|
M |
N |
M |
N |
||
ASCII/ |
M |
Ignored |
Ignored |
Converted |
Ignored |
N |
Ignored |
Ignored |
Converted |
Ignored |
|
EBCDIC |
M |
Converted |
Ignored (Always trim) |
Ignored |
Ignore (Always trim) |
N |
Ignored |
Ignored |
Ignored (Always add) |
Ignored |
Converted: Converted in accordance with the setting value.
Ignored: This field will be ignored.
In DataMagic, shift codes are defined as follows.
Character code |
Shift out (hexadecimal) |
Shift in (hexadecimal) |
---|---|---|
JEF |
0x29 |
0x28 or 0x38 |
KEIS |
0x0A41 |
0x0A42 |
IBM Kanji |
0x0F |
0x0E |
NEC Kanji |
0x3F76 |
0x3F75 |
Fields to be set if Kanji code type is KEIS
KEIS fullwidth space
|
|
|
|
|
In the case of DataMagic Desktop grade, this field is not displayed.
Selection of KEIS fullwidth space code.
If KEIS is selected as Kanji code type, specify this item. Select fullwidth space code of KEIS when converting Shift JIS, EUC, IBM kanji, and JEF to KEIS code. For details, see DataMagic Operation Manual.
- A1A1
-
: Converts to 0xA1A1.
- 4040
-
: Converts to 0x4040.
Fields to be set if Kanji code type is Shift JIS, IBM Kanji, UTF-16 or UTF-8
Convert characters other than of JIS Level 1 or JIS Level 2 as well
|
|
|
|
|
|
In the case of DataMagic Desktop grade, this field is not displayed.
This enables the conversion of characters other than JIS Level 1 and JIS Level 2 characters. For example, this enables the conversion of widely used JIS Level 3 and JIS Level 4 characters such as circled characters and ㈱, without requiring you to register such characters in the external character table.
This takes effect if Shift JIS, IBM kanji, UTF-8, and UTF-16 are specified for Kanji code.
(4) External characters fields
Conversion table for external characters
|
Whether to use the conversion table for external characters.
Select from the following when the kanji code type is different between input side and output sides.
- Do not use
-
: Without using the conversion table for external characters, convert all external characters to default code.
- Use
-
: Using the conversion table for external characters, convert the external character in accordance to the conversion table for external characters.
- Use preferentially
-
: Using the conversion table for external characters preferentially, and convert the code other than the external character code in accordance to the contents of the table if it is registered in the table.
Select from the following when the kanji code types are same between input side and output side.
- Do not use
-
: Without using the conversion table for external characters, output the input data without conversion.
- Use preferentially
-
: Using the conversion table for external characters preferentially, and convert the code other than the external character code in accordance to the contents of the table if it is registered in the table.
-
The conversion table for external characters is referenced regardless of existence of external character in the input data when this field is set to Use or Use preferentially.
In doing so, a conversion error will occur if corresponding file for external character table expansion does not exist.
-
External character is supported when the character code for the input XML file is UTF-8 or UTF-16, but it is not supporting to the external character of other character code. A conversion error will occur when an external character is in the input XML file other than UTF-8 or UTF-16.
-
When there is a type W at the output side, the external character table used by the type W field will be input code UTF-16. Also, for the case that the input side is UTF-16 and the output side is not UTF-16, only the type W will operate in Use preferentially even if it is set to Use.
Handling of external characters that are not registered
|
How an external character code not registered in the conversion table for external characters is handled.
Select from the following when the kanji code type is different between input side and output sides.
- Use default value
-
: Converts to default code.
- Treat as an error
-
: Make it a conversion error.
If the kanji code type of the input side and of the output side are the same, the following values are fixed and cannot be changed.
- Do not convert
-
: Outputs without conversion.
Path of the external character conversion table
|
The path to the external character conversion table folder gtf.
Specify with absolute path or relative path.
The path that will be reference at the time of execution will be the gtf folder inside the specified path.
If this path is not specified, the shared data storage folder (Windows) or $DMPATH (UNIX) is used.
The shared data storage folder stores system operation information, which is specified during installation of DataMagic. For details, see DataMagic Operation Manual.