Available functions of DataMagic

The following functions are available for DataMagic to perform various data processing.

For details on each function, see Data input functionData processing functionData output functionOther functions related to DataMagic operations.

Table 1.1 Available functions of DataMagic

Functions

Overview

Data input function

Data extraction

This function extracts the data from the specified input file or database. In addition, you can extract only necessary records from the input file.

Data matching

This function combines the input file and other file (matching file) by using common field name with the input file as keys.

Data sorting

This function allows you to sort the order of the data in the input file.

Data merging

This function allows you to merge the data in the input file.

Checking input data

This function checks the input file before data processing.

Data processing function

Attribute conversion

This function allows you to change the attribute of numeric data type.

Data insertion

This function allows you to insert a value anywhere in a record.

Field replacement

This function allows you to replace fields in the input file.

Code conversion

This function can convert the encoding between 1-byte codes or between 2-byte codes.

Numeric field computations

This function allows you to perform calculations by the operation formula you specified to the numeric data type.

This function allows you to set output to various numeric character formats, including sign output, round to nearest value (up for 5 and above), digit delimiter output and currency symbol output.

Combining fields

This function allows you to combine the fields as one field.

Splitting a field

This function allows you to extract a field as multiple fields.

Settings of the user exit program

In the data processing, this function allows you to create custom conversion logic (user exit program) to perform a user-specific conversion in the unit of field.

Specifying dynamic values

During data processing, a numeric value or character string given as an argument of a command can be used in the extraction conditions and output information. Therefore, this function allows you to dynamically change the compared value in the extraction condition.

Conversions that use functions

This function allows you to run a computational function on an input field value.

Setting variables

This function allows you to store input records in the variable area. You can store multiple record values in that area and use them to conduct numeric computations. You can also store previously loaded record values in the same area, and compare them to or use them to judge the values of subsequent records.

Executing query to virtual tables

This function allows you to temporarily store information about CSV files, format files, Excel files, or database table files in a virtual table. You can edit data and apply numeric operations by SQL statements.

Conversion using common components

This function allows you to use the common component that is made of the common processing used in data processing.

Data output function

Sorting data into specified output locations

Instead of a single file, this function allows you to specify the different output files for each condition.

Specifying output file names

This function allows you to specify a character string, date and time, serial number, or other variable to be used in an output file name.

Enabling output file changeover

This function allows you to change over output files each time the specified number of output records, input fields, or variables is changed.

Functions related to DataMagic operations

Importing and exporting management information

This function allows you to import and export DataMagic management information.If you import the exported management information, you can use the previous management information in the new environment.

Exclusive control of networked files

When you use files on your network for purposes such as processing input data or output data, this function allows you to access files on your network and applies locks on the files.

Switching of language

This function allows you to switch the language used for display between Japanese and English.

Executing in multi-thread

This function allows you to execute data processing by using multi-thread, and enables faster data processing than data processing by using single-thread.

Executing test for data processing

This function allows you run a test for data processing to be able to continue data processing even if a minor error occurs.

Step execution of data processing

This function allows you to execute data processing by checking the process like a debugger for a program.

Outputting specifications of data processing

This function allows you to output data processing and its settings (specifications) to an Excel file.

Tutorial

This function allows you to learn the basic operation of DataMagic by setting data processing interactively.