Technical

Tips

How to Merge Multiple Files

You can download a sample script for this tip by clicking on the following link.
Please download the sample script and try it out.

Sample Script_Tips4

How to use the sample script:
1. Download the sample script file to local disk from above link.
2. Start DataMagic Manager and log in.
3. From the menu of DataMagic Management screen, select Import Management Information and import the sample script.
4. Download the sample data files and place them to the indicated path as below.

Introduction

A merge is a type of processing that integrates multiple files or data by following a given set of rules.
For example, when you merge product masters, you can delete the data with an earlier registration date if duplicate data for the same product name exists.
You can perform this kind of processing by using DataMagic.

Processing diagram

Functions used
 - Merge

Diagram of completed data processing information and required settings

Sample data files

merge In.txt
merge merge.txt
  • *Click to download the sample data files and place them to the indicated place.
How to Create Sample Data Processing Information
1. Create new data processing information with the name Tips4.
2. Double-click Input Settings to open the Input Settings window, and set the input file. After you set the input file, go to the Merging tab.
3. Set the file to be merged.
4. Define the fields to be analyzed for duplicate data.
5. Define the fields by which priority is to be assigned to duplicate data, and the order in which duplicate data is to be listed.
6. For Add extraction condition, select OK.
7. Double-click Output Settings to open the Output Settings window, and specify the output file.
8. Associate the extraction conditions with the output settings, and double-click Set Mapping Information to open the Set Mapping Information window.
9. Map the input and output data items.
10. Finish creating the data processing information, and execute the processing. If the same data as in the processing diagram is output, the processing was successful.
In Conclusion

So, what do you think?
By performing a merge, you can not only combine multiple files, but also check for and delete duplicate data.