Notes on temporary files

After data processing finishes successfully, temporary files are deleted automatically. However, temporary files might not be deleted if the data processing is terminated abnormally because of DataMagic forcibly termination. In this case, delete the following temporary files from the folder where the temporary files were generated.

Also, note that during conversion a capacity of about 5 times the input data size is required for temporary files. The required capacity differs depending on the contents of the input data. Estimate the required capacity by measuring in your environment.

The following are the paths and names of the temporary files.

(1) Matching

In the matching settings, if you select Expand to a file in Expansion method, temporary files are created in the following location.

Path:: The folder specified in work file directory name (work_dir) of the system environment settings file (huledenv.conf).
File names:: [uuid].match[%d].tmp; [uuid].match[%d].tmp-journal; ([uuid] is a unique identification string and [%d] is the matching number.)

(2) Sorting

If you set the sort settings in the input settings, temporary files are created in the following location.

Path:: The folder specified in work file directory name (work_dir) of the system environment settings file (huledenv.conf).
File names:: [uuid].sort.tmp; [uuid].sort_merge.tmp; ([uuid] is a unique identification string.)

(3) Merging

If you set the merge settings in the input settings, temporary files are created in the following location.

Path:: The folder specified in work file directory name (work_dir) of the system environment settings file (huledenv.conf).
File name:: [uuid].sort.tmp; [uuid].sort_merge.tmp; [uuid].merge_merge.tmp; ([uuid] is a unique identification string.)

(4) Virtual table

If you set up virtual tables, temporary files are created in the following location.

Path:: The folder specified in the work file directory name (work_dir) of the system environment settings file (huledenv.conf).
File names:: [uuid].vttable.tmp; [uuid].vttable.tmp-journal; ([uuid] is a unique identification string.)

(5) Output location (use of field values)

In the output settings, if you select Use field values in Output location, a temporary file is created in the following location.

Path:: If the work file path is specified, the specified path; if there is no such specification, the folder specified in the work file directory name (work_dir) of the system environment settings file (huledenv.conf).
File name:: [uuid].out[%d].tmp; ([uuid] is a unique identification string. [%d] is a sequential number of the process, which can be up to 10 digits.)

(6) Output to XML file

In the output settings, if you select XML in Format and select Custom in XML record unit, a temporary file is created in the following location.

Path:: The folder specified in the work file directory name (work_dir) of the system environment settings file (huledenv.conf).
File name:: [uuid].xmlout; ([uuid] is a unique identification string.)

Note

Because SQLite is used in the cases of (1), (4) and (6), temporary files of SQLite are created in the following location.

SQLite searches for a path in the following order and creates temporary files in the first path that is found.

Windows:: %TMP%; %TEMP%; current-folder
UNIX/Linux:: /var/tmp; /usr/tmp; /tmp; current-folder