Method of deletion for temporary data on Amazon S3

When data is uploaded to an object storage, HULFT Cloud Storage Option creates temporary data on the object storage.

If an upload to object storage is interrupted, this temporary data may not be deleted and will remain on the object storage.

If temporary data remains, you may incur charges for this data as well, so be sure to delete the temporary data.

To delete temporary data on Amazon S3, use either of the following methods:

Automatic deletion according to the period set for the lifecycle
Manual deletion

Automatic deletion according to the period set for the lifecycle

You can set the lifecycle for buckets on Amazon S3 in advance to delete temporary data automatically after a set period of time.

Set the lifecycle according to actual operations.

For details on the setting procedure for the lifecycle, refer to the manual for the object storage.

Manual deletion

You can delete temporary data by using the AWS CLI command.

Check the console log or trace log output when an error occurs in an upload.

The information for the "UploadID" is included in the output message.

Use the "UploadID" to execute the AWS CLI command.

<Example of AWS CLI command execution>

aws s3api abort-multipart-upload –bucket Bucket Name --key Object Name --upload-id
"UploadID" output in the message

<Example of message output (for console log)>

ID=W149005 DATE=2019/12/28 09:57:39 CLASS=W PNAME=hulrcv PID=24520 TID=1564 DTLCODE=0 MYHOST=HOST01 UNAME=SYSTEM FID=AWS SNAME= A warning was generated during the termination processing after the output of receiving data (Content=Upload canceled, but any uploaded parts on S3 might not have been removed. <Bucket="hulcloud-001",UploadID="ee07qcIlEWoKRTFIV1qqfIrpZWDVs6x8XEaciJck89OKut4r1UyrOCBDDZi._8As6_UWrgJpB2X.9FR76aYvuVlAsCvRVYHumjJz87Rtn1j5yFm0PyiLaPOO_qYW.CTM7UIXPuj6p6SHOqFDhrzN5Q--">).(ThreadID=1564)

<Example of message output (for trace log)>

ID=W1023005 DATE=2019/12/18 16:21:54 CLASS=W HULCHARACTER=     PNAME=hulrcvd PID=25474  DTLCODE=10   MYHOST=HOST01 UID=0 MSG=A warning was generated during the termination processing after the output of receiving data. DETAIL=Upload canceled, but any uploaded parts on S3 might not have been removed. <Bucket="hulcloud-001",UploadID="ow2LzoHXVbvf0vG8V3wL5EMyVda_bIf5OqfsweCfmCow.cFhQXxh7T9c0cTjI8m7665RT6pn_jKL0wVKJo7FdnShp48POQNTtu28dLYZ2Mw-">