Get File/Folder List

Operation name

Function overview

Gets file/folder list on Amazon S3.

Data model

The data model of this component is XML type.

Tutorials

For details about how to create a connection to Amazon S3, refer to the following tutorial:

Create a connection to Amazon S3

Properties

= Remarks =

For details on use of variables, refer to Variables.

Basic settings

Item name	Required/Optional	Use of variables	Description	Remarks
Name	Required	Not available	Enter a name that is used on the script canvas.

Required settings

Item name	Required/Optional	Use of variables	Description	Remarks
Destination	Required	Not available	Select a connection resource. Add A new connection resource can be added. Edit list Connection resource settings can be edited in > HULFT INTEGRATE > Connections.
Bucket name	Required	Available	Specify a bucket.	For Bucket name, if you specify a bucket in which a large number of files exist, it may take time to update the list in Folder path.
Folder path	Required	Available	Enter an Amazon S3 folder path.	Note Specify the absolute path of Amazon S3 as the folder path. With the exception of the path separator "/", the Restricted characters of HULFT Square Storage can't be used.
Recursive processing	Optional	Not available	For a specified folder, select whether to get the list recursively or not. Selected If the specified folder contains folders, get the list recursively. Not selected (Default) Get a list only for the specified folder.
Include permissions in result	Optional	Not available	Select whether to include file access right information in the results. Selected Include file access right information in the results. Not selected (Default) Don't include file access right information in the results.

Data processing method

Item name	Required/Optional	Use of variables	Description	Remarks
Data processing method	Required	Not available	Select a data processing method. Apply script settings (Default) The setting for mass data processing in the script properties is applied to the connector. Do not perform mass data processing Mass data processing isn't performed. Perform mass data processing Mass data processing is performed.

Item name

Required/Optional

Use of variables

Description

Remarks

Data processing method

Required

Not available

Select a data processing method.

Apply script settings

(Default)

The setting for mass data processing in the script properties is applied to the connector.

Do not perform mass data processing

Mass data processing isn't performed.

Perform mass data processing

Mass data processing is performed.

Comment

Item name	Required/Optional	Use of variables	Description	Remarks
Comment	Optional	Not available	You can write a short description of this connector.

Schemas

Input schema

None.

Output schema

<?xml version="1.0"?>
<server>
  <bucket name="" status="" >
    <file etag="" name="" public="" remotepath="" size="" status="" storageclass="" type="" updated="" />
  </bucket>
</server>

Element name	Attribute name	Description	Remarks
server	-
bucket	-	Appears for the bucket that is specified in Bucket name.
	name	Outputs the name that is specified in Bucket name.
	status	Outputs the status of the bucket that is specified in Bucket name. Exist The bucket exists. ErrorBucketNotFound The specified bucket doesn't exist in Amazon S3. The specified Bucket name may be incorrect. Error The bucket couldn't be retrieved because an error has occurred.
file	-	Appears once for each retrieved file/folder.
	etag	Outputs the ETag of the retrieved file/folder.	If file/folder information couldn't be retrieved successfully, the value is blank.
	name	Outputs the name of the retrieved file/folder.	If status is "ErrorRemoteFolderNotFound", then the value is blank.
	public	Outputs the access right of the retrieved file/folder. true Public false Private	If file/folder information couldn't be retrieved successfully, the value is blank. When "READ" permissions is given to "AllUsers Group", it's "Public". If Include permissions in result isn't selected, then the value is blank.
	remotepath	Outputs file path on Amazon S3 of the retrieved file/folder.
	size	Outputs the size of the retrieved file/folder. The unit is byte.	If file/folder information couldn't be retrieved successfully, the value is blank. In the case of a folder, "0" is always output.
	status	Outputs the status of the retrieved file/folder. Exist The file/folder exists. Virtual The folder specified in Folder path doesn't exist on Amazon S3 but files and/or folders exist in the folder. ErrorRemoteFolderNotFound The folder specified in Folder path doesn't exist on Amazon S3, or a file is specified. Error The file/folder information couldn't be retrieved because an error has occurred.
	storageclass	Outputs Storage Class of the retrieved file/folder. STANDARD Standard REDUCED_REDUNDANCY RRS(Reduced Redundancy Storage) STANDARD_IA Standard_IA	If file/folder information couldn't be retrieved successfully, the value is blank.
	type	Outputs the classification of the retrieved file/folder. File File Folder Folder
	updated	Outputs the last updated date of the retrieved file/folder.	If file/folder information couldn't be retrieved successfully, the value is blank.

Loading schema in Mapper

The schema is loaded automatically.

= Remarks =

For details, refer to Edit Schema.

Mass data processing

Mass data processing is supported.

Parallel Stream Processing

PSP isn't supported.

Available component variables

Component variable name	Description	Remarks
count	The number of retrieved folders and files is stored.	The default value is null. The sum of "folder_count" and "file_count".
folder_count	The number of retrieved folders is stored.	The default value is null.
file_count	The number of retrieved files is stored.	The default value is null.
message_category	When an error occurs, the category of the message code corresponding to the error is stored.	The default value is null.
message_code	When an error occurs, the code of the message code corresponding to the error is stored.	The default value is null.
message_level	When an error occurs, the severity of the message code corresponding to the error is stored.	The default value is null.
error_type	When an error occurs, the error type is stored.	The default value is null. The format of the error type is as follows. Example: java.io.FileNotFoundException
error_message	When an error occurs, the error message is stored.	The default value is null.
error_trace	When an error occurs, the trace information for the error is stored.	The default value is null.

Message codes, exception messages, and limitations

Connector	Message code	Exception message	Limitations
Messages and limitations of the Amazon S3 connector