Load Table Data

Operation Name

Load Table Data

Function Overview

Get data from the file on Google Cloud Storage, and write the data to the table on Google Big Query.

Properties

For details on using variables, refer to "Variables".
Basic Settings
Item name Required/Optional Use of variables Description Remarks
Name Required Not Available Enter the name on the script canvas.  
Required Settings
Item name Required/Optional Use of variables Description Remarks
Destination Required Not Available Select Global Resources.
  • [Add]:
    Adds a new global resource.
  • [Edit list]:
    Allows you to edit the global resource settings on the "Edit resource list" screen.
  
Bucket name Required Available Select or enter the bucket name.  
Folder path Required Available Select or enter a folder path.
  • Specify a folder path as an absolute path on Google Cloud Storage.
  • Specify a slash (/) at the beginning and the end.
  • Consecutive slashes (//) cannot be included.
File name Required Available Select or enter file name.
  • A slash (/) cannot be included.
Destination project ID Required Available Select or enter the destination project ID.  
Destination dataset name Required Available Select or enter the destination dataset name.  
Destination table name Required Available Select or enter the destination table name.
  • If the specified table does not exist, create a new table by using the specified name, and write to the table.
Property Action
Item name Description Remarks
Update the list of bucket names Get buckets in the specified destination, and set them in [Bucket name].
  • If [Destination] is specified/edited, or a bucket has been added/edited on Google Cloud Storage, you can apply the changes by using this property action.
Update the list of folder paths Get folder paths in the specified bucket, and set them in [Folder path].
  • If [Bucket name] is specified/edited, or a folder has been added/edited on Google Cloud Storage, you can apply the changes by using this property action.
  • If variable is set to [Bucket name path], this action will be invalid.
Update the list of file names Get files in the specified folder path and set them to [File name].
  • If [Folder path] is specified/edited, or a file has been added/edited on Google Cloud Storage, it can be applied using this property action.
  • If a variable is set to [Bucket name] or [Folder path], this action will be invalid.
Update the list of destination project IDs Get projects in the specified destination, and set them to [Destination project ID].
  • If [Destination] is specified/edited, or projects have been added/edited on Google BigQuery, you can apply the changes by using this property action.
Update the list of destination dataset names Get datasets in the specified project and, set them in [Destination dataset name].
  • If [Destination project ID] is specified/edited, or a dataset has been added/edited on Google BigQuery, you can apply the changes by using this property action.
  • Disabled if variable is set to [Destination project ID].
Update the list of destination table names Get tables in the specified dataset, and set them in [Destination table name].
  • If [Destination dataset name] is specified/edited, or a table has been added/edited on Google BigQuery, you can apply the changes by using this property action.
  • Disabled if variable is set to [Destination project ID] or [Destination dataset name].
Read settings
Item name Required/Optional Use of variables Description Remarks
Input file format Optional Not Available Select an input file format.
  • [CSV]: (default)
    Read data from Google Cloud Storage in CSV format.
  • [TSV]:
    Read data from Google Cloud Storage in TSV format.
 
Do not read the first line as a value Optional Not Available Select whether or not to handle the first column of the specified file on Google Cloud Storage as data.
  • [Checked]:
    Do not handle as data.
  • [Not checked]: (default)
    Handle as data.
 
Write Settings
Item name Required/Optional Use of variables Description Remarks
Write settings of destination tables Optional Not Available Select an option to use when writing.
  • [Add to table]: (default)
    Add data to the end of an existing table.
  • [Overwrite table]:
    Delete all the data in the write destination table, and write data.
 
Comment
Item name Required/Optional Use of variables Description Remarks
Comment Optional Not Available You can write a short description of this adapter.
The description will be applied in the specifications.		  

Schema

Input Schema

None

Output Schema

None

Transaction

Transaction is not supported.

PSP Usage

PSP cannot be used.

Available Component Variables

Component variable name Description Remarks
message_category When an error occurs, the category of the message code corresponding to the error that occurred is stored.
  • The default value is null.
message_code When an error occurs, the code of the message code corresponding to the error that occurred is stored.
  • The default value is null.
message_level When an error occurs, the severity of the message code corresponding to the error that occurred is stored.
  • The default value is null.
error_type When an error occurs, the type of error that occurred is stored.
  • The default value is null.
  • Error type is in the following format:
    Example: "java.io.FileNotFoundException"
  • The contents to be stored may vary depending on the version of DataSpider Servista.
error_message When an error occurs, the message of the error that occurred is stored.
  • The default value is null.
  • The contents to be stored may vary depending on the version of DataSpider Servista.
error_trace When an error occurs, the trace information of the error that occurred is stored.
  • The default value is null.
  • The contents to be stored may vary depending on the version and client applications of DataSpider Servista.

Specification Limits

Major Exceptions

Exception Name Cause Solution
ResourceNotFoundException
Resource definition is not found. Name:[]		 [Destination] is not specified. Specify [Destination].
ResourceNotFoundException
Resource definition is not found. Name:[<Name of global resources>]		 Resource definition selected in [Destination] is not found. Check the global resource specified in [Destination].
InvalidPropertyConfigurationException
<property name> is not specified.		 [<Property name>] is not specified. Specify [<Property name>].
BigQueryServiceException
Failed to execute the job.		 Failed to execute the job. Identify the cause of the error by referring to the error logs, and resolve the problem.
BigQueryServiceException
Failed in the operation for Google BigQuery.		 Failed in the operation for Google BigQuery Identify the cause of the error from the status code and error code by referring to the error message list page of Google BigQuery (https://cloud.google.com/bigquery/docs/error-messages), and then resolve the problem.
CloudStorageServiceException Failed in the operation for Google Cloud Storage. Identify the cause of the error from the status code and error code by referring to the status code and error code list page of Google Cloud Storage (https://cloud.google.com/storage/docs/json_api/v1/status-codes), and then resolve the problem.
ResourceManagerServiceException Failed in the operation for Google Resource Manager. Identify the cause of the error from the status code and error code by referring to the error message list page of Google Resource Manager (https://cloud.google.com/resource-manager/docs/core_errors), and then resolve the problem.

Notes