Setting fields for resources

= Remarks =

When you set dates that do not exist in the schedule for automatic crawling, the scheduled crawling is performed on the first day of the next month.

Example: If you set the schedule to crawl on the 31st of every month, crawling is not performed in April but on May 1st.

 

DataSpider

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "DataSpider" here.

Resource name

Set the name of DataSpider.

 

Host name

Enter the host name of DataSpider.

 

Port number

Enter the port number of DataSpider.

 

Description

Set a description for DataSpider.

 

Target global resource

Set applicable global resource for crawling.

Before clicking "Get global resource," enter "Host name" and "Port number."

Target project/script

When this field is selected, only scripts registered as services are crawled.

 

Owner

Set the owner of DataSpider.

Set using pre-registered users.

Expert

Set the Expert of DataSpider.

Set using pre-registered users.

Term

Set terms related to DataSpider.

Set using pre-registered terms.

Tag

Set tags related to DataSpider.

Set using pre-registered tags.

Automatic crawling

Set if you want to crawl DataSpider automatically.

 

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

PostgreSQL

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "PostgreSQL" here.

Resource name

Set the name of the database.

 

Host name

Enter the host name of the database.

 

Port number

Enter the port number of the database.

 

User name

Enter the user name.

 

Password

Enter the password.

If the password is not set for the database, you do not need to enter a password.

Database name

Set a database name.

 

URL

Enter a URL.

For example: jdbc:postgresql://(host name or IP address):(port number)/(path of the target database)

Crawling target schema

Set a crawling schema that you want.

Before clicking "Get schema," enter "User name," "Database name," and "URL."

Description

Set descriptions for the database.

 

Owner

Set the owner of the database.

Set using pre-registered users.

Expert

Set the expert of the database.

Set using pre-registered users.

Term

Set terms related to the database.

Set using pre-registered terms.

Tag

Set tags related to the database.

Set using pre-registered tags.

Automatic crawling

Set if you want the database to crawl automatically.

 

Automatic profiling

 Set if you want the database to profile automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

Oracle

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "Oracle" here.

Connection type

Set a method of specifying a resource.

 

Resource name

Set the name of the database.

 

Host name

Enter the host name of the database.

 

Port number

Enter the port number of the database.

 

User name

Enter the user name.

 

Password

Enter the password.

If the password is not set for the database, you do not need to enter a password.

Database name

Set a database name.

 

URL

Set a URL.

For example: jdbc:oracle:thin:@//(host name or IP address):(port number)/(path of the target database)

Crawling target schema

Set a crawling schema that you want.

Before clicking "Get schema," enter "Connection type," "User name," "Database name," and "URL."

Description

Set descriptions for the database.

 

Owner

Set the owner of the database.

Set using pre-registered users.

Expert

Set the expert of the database.

Set using pre-registered users.

Term

Set terms related to the database.

Set using pre-registered terms.

Tag

Set tags related to the database.

Set using pre-registered tags.

Automatic crawling

Set if you want the database to crawl automatically.

 

Automatic profiling

 Set if you want the database to profile automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

SQL Server

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "SQL Server" here.

Resource name

Set the name of the database.

 

Host name

Enter the host name of the database.

 

Port number

Enter the port number of the database.

 

User name

Enter the user name.

 

Password

Enter the password.

If the password is not set for the database, you do not need to enter a password.

Database name

Set a database name.

 

URL

Enter a URL.

For example: jdbc:sqlserver://(host name or IP address):(port number);DatabaseName=(database name)

Crawling target schema

Set a crawling schema that you want.

Before clicking "Get schema," enter "User name," "Database name," and "URL."

Description

Set descriptions for the database.

 

Owner

Set the owner of the database.

Set using pre-registered users.

Expert

Set the expert of the database.

Set using pre-registered users.

Term

Set terms related to the database.

Set using pre-registered terms.

Tag

Set tags related to the database.

Set using pre-registered tags.

Automatic crawling

Set if you want the database to crawl automatically.

 

Automatic profiling

 Set if you want the database to profile automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

MySQL

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "MySQL" here.

Resource name

Set the name of the database.

 

Host name

Enter the host name of the database.

 

Port number

Enter the port number of the database.

 

User name

Enter the user name.

 

Password

Enter the password.

If the password is not set for the database, you do not need to enter a password.

Database name

Set a database name.

 

URL

Enter a URL.

For example: jdbc:mysql://(host name or IP address):(port number)/(path of the target database)

Crawling target schema

Set a crawling schema that you want.

Before clicking "Get schema," enter "User name," "Database name," and "URL."

Description

Set descriptions for the database.

 

Owner

Set the owner of the database.

Set using pre-registered users.

Expert

Set the expert of the database.

Set using pre-registered users.

Term

Set terms related to the database.

Set using pre-registered terms.

Tag

Set tags related to the database.

Set using pre-registered tags.

Automatic crawling

Set if you want the database to crawl automatically.

 

Automatic profiling

 Set if you want the database to profile automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

Db2

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "Db2" here.

Resource name

Set the name of the database.

 

Host name

Enter the host name of the database.

 

Port number

Enter the port number of the database.

 

User name

Enter the user name.

 

Password

Enter the password.

If the password is not set for the database, you do not need to enter a password.

Database name

Set a database name.

 

URL

Enter a URL.

For example: jdbc:db2://(host name or IP address):(port number)/(path of the target database)

Crawling target schema

Set a crawling schema that you want.

Before clicking "Get schema," enter "User name," "Database name," and "URL."

Description

Set descriptions for the database.

 

Owner

Set the owner of the database.

Set using pre-registered users.

Expert

Set the expert of the database.

Set using pre-registered users.

Term

Set terms related to the database.

Set using pre-registered terms.

Tag

Set tags related to the database.

Set using pre-registered tags.

Automatic crawling

Set if you want the database to crawl automatically.

 

Automatic profiling

 Set if you want the database to profile automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

JDBC

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "JDBC" here.

Resource name

Set the name of the database.

 

User name

Enter the user name.

 

Password

Enter the password.

If the password is not set for the database, you do not need to enter a password.

URL

Enter a URL.

Refer to the document provided by the vendor of the driver that you use.

Crawling target schema

Set a crawling schema that you want.

Before clicking "Get schema," enter the "User name," "Resource name," and "URL."

Description

Set descriptions for the database.

 

Owner

Set the owner of the database.

Set using pre-registered users.

Expert

Set the expert of the database.

Set using pre-registered users.

Term

Set terms related to the database.

Set using pre-registered terms.

Tag

Set tags related to the database.

Set using pre-registered tags.

Automatic crawling

Set if you want the database to crawl automatically.

 

Automatic profiling

 Set if you want the database to profile automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

Amazon S3

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "Amazon S3" here.

Resource name

Set the name of Amazon S3.

 

Access key ID

Enter the access key ID.

 

Secret access key

Enter the secret access key.

 

Endpoint

Enter the endpoint.

Refer to the following URL:

https://docs.aws.amazon.com/en_us/general/latest/gr/rande.html#s3_region

Description

Set descriptions for Amazon S3.

 

Crawling target bucket

Set the crawling bucket that you want.

Before clicking "Get bucket," enter "Resource name," "Access key ID," "Secret access key," and "Endpoint."

Owner

Set the owner of Amazon S3.

Set using pre-registered users.

Expert

Set the expert of Amazon S3.

Set using pre-registered users.

Term

Set terms related to Amazon S3.

Set using pre-registered terms.

Tag

Set tags related to Amazon S3.

Set using pre-registered tags.

Automatic crawling

Set this field if you want to crawl Amazon S3 automatically.

 

Automatic profiling

 Set this field if you want to profile Amazon S3 automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

Azure Blob Storage

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "Azure Blob Storage" here.

Resource name

Set the name of Azure Blob Storage.

 

Connection string

Enter the connection string.

Refer to the following URL:

https://docs.microsoft.com/en-us/azure/storage/common/storage-configure-connection-string#configure-a-connection-string-for-an-azure-storage-account

Crawling target container

Set the crawling container that you want.

Before clicking "Get container," enter "Resource name" and "Connection string."

Description

Set a description for Azure Blob Storage.

 

Owner

Set the owner of Azure Blob Storage.

Set using pre-registered users.

Expert

Set the expert of Azure Blob Storage.

Set using pre-registered users.

Term

Set terms related to Azure Blob Storage.

Set using pre-registered terms.

Tag

Set tags related to Azure Blob Storage.

Set using pre-registered tags.

Automatic crawling

Set if you want to crawl Azure Blob Storage automatically.

 

Automatic profiling

 Set if you want to profile Azure Blob Storage automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

Google Cloud Storage

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "Google Cloud Storage" here.

Resource name

Set the name of Google Cloud Storage.

 

Service account authentication key

Specify the authentication key file for the service account in JSON format.

When you select the file, "Project ID," "Client ID," and "Client email address" are entered.

Crawling target bucket

Set the crawling target bucket.

Before clicking "Get bucket," set "Service account authentication key."

Description

Set descriptions for the database.

 

Owner

Set the owner of the database.

Set using pre-registered users.

Expert

Set the expert of the database.

Set using pre-registered users.

Term

Set terms related to the database.

Set using pre-registered terms.

Tag

Set tags related to the database.

Set using pre-registered tags.

Automatic crawling

Set if you want the database to crawl automatically.

 

Automatic profiling

 Set if you want the database to profile automatically.  

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.

  

 

Google BigQuery

Field name

Description

Remarks

Resource type

Select a type of resource.

Set "Google BigQuery" here.

Resource name

Set the name of Google BigQuery.

 

Service account authentication key

Specify the authentication key file for the service account in JSON format.

When you select the file, "Project ID," "Client ID," and "Client email address" are entered.

Crawling target dataset

Set the crawling target dataset.

Before clicking "Get dataset," set "Service account authentication key."

Description

Set descriptions for the database.

 

Owner

Set the owner of the database.

Set using pre-registered users.

Expert

Set the expert of the database.

Set using pre-registered users.

Term

Set terms related to the database.

Set using pre-registered terms.

Tag

Set tags related to the database.

Set using pre-registered tags.

Automatic crawling

Set if you want the database to crawl automatically.

 

Initial settings of new asset permissions

If you select "Apply the parent asset permissions", the new asset inherits the permissions of the parent asset. If you do not select this check box, the new asset is added with no permissions.