Release notes

2023.4.1 (2024/3/10)

2023.4 hotfix (2024/2/21)

2023.4 (2024/1/28)

New features

Notification function

You can now send notifications to a specified email or service screen in cases like the below.

  • When a job fails (email notification)

  • When a job succeeds (browser notification on service screen)

  • When HULFT Integrate or a HULFT Transfer service shuts down or becomes available for use

  • When you have set a threshold per month for each type of value that can be checked on the dashboard, and usage exceeds one of the set values

For more details on what you can send notifications about, refer to Types of notifications and notification destinations.

Script dependency

If you use a lot of Call Script operations, the dependency of the scripts may become difficult to determine, and the version management may become a hassle.

By using this function, you can make the structure of Call Script operations visual.

The following settings can be configured for each script:

  • Always call latest version

  • Call specified version

You can also configure the above settings all at once for all scripts.

If you purchase paid options, you can display the structure graphically.

This allows you to instinctively grasp which scripts will be affected when you change the version of a script.

Additionally, if the script has multiple hierarchies, you can configure the setting to call the latest version so that the setting is inherited from the specified script to all scripts below it.

Improved features

Display of the REST API job execution count

The execution count for REST API jobs has been added to the dashboard. The total count by day and by month are now displayed.

Improvements to audit logs

In Audit Log, when you set "On" for Status, the detailed logs for the script are also saved. This is available in both HULFT Integrate and HULFT Transfer.

Improvements to applications

Applications have been officially released.

You can now specify a script or scheduled job to create an application. You can also clone an application and edit it.

Connectors

The following connector was added:

  • PostgreSQL connector

    • Supports PostgreSQL 15

Additional OS support

Windows 11 is now supported.

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

> JOBS > File Event Jobs

Multiple file event jobs might run if all of the following conditions are met:

  • A parent directory that includes 100 or more subdirectories or files is created

  • A file event job that runs when the parent directory is deleted is created

  • The parent directory is deleted

2

Designer

In the Mapper editor of Designer, when you edit a schema and change the order of schemas, the schema structure displayed in the right pane may not be sorted, and cease to match.

3

> SERVICES

When there are 200 or more workspaces, the Integrate service may be forcibly restarted.

4

> AUDIT >

If you open HULFT Square on multiple tabs of a tabbed browser and then log out on one of them, multiple logout messages may be recorded in the log.

5

> API MANAGEMENT > API Projects

If an extremely large number of versions of an API project exist, you might not be able to open the project from the resource editing screen.

6

Designer

BOX connector

If you generated a JWT keypair for Box in October 2023 or thereafter, you can't connect to the corresponding Box.

(2024/2/21)

7

> DATA INTEGRATION > Connections > FTP connector

Even if you create a connection with FTP over SSL/TLS, you may not be able to connect. Connection may not be possible depending on the encryption algorithms that are supported by the FTP server at the connection destination.

(2024/3/10)

8

> JOBS > HULFT Transfer Jobs

When you create, edit, delete, enable, or disable a HULFT Transfer job, the following message might be displayed on the screen:

"Unexpected Error Endpoint request timed out"

(2024/3/10)

9

> Audit logs

When audit logs are automatically stored and output to files, the output data may consist of only the headers.

(2024/3/10)

10

Confirmation email for user invitation

The signature of the email that HULFT Square sends to customers when a user invitation is completed has been changed to "The HULFT Square Team".

(2024/3/10)

Release note history

Closed2023.3 hotfix3 (2023/12/3–)

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

> DATA INTEGRATION > Projects

If an extremely large number of versions of a project exist, you might not be able to open the project from the project screen.

(2023/12/3)

Closed2023.3 hotfix2 (2023/11/21–)

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

> JOBS > HULFT Transfer Jobs

HULFT Transfer jobs might not start if either of the following conditions is met:

  • HULFT on the sending-side client is Ver.8 or later, and V7 compatible is selected in HULFT Transfer Hosts

  • HULFT on the sending-side client is earlier than Ver.8

(2023/11/21)

2

> SERVICES > Storage

If you delete a workspace and then create a workspace of the same name, when you attempt to display the workspace, the storage for the deleted workspace may be displayed.

(2023/11/21)

Closed2023.3 hotfix (2023/10/15–)

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

> AUDIT >

If you enable audit logs and retrieve the user login history as "audit-user-login-history-yyyymmdd.log.gz" from the storage, the order of item names in the title row and the order of item names in the output log don't match.

Title row: Date,Event Type,Email,Name,....

Output log: Date,Email,Name,Event Type,....

(2023/10/15)

2

Monitoring

When you change a username, the change might not be reflected in logs.

(2023/10/15)

3

Monitoring

If commas are included in the log data, when you output the data to a file, it might not be processed correctly as CSV.

(2023/10/15)

Closed2023.3 (2023/9/24–)

Functions with "Experimental" sign

These are trial functions to test usability. At present, proper verification of quality and usability haven't been performed yet. Therefore, because the UI and UX may change significantly in future releases, compatibility isn't guaranteed. Experimental functions aren't the object of guarantees or support services. We hope you will use them and provide feedback to our support desk.

New features

Single sign-on

Single sign-on that uses Microsoft Entra ID (formerly Azure AD) is now supported.

You can simply log in to HULFT Square with the domain credentials you currently use.

To use this function, you need to set the permissions from the policy.

For details about usage, refer to Single Sign-on and the tutorials described there.

Status of HULFT Integrate services

You can now see the usage status of the JVM Non-Heap Memory, CPU, and JVM Heap Memory in HULFT Integrate services. Based on the usage, you can choose to restart the service, or determine whether to scale up or scale out.

For details on how to make these determinations, refer to When the status of a HULFT Integrate service is yellow or red.

Applications (Experimental)

You can now install and use safe, reliable, thoroughly-reviewed applications from App Square.

You can now carry out a specific Data Integration task by simply executing an application, without the need to create a script from scratch. To use this function, you must configure a profile, HULFT Integrate service, connections, and other settings according to HULFT Square specifications.

You can use the provided applications as a base for customizations, or use them as parts for your own script.

As of this release, application events are now referred to as "service events."

Improved features

Improvements to organization information

Your AWS account ID and the global IP address of your environment that is used for HULFT Square are now displayed in your organization information. You can now quickly and easily refer to your HULFT Square IP address during tasks such as adding it to your allowlist or connecting with PrivateLink.

Additional time zone support

The number of time zones you can specify when you complete your contract has increased. Accordingly, additional considerations have been made for time zones in processing such as Date/Time Constant.

Improvements to script properties

The version and the last updated date and time are now displayed on the Basic information tab of the script properties.

Improvements to audit logs

System Events and User Login History have been added to the audit logs. You can now refer to information on changes made by users and on when users logged in or out. You can also save logs in the storage of the specified workspace and download the logs.

This doesn't include features that already supported download and export. Also, it doesn't include logs for experimental applications.

Improvements to log functions

The log functions have been improved. When the number of log records in the execution log reaches the display limit, only errors and completion messages are displayed. You can view all the log records in the event log of HULFT Integrate.

This improvement reduces unnecessary memory usage and eliminates a source of instability.

Improvements to the service event log filter

On the screen to view details of the service log or the execution log for a script, specification of hours/minutes/seconds has been added to the filter function. Also, Error has been added as a log level.

This allows you to narrow down your search to the problem area and select log records to view.

Improvements to connectors for OAuth

The OAuth 2.0 redirect URI has been changed.

Although the previous URI will be available for use until March 31, 2024, we recommend that you use the new URI from now on. For details, refer to Announcement regarding authentication incompatibility for HULFT Square Auth (OAuth 2.0) (Japanese language only).

Improvements to File connector timeout

There was a limit on File connectors of a maximum timeout of 350 seconds. This has been improved. As a result, timeouts no longer occur when copying large files.

Connectors

The following connector was updated:

  • File Operation connector

    • Compress GZIP

    • Extract GZIP

Experimental functions included in this release

*Refer to Functions with "Experimental" sign.

APPLICATIONS

Applications are experimental functions. Logs can be viewed from > Application, but download isn't available.

When an application that supports schedule execution is released, you will be able to execute according to a schedule. In the current version, the longest interval for execution is every day, and setting execution for every week or every month isn't available.

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

> DATA INTEGRATION > Connections

  • The dropdown list on the edit screen for a connection resource may be blank.

  • For the field for the settings file of the Box connector, although "Select a private key file" is displayed on the screen when you click Browse, it should actually be "Select a file".

2

> DATA ENTRY > HULFT Transfer Receive

> DATA ENTRY > HULFT Transfer Send

In File to receive of the HULFT Transfer Receive configuration and File to send of the HULFT Transfer Send configuration, on the screen that is displayed when you click Browse, "Select a directory" is displayed but it should actually be "Select a file".

3

> API MANAGEMENT > API Projects

  • Selecting for the HTTP methods for an API project may display the wrong message.

  • If the version number is a value that exceeds 400, the latest version is displayed, but there may be items that aren't displayed.

4

> JOBS > REST API Jobs

When you select Turn off job from the action menu, the message "Are you sure you want to turn on the REST API job?" is displayed. Although the opposite message is displayed, the job is disabled correctly.

In the same way, when you select Turn on job, the opposite message is displayed. The job is enabled correctly.

5

Monitoring

The Japanese word breaker of the filter may not work properly.

For example, in the filter for project name, nothing is displayed when you search for "新しい", but "新しいプロジェクト" is displayed when you search for "新".

6

> SERVICE EVENTS > HULFT Integrate

  • If an unexpected error occurs while you are running a script, it may appear in the log that the script continued running. If that occurs, the Project name and Script name will be blank.

  • If you execute multiple Script Calls using thread processing, the logged script names may differ from the actual names.

7

> USER MANAGEMENT > Users

  • Although you specify a group when you invite a user, permissions for that group may not be granted properly.

    For example, when you specify the Developer group during an invitation, if that user tries to see the accessible workspace, messages such as "Require workspace permission: READ" may be displayed.

8

Designer

  • When you create a script, if you close Designer without running the script at least once, a "Failed to load script" error occurs when you reopen the script and try to run it.

  • Although the lock information is listed in the script properties, there's no lock function in HULFT Square.

  • On the settings screen for the script variables, if you select the Required checkbox for Use as script input variable and execute a script, an error may not occur even if you don't set a value.

9

> SERVICE EVENTS > HULFT Transfer

The maximum number of displayed logs is 500. The page transition doesn't work, and 500 logs are displayed in one page.

(2023/9/27)

Closed2023.2.1 (2023/6/18–)

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

> DATA INTEGRATION > Projects

When you create a new project, the Edit project name dialog isn't displayed even if you click Finish.

(2023/6/18)

2

> DATA INTEGRATION > Connections

> DATA INTEGRATION > Variables

> DATA INTEGRATION > Calendars

For connection resources, variables, or calendars, when you open pages from Information in the action menu, the Information menu item in the action menus for the profile list may not be displayed, regardless of whether you have the view permission.

(2023/6/18)

3

Workspaces

The color scheme of the workspace may have changed.

(2023/6/18)

Closed2023.2 hotfix (2023/6/8–)

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

Storage access (general)

Depending on the state of the network, an exception (io.vertx.core.http.HttpClosedException) may occur when performing general storage access and script execution tasks such as those below.

  • Operating the storage service screen

  • Referring to project information while operating the screen

  • Acquiring project information at the beginning of script execution

  • Acquiring project information during script execution

  • Executing a script that contains a connector that accesses storage (*1)

    *1

    :

    Applicable connectors

    • Basic

      Assertion - Compare File

    • File

      CSV, Excel, Excel(POI), XML, Fixed-Length, Variable-Length

    • File Operation

      Filesystem

    • Network

      FTP

    • Cloud

      Amazon S3, Azure BLOB Storage, Google BigQuery, Google Cloud Storage, Google Drive, Google Sheets, BOX, SharePoint

    • Cryptography

      PGP

(2023/6/8)

Closed2023.2 (2023/5/28–)

Functions with "Experimental" sign

These are trial functions to test usability. At present, proper verification of quality and usability haven't been performed yet. Therefore, the UI and UX may change significantly in future releases. We hope you will use them and provide feedback to our support desk.

New features

Single sign-on

Single sign-on of Microsoft Active Directory is supported.

You can simply log in to HULFT Square with the domain credentials you currently use.

To use this function, you need to set the permissions from the policy.

For details about usage, refer to Single Sign-on and the tutorials described there.

Dashboard

The widget for total amount of transferred data was officially released.

The contents of your contract are now displayed.

In addition, the following widgets were added:

  • Daily quantity of allocated memory (Integrate services)

  • Daily number of vCPU (Integrate services)

  • Daily number of created VPC endpoints (Experimental)

Audit logs

The records of accessing REST API jobs can now be displayed as logs.

You can download the logs of the past 30 days all at once.

To use this function, you need to set the permissions from the policy.

Asynchronous execution of REST API jobs

REST API jobs now support asynchronous execution.

With this, you can avoid the timeout problem that jobs with long execution times have.

For details about usage, refer to When you want to execute REST API jobs asynchronously in the tutorial Execute a script using an HTTP REST request.

GDPR/CPRA support

You will now be explicitly asked to agree to the privacy policy when you begin using HULFT Square.

In addition, the date of agreement is recorded and you can check it from My Profile.

Improved the handling of the deleted workspaces

Users who have the WorkspaceAdminAccess permission can now display deleted workspaces.

Memory management

Memory management has been improved when newly creating HULFT Integrate services.

Existing HULFT Integrate services aren't affected. To apply this memory management improvement, you need to recreate the HULFT Integrate service.

Additionally, a menu item to restart HULFT Integrate services was added.

Connectors

The following connectors were updated:

  • Sharepoint connector

  • Box connector

  • REST connector

  • Excel connector

  • Excel POI connector

  • FTP connector

Experimental functions included in this release

*Refer to Functions with "Experimental" sign.

Dashboard

The information on the dashboard about VPC endpoints is displayed for reference only.

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

Login screen

When your password expires, even if you reset your password from "Forgot your password?" on the login screen, it stays expired, and you can't log in.

2

> SERVICES > HULFT Transfer Service

On the registration screen for the HULFT Transfer service, you can't change or update the description.

3

> DATA INTEGRATION > Data Formats

After you create and add a data format resource in Designer, if you edit a Variable-length connector or a Fixed-length connector in Data Formats, the format may be deleted.

4

> DATA INTEGRATION > Calendars

You can't change a date you set as a non-business day back to a business day.

5

> API MANAGEMENT > API Projects

  • Sorting by owner may not work as expected.

  • You may not be able to delete the resources for an API project.

6

> JOBS > REST API Jobs

When multi-byte characters are included in the request body sent to a REST API endpoint, the response may be garbled or fail.

7

> JOBS > Schedule Jobs

A scheduled job set for 0:00 may be executed one more time at 0:00 on the day after the end date.

This occurs when all of the following conditions are satisfied:

  • "Time" is set as "0:00".

  • "Recurrence" is set as either "Day", "Week", "Month", or "Year".

  • The day after the "End date" satisfies the execution conditions other than "End date" (example: the job is set to execute every Saturday, and the day after the end date is a Saturday).

8

> SERVICE EVENTS > HULFT Transfer

The sorting function doesn't work.

9

> JOB EVENTS

When you open the details of a log for an error that occurred in a job event, it may transition to the top page.

10

> JOB EVENTS > HULFT Transfer Jobs

When you update a job, an error may occur.

Even if an error occurs, an update may be successful.

11

Support > Support Center

When you open Support Center, the error "Authentication header must be set" may occur.

12

> USER MANAGEMENT > Users

When you invite a user, if no operations are performed for three minutes, an error may occur.

13

> VPC Endpoint

When you open VPC Endpoint in the navigation menu, "Something went wrong." may be displayed.

14

> API Token Expiration

Even if you set the expiration date of a refresh token to be longer than 30 days, the expiration date of the refresh token may be up to only 30 days. If it expires, the display is the same as if the access token isn't yet generated.

15

Workspaces

  • Even if users with only the read permission attempt to use workspaces that they don't have enough permissions for, they may be able to use the workspaces without errors.

  • If you delete a workspace, the resources linked to the corresponding workspace will no longer be displayed on the screen. The resources themselves will remain.

    To delete a workspace, delete related resources first.

16

Designer

  • If you create multiple folders in a project and put scripts with the same name in them, they can't be differentiated when you execute jobs or scripts. Don't use the same script name multiple times in a project.

  • After you create a script that uses a connection resource, if you delete that connection resource and open the script again, the connection resource that was supposed to be deleted may be displayed as GUID instead of its specified name.

  • If you change the project name, scripts may not be able to be executed.

  • Even if you set argument values for test execution from the script properties, they may not be reflected during test execution.

  • When you run debugging, the results shown in the log may differ from the actual processing time.

  • If you use the history to edit and save a script that was previously deleted, an error may occur.

  • If changes to a script in Designer are saved locally, if you reopen the local save data, an error may occur.

  • For Google BigQuery connection, if you set an invalid value for Service account authentication key, you may not be able to set Google BigQuery operations on Designer.

Closed2023.1.1 (2023/2/26–)

New features

Connectors

The following connector was updated:

  • Salesforce connector (*1)

*1

:

Batch operations were officially released in the 2023.1.1 release. (2023/2/26)

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

Login screen

When you reset your password from "Forgot your password?", the password policy may not be applied.

(2023/2/26)

2

> Workspaces

For workspace creation, if you create a workspace with an administrator (admin) in the group, an error may occur.

(2023/2/26)

3

> Password Policy

Even if you change the password policy, you may not be able to apply it.

(2023/2/26)

4

Designer

  • When you debug a script, the message that should be output to the execution log may not be output.

  • You can't rearrange script names in the project explorer.

(2023/2/26)

5

File Operation connector

For the File Operation connector, a timeout of 350 seconds is set according to specifications. For operations where the processing takes a long time such as copying of large files, a timeout may occur, and the script may fail.

(2023/2/26)

6

Call Script

If you run Call Script recursively, ScriptNotFoundException may occur.

(2023/2/26)

Closed2023.1 hotfix2 (2023/1/29–)

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

> SERVICE EVENTS > HULFT Transfer Service

The HULFT Transfer service for monitoring is hidden.

You can check the results of transfer processing for HULFT Transfer in the APP EVENTS menu.

(2023/1/29)

2

Designer

For operations for Google Sheets and Google Drive, the list of connection settings may not be displayed at the destination.

(2023/1/29)

Closed2023.1 hotfix (2023/1/18–)

Fixed issues

The following issues were fixed.

 

Category

Fixed issues

1

> SERVICES > HULFT Integrate Service

When you delete a file in storage from a job or script, an error may occur. Even if an error occurs, deletion of the file is performed correctly.

After the fixes are applied, the error no longer occurs. If a job or script is still running from before the fixes were released, the fixes are automatically applied after it finishes.

(2023/1/18)

Closed2023.1 (2023/1/15–)

Functions with "Experimental" sign

These are trial functions to test usability. At present, proper verification of quality and usability haven't been performed yet. Therefore, the UI and UX may change significantly in future releases. We hope you will use them and provide feedback to our support desk.

New features

Overall Summary

In HULFT Square, you can connect to various data sources such as databases and cloud services and to the HULFT system, and you can handle the relevant data and files.

When data processing is required, you can create a script by arranging and linking process icons without writing program code.

Register the completed script as a job. Various triggers are available, such as executing it repeatedly at planned dates and times, executing it when specific files are updated, or calling with HTTP REST.

Welcome to the world of data integration services.

Workspaces

By using workspaces, you can share settings such as for projects, storage, and resources with members in an organization to work together more efficiently.

The administrator can set members for workspaces and access permissions to separate each workspace safely and logically. Additionally, users can filter workspaces to display only the workspaces that they themselves have access rights to, in order to focus on their own work.

Projects

The scripts you create are managed in units known as projects.

To create a script, first create a project.

Profile

By preparing profiles such as for the production environment and for development, you can switch connection resources without changing the created script.

Calendars

If you set company holidays, you can configure settings such as to not execute jobs on those days.

API Management

Link scripts created in API projects and HTTP methods.

On the API client, set the users and IP addresses that can access the API.

Jobs

Set the triggers to run a script you created in Designer.

You can run scripts based on the triggers of file events such as file creation, setting of a schedule, and receipt of a file from the HULFT system.

Additionally, you can configure the responses for HTTP REST requests and other such settings from here.

Monitoring

You can check the amount of data and amount of communication used by the service, the records of running of jobs, and so on.

  • Dashboard

    • Daily maximum Storage usage

    • Total amount of transferred data (Experimental)

  • Application (What project/script was run or sent/received, when, and by whom are displayed. You can check the execution results for REST API jobs from here)

    • HULFT Integrate

    • HULFT Transfer

  • Job (What job was executed, when, and by whom are displayed)

    • File event job

    • Scheduled job

    • HULFT Transfer job

User management

In HULFT Square, an administrator manages users in groups and manages the permissions of the users by applying policies to the groups they belong to.

VPC endpoint

Create and manage VPC endpoints for HULFT Square.

MFA

Multifactor authentication settings are available.

MFA increases the security level to help prevent unauthorised access by third parties.

Subscription Info

You can check the service plan that you have a contract for.

You can check the contract number, contract start date, contract end date, domain name, resources, add-on services, connectors, and so on.

Connectors

The following connectors are available:

  • Amazon Aurora for MySQL connector

  • Amazon DynamoDB connector

  • Amazon EC2 connector

  • Amazon RDS connector

    • Amazon RDS for MySQL connector

    • Amazon RDS for Oracle connector

    • Amazon RDS for PostgreSQL connector

    • Amazon RDS for SQL Server connector

  • Amazon RedShift connector

  • Amazon S3 connector

  • Amazon SQS connector

  • AWS Lambda connector

  • Azure BLOB Storage connector

  • Azure CosmosDB connector

  • Azure HDInsight connector

  • Azure Queue Storage connector

  • Azure SQL Database connector

  • BOX connector

  • CSV connector

  • DB2 connector

  • Dynamics 365 for Customer Engagement connector

  • Excel connector

  • Excel POI connector

  • FTP connector

  • Gmail connector

  • Google BigQuery connector

  • Google Cloud Storage connector

  • Google Drive connector

  • Google Sheets connector

  • Google Workspace connector

  • HULFT connector

  • JDBC connector

  • kintone connector

  • Mail connector

  • MySQL connector

  • Oracle connector

  • PGP connector

  • PostgreSQL connector

  • REST connector

  • Salesforce connector

  • ServiceNow connector

  • Slack connector

  • SnowFlake connector

  • SQL Server connector

  • XML connector

  • Event notification connector

  • Fixed-length connector

  • Variable-length connector

Related Services

Status Site

We have posted a status site (https://status.square.hulft.com/).

View this site to check at a glance the operational status of core services for HULFT Square that would have an impact on work.

You can also view the history of incidents that occurred.

Technical Documents

We have posted technical documents (https://www.hulft.com/help/en-us/HULFTSquare/).

Check these for descriptions of functions and descriptions of procedures.

Experimental functions included in this release

*Refer to Functions with "Experimental" sign.

Bulk operation of the new Salesforce connector (Experimental)

Among the operations of the Salesforce connector, the following operations are experimental:

  • Bulk Read Records

  • Bulk Read Records (Child-to-parent relationship)

  • Bulk Insert Records

  • Bulk Update Records

  • Bulk Upsert Records

  • Bulk Delete Records

Metering Service (Experimental)

The amount of network use on the dashboard is a rough estimate.