DataSpider Log Settings

Refer to here for more information about Web Console edition.

DataSpider Log Settings

DataSpider Log Settings is used to configure the behavior for rotating the logs files placed under the $DATASPIDER_HOME/server/logs/<date directories>

This is administrative function and can only be performed by administrators.

DataSpider Log Settings

Compress settings

Description of items

Item name	Description	Remarks
Not compress logs	The logs are not compressed.
Compress logs	The logs beyond the period specified in [Retention period to be compressed] are compressed.	Defaults to "Compress logs".
Retention period to be compressed	Specify the number of directories which will be excluded from being archived. e.g. If "5" is specified, the logs saved from the previous day to 5 days ago are not compressed.	Defaults to 5 A valid value is a integer in the range between 0 and 2147483647. The recommended maximum number is 65535 Today is not included in the period.

The logs beyond the specified period are compressed into a zip file every 12 hours from the time the DataSpiderServer started.

Delete settings

Description of items

Item name	Description	Remarks
Not compress and delete logs	The logs and the compressed logs are not deleted.
Compress and delete logs	The logs and the compressed logs beyond the period specified in [Retention period to be deleted] are deleted.	Defaults to "Compress and delete logs".
Retention period to be deleted	Specify the number of directories which will be excluded from being removed e.g. If 5 and 5 are specified in [Retention period to be compressed] and [Retention period to be deleted] respectively, the logs saved from the previous day to 5 days ago are not compressed and the compressed logs saved from 6 days ago to 10 days ago are not deleted. The logs and the compressed logs saved before 11 days are deleted.	Defaults to 5 A valid value is a integer in the range between 0 and 2147483647. The recommended maximum number is 65535

The logs and the compressed logs beyond the specified period are deleted every 12 hours from the time the DataSpiderServer started.

Date directory that is generated when you start DataSpiderServer and in empty state (no script ever executed) will not be subject to compression.
If exceeding the number specified in [Retention period to be compressed] ,[Retention period to be deleted] it will only be deleted.

About date directory which is subject of roll-up

Formulas to calculate the directories that are going to be archived and removed are as follows:

[Compress logs][Retention period to be compressed:5 days] / [Not compress and delete logs]
  [Summary]:The logs are compressed and are not deleted.
  [Formula]:(Current date - 1) - (Retention period to be compressed)
  [Example]: Given the current date is 7/15, (7/15 - 1) - (5) = 7/9
  [Result]:The logs saved before 7/9 are compressed and are not deleted.

[Not compress logs] / [Compress and delete logs][Retention period to be deleted:5 days]
  [Summary]:The logs are not compressed and are deleted.
  [Formula]: (Current date - 1) - (Retention period to be deleted)
  [Example]: Given the current date is 7/15, (7/15 - 1) - (5) = 7/9
  [Result]:The logs and the compressed logs saved before 7/9 are deleted.

[Compress logs][Retention period to be compressed:5 days] / [Compress and delete logs][Retention period to be deleted:5 days]
  [Summary]:The logs are both compressed and deleted.
  [Formula]:(Current date - 1) - (Retention period to be compressed + Retention period to be deleted)
  [Example]: Given the current date is 7/15, (7/15 - 1) - (5 + 5) = 7/4
  [Result]:The logs saved before 7/9 are compressed and the logs and the compressed logs saved before 7/4 are deleted.