Scheduled exporting enables exporting of historical data and forecasts to the local file system in CSV or Excel formats, as well as delivery of produced reports to email subscribers.
Scheduled Exporting Settings
Scheduled exporting may be controlled via
cron expression. See Scheduling for example and instructions about scheduling export jobs.
Concurrent execution for the same job is not allowed.
Export job settings in the server.properties file:
export.worker.count (default = 8)– number of export jobs that can be executed at the same time
export.worker.queue (default = 8)– number of export jobs that can be queued for execution
If new jobs are added for executing when the queue is full, such jobs are rejected.
Export Job Logging
Each export job execution is logged in ATSD. Messages are saved to track the status. Below are their parameters.
The administrator can create rules to be informed if jobs are not executed according to schedule.
|Status||Severity||Name||Message||Start Time||End Time|
|on job start|| || || || || |
|on job complete|| || || || || |
|on job queued|| || || || || |
|on job blocked *|| || || || || |
|on job rejected|| || || || || |
|on job failed|| || || || || |
- Raised when the job starts while the previous instance of the same job is still running.
|Name||Export job name.|
|Data Type||Type of data exported.|
Possible values: history, forecast.
|Metric||Metric name for which data is exported. Data can be exported for one metric at a time.|
|Entity||If selected, exported data is limited to the specified entity. Supersedes the Entity Group selector.|
|Entity Group||If selected, exported data is limited to entities contained in the specified entity group. Supersedes Entity Expression field.|
|Entity Expression||An expression to filter selected data by entity name and entity tags. For example: |
|Value Filter||Expression to fetch only detailed samples that satisfy a condition. For example, |
|Selection Interval||Time frame of exported data. End of the Selection Interval can be optionally specified in End Time field. By default End Time is set to current time. Selection Interval setting is ignored if both Start Time and End Time fields are set.|
|Start Time||Start time of the selection interval. This field supports calendar keywords, for example 'previous_day'. If not defined, Start Time is calculated as End Time minus Selection Interval.|
|End Time||End time of the selection interval. This field supports calendar keywords, for example 'next_day'. If not defined, End Time is calculated as Start Time plus Selection Interval. If Start Time is not defined, End Time is set to current time.|
|Versioning||Display value history for metric that is enabled for Versioning. Versioning is displayed only for detailed, non-aggregated, samples.|
|Revisions Only||Filters displayed versions only for samples with values changes. Excludes samples without versions.|
|Version Filter||Expression to filter value history (versions) by version status, source, or time. For example: |
|Aggregate||Enable period aggregations based on selected detailed samples, after the optional Value Filter is applied.|
|Aggregation Period||Period of time over which detailed samples are aggregated.|
|Interpolation||Insert missing periods in aggregated results. The period is considered missing if it contains no detailed samples. Supported options: |
|Aggregate Statistics||One or multiple aggregation functions: average, minimum, maximum, sum, count, standard deviation, weighted average, weighted time average, median (percentile 50), first, last, percentile 50/75/90/95/99/99.5/99.9, |
|Format||Export file format.|
Possible values: CSV, XLSX.
|Compression||Compression of exported files.|
Possible values: none, gzip, zip.
|Output Path||Absolute path for exported files.|
Expressions can be used to create timestamped files.
This means that exported files are grouped by month and year, each in their relevant directory.
|Split by Entity||Creates a new file for each exported entity, which is useful when exporting data for multiple entities.|
If Output Path contains
If Output Path does not contain
|Annotation||Custom annotation that is added above the exported time series.|
Can include any text, characters, and numbers.
If the field is left empty, no custom annotation is added.
To include entity name, entity tags, metric names, or metric tags use the following placeholders as part of the annotation text:
|Entity Tags||List of entity tags included as columns in the exported file.|
|Metric Tags||List of metric tags included as columns in the exported file.|
|Decimal Precision||Number of fractional digits displayed. If a negative value such as -1 is specified, stored numbers are displayed 'as is' without any formatting.|
|Time Format||Format for displaying series sample timestamps: Local Time (server time zone) or ISO (UTC time).|
|Email Subscribers||List of email addresses separated by commas, white spaces, or semicolons, to which the exported files are sent as attachments.|
|Email Subject||Email subject.|
Clicking Test exports the first file, displays the file name, and provides a link to download the file.