Uploading CSV Files
CSV files can be uploaded via HTTP API or manually through the user interface.
To process a CSV file you need to create a CSV parser, which splits the file into lines (rows) consisting of multiple columns and converts the lines into
| ||Parser status. If parser is disabled, uploaded CSV files referencing this parser are discarded.|
| ||Unique parser name used as identifier when uploading files.|
| ||Type of data contained in the file: time series, properties, messages.|
| ||Enable writing data both as series and as properties.|
| ||Name of column in CSV file containing the entities. For example: host or node.|
Multiple columns can be specified in the Entity Column field to concatenate their values into a composite entity name using a dash symbol
Source CSV file:
| ||Prefix added to entity names.|
| ||All data written to specific entity.|
| ||Replace entity names in the input file with their aliases from the selected Replacement Table|
| ||Process incoming data in the Rule Engine in addition to storing it in the database.|
| ||Prefix added to metric names.|
| ||Column containing metric names.|
| ||Column containing metric values.|
| ||Column containing message text.|
| ||Columns containing the Timestamp for each data sample. In some cases, depending on the CSV file, the Timestamp may be split into multiple columns. For example: Date, Time.|
If there are two columns containing the Timestamp, then they are concatenated with a dash symbol (-) in the Timestamp Pattern field.
Source CSV File:
Timestamp Pattern Setting:
| ||Pattern, Seconds (Unix Seconds), Milliseconds (Unix Milliseconds).|
| ||Predefined Timestamp formats.|
| ||Custom timestamp format, specified manually. For example: |
If there are two columns containing the Timestamp, then in they are divided with a dash (-) in the pattern.
| ||Column containing the time difference calculated from UTC.|
| ||Time zone for interpreting Timestamps.|
| ||Expression applied to row. If expression returns false, the row is discarded.|
timestamp – timestamp in milliseconds. Computed by parsing date from Time Column with specified Time Format and converted into milliseconds.
timestamp > date(
timestamp > date(
timestamp > date(
| ||Columns converted to series tags.|
| ||Predefined series tags, specified as name=value on multiple lines.|
| ||List of columns ignored in |
These columns are retained in
| ||List of column names to substitute input column headers, one mapping per line.|
| ||Header to be used if the file contains no header or to replace existing header.|
| ||Schema defines how to process cells based on their position.|
Columns contained in the CSV file that are not specified in any field in the parser are imported as metrics.
|Delimiter||Separator dividing values: comma, semicolon, or tab.|
|Line Delimiter||End-of-line symbol: EOL |
|Text Qualifier||Escape character to differentiate separator as literal value.|
|Comment Symbol||Lines starting with comment symbol such as hash |
|Padding Symbol||Symbol appended to text values until all cells in the given column have the same width.|
Applies to fixed-length formats such as
|Decimal Separator||Symbol used to mark the border between the integral and the fractional parts of a decimal numeral.|
Default value: comma.
Possible values: period, comma.
|Grouping Separator||Symbol used to group thousands within the number.|
Default value: none.
Possible values: none, period, comma, space.
|Fields Lengths||Width of columns in symbols. Padding symbols added to the end of the field to obey the fields lengths.|
For files in
|Discard NaN||NaN (Not a Number) values are discarded|
|Ignore Line Errors||If enabled, any errors while parsing the given line are ignored, including date parse errors, number parse errors, split errors, mismatch of rows, and header column counts.|
|Ignore Header Lines||Ignore Top-N lines from the file header|
select("#row=2-*").select("#col=3-*"). addSeries(). metric(cell(1, col)). entity(cell(row, 2)). tag(cell(1, 3),cell(row, 3)). timestamp(cell(row, 1));
series e:nurswgvml007 d:2015-11-15T00:00:00Z m:space_used_%=72.2 t:disk=/dev/sda series e:nurswgvml007 d:2015-11-15T00:00:00Z m:space_used_%=14.5 t:disk=/dev/sdb series e:nurswgvml001 d:2015-11-15T00:00:00Z m:space_used_%=14.4 t:disk=/dev/sda1