Join

Joining Series Collected with Similar Timestamps

The JOIN operation merges rows with the same timestamp, entity, and tags. Rows that have different timestamps are excluded from the results.

SELECT t1.entity, t1.datetime, t1.value, t2.value
  FROM "mpstat.cpu_busy" t1
JOIN "mpstat.cpu_idle" t2
  WHERE t1.datetime > NOW - 1 * HOUR
  AND t1.entity = 'nurswgvml006'

Results

| entity       | datetime             | t1.value | t2.value |
|--------------|----------------------|----------|----------|
| nurswgvml006 | 2016-06-18T21:49:53Z | 14.1     | 85.9     | <-- both cpu_busy and cpu_idle had samples recorded at 2016-06-18T21:49:53Z
| nurswgvml006 | 2016-06-18T21:50:09Z | 88.0     | 12.0     |
| nurswgvml006 | 2016-06-18T21:50:25Z | 8.0      | 92.0     |
| nurswgvml006 | 2016-06-18T21:50:41Z | 6.1      | 93.9     |
| nurswgvml006 | 2016-06-18T21:50:57Z | 2.0      | 98.0     |
| nurswgvml006 | 2016-06-18T21:51:13Z | 4.0      | 96.0     |

Joining Series Collected with Different Timestamps

The series have to be collected at the same time for the timestamps to be equal and therefore the rows to be joined.

SELECT t1.entity, t1.datetime, t1.value,
       t2.entity, t2.datetime, t2.value
FROM "mpstat.cpu_busy" t1
  JOIN "meminfo.memfree" t2
WHERE t1.datetime BETWEEN '2017-04-08T07:01:00Z' AND '2017-04-08T07:02:00Z'
  AND t1.entity = 'nurswgvml006'
| t1.entity    | t1.datetime          | t1.value | t2.entity    | t2.datetime          | t2.value |
|--------------|----------------------|----------|--------------|----------------------|----------|
| nurswgvml006 | 2017-04-08T07:01:27Z | 3.0      | nurswgvml006 | 2017-04-08T07:01:27Z | 70820.0  |

Adding Rows with Different Timestamps

Rows with different timestamps can be included with OUTER JOIN. Missing values are filled with NULL.

SELECT t1.entity, t1.datetime, t1.value,
       t2.entity, t2.datetime, t2.value
FROM "mpstat.cpu_busy" t1
  OUTER JOIN "meminfo.memfree" t2
WHERE t1.datetime BETWEEN '2017-04-08T07:01:00Z' AND '2017-04-08T07:02:00Z'
  AND t1.entity = 'nurswgvml006'
| t1.entity    | t1.datetime          | t1.value | t2.entity    | t2.datetime          | t2.value |
|--------------|----------------------|----------|--------------|----------------------|----------|
| nurswgvml006 | 2017-04-08T07:01:11Z | 6.1      | null         | null                 | null     |
| null         | null                 | null     | nurswgvml006 | 2017-04-08T07:01:12Z | 71276.0  |
| nurswgvml006 | 2017-04-08T07:01:27Z | 3.0      | nurswgvml006 | 2017-04-08T07:01:27Z | 70820.0  | <-- this row has the same timestamp and is present in inner JOIN
| null         | null                 | null     | nurswgvml006 | 2017-04-08T07:01:42Z | 69944.0  |
| nurswgvml006 | 2017-04-08T07:01:43Z | 2.0      | null         | null                 | null     |
| null         | null                 | null     | nurswgvml006 | 2017-04-08T07:01:57Z | 75928.0  |
| nurswgvml006 | 2017-04-08T07:01:59Z | 10.9     | null         | null                 | null     |

Regularizing Series to Fill Missing Values

The merged series can be regularized using WITH INTERPOLATE option to fill missing values at regular intervals.

SELECT t1.entity, t1.datetime, t1.value,
       t2.entity, t2.datetime, t2.value
FROM "mpstat.cpu_busy" t1
  JOIN "meminfo.memfree" t2
WHERE t1.datetime BETWEEN '2017-04-08T07:01:00Z' AND '2017-04-08T07:02:00Z'
  AND t1.entity = 'nurswgvml006'
  WITH INTERPOLATE(15 SECOND, PREVIOUS, OUTER)
| t1.entity    | t1.datetime          | t1.value | t2.entity    | t2.datetime          | t2.value |
|--------------|----------------------|----------|--------------|----------------------|----------|
| nurswgvml006 | 2017-04-08T07:01:00Z | 5.0      | nurswgvml006 | 2017-04-08T07:01:00Z | 74804.0  |
| nurswgvml006 | 2017-04-08T07:01:15Z | 6.1      | nurswgvml006 | 2017-04-08T07:01:15Z | 71276.0  |
| nurswgvml006 | 2017-04-08T07:01:30Z | 3.0      | nurswgvml006 | 2017-04-08T07:01:30Z | 70820.0  |
| nurswgvml006 | 2017-04-08T07:01:45Z | 2.0      | nurswgvml006 | 2017-04-08T07:01:45Z | 69944.0  |
| nurswgvml006 | 2017-04-08T07:02:00Z | 10.9     | nurswgvml006 | 2017-04-08T07:02:00Z | 75928.0  |

Filling Missing Values with Detailed Interpolation

SELECT t1.entity, t1.datetime, t1.value,
       t2.entity, t2.datetime, t2.value
  FROM "mpstat.cpu_busy" t1
  JOIN "meminfo.memfree" t2
WHERE t1.datetime BETWEEN '2017-04-08T07:01:00Z' AND '2017-04-08T07:02:00Z'
  AND t1.entity = 'nurswgvml006'
  WITH INTERPOLATE(DETAIL, LINEAR, OUTER)
| t1.entity    | t1.datetime          | t1.value | t2.entity    | t2.datetime          | t2.value |
|--------------|----------------------|----------|--------------|----------------------|----------|
| nurswgvml006 | 2017-04-08T07:01:11Z | 6.1      | nurswgvml006 | 2017-04-08T07:01:11Z | 71511.2  | t1
| nurswgvml006 | 2017-04-08T07:01:12Z | 5.9      | nurswgvml006 | 2017-04-08T07:01:12Z | 71276.0  | t2
| nurswgvml006 | 2017-04-08T07:01:27Z | 3.0      | nurswgvml006 | 2017-04-08T07:01:27Z | 70820.0  | t1, t2
| nurswgvml006 | 2017-04-08T07:01:42Z | 2.1      | nurswgvml006 | 2017-04-08T07:01:42Z | 69944.0  | t2
| nurswgvml006 | 2017-04-08T07:01:43Z | 2.0      | nurswgvml006 | 2017-04-08T07:01:43Z | 70342.9  | t1
| nurswgvml006 | 2017-04-08T07:01:57Z | 9.8      | nurswgvml006 | 2017-04-08T07:01:57Z | 75928.0  | t2
| nurswgvml006 | 2017-04-08T07:01:59Z | 10.9     | nurswgvml006 | 2017-04-08T07:01:59Z | 75652.8  | t1

Alternative atsd_series Syntax

  • Regular syntax:
SELECT t1.datetime, t1.entity, t1.value, t2.value, t3.value
  FROM "mpstat.cpu_system" t1
  JOIN "mpstat.cpu_user" t2
  JOIN "mpstat.cpu_iowait" t3
WHERE t1.datetime >= '2016-06-16T13:00:00Z' AND t1.datetime < '2016-06-16T13:10:00Z'
  AND t1.entity = 'nurswgvml006'
LIMIT 3
  • atsd_series syntax:
SELECT t1.datetime, t1.entity, t1.value, t2.value, t3.value
  FROM atsd_series t1
  JOIN "mpstat.cpu_user" t2
  JOIN "mpstat.cpu_iowait" t3
WHERE t1.metric = 'mpstat.cpu_system'
  AND t1.datetime >= '2016-06-16T13:00:00Z' AND t1.datetime < '2016-06-16T13:10:00Z'
  AND t1.entity = 'nurswgvml006'
LIMIT 3