MQTT 2 InfluxDB
Subscribe to MQTT topics and push them to InfluxDB 1.x or v2
Something like Telegraf for MQTT like it does with inputs.mqtt_consumer and output.influxdb. Telegraf has its downsides which sparked the creation of this tool.
Features
- Telegraf uses a lot of resources. This tool is easily able to run on a Raspberry Pi 1 without any problems.
- Telegraf publishes retained messages on startup. Retained messages have happened at some point in time. Time series databases are made for exact times, not some undefined times. This tool only pushes values to InfluxDB when the time is known (right when they are published/received).
- Telegraf uses a loop every n seconds which gets the timing of MQTT messages wrong. This tool handles MQTT messages exactly when they arrive (and buffers them for better performance).
- Some devices use values like
trueoronwhich are annoying to visualize. This tool migrates values like this into1.0and0.0. - Telegraf publishes the values with a
topictag. This is fine but results in a lot of regular expressions in Grafana. This tool also sets the tagstopic1,topic2, … and from the end withtopic-1,topic-2, … (negative numbers). For example for topicfoo/bar/testthis results in the following tags:topic1=foo,topic2=bar,topic3=testand from the endtopic-1=test,topic-2=barandtopic-3=foo. Creating queries with them is way easier and probably also faster to compute for InfluxDB.
Usage
Command Line Arguments
mqtt2influxdb 0.1.0
EdJoPaTo
Subscribe to MQTT topics and push them to InfluxDB 1.x or v2
USAGE:
mqtt2influxdb [OPTIONS] <--influx-org |--influx-database > [TOPIC]...
ARGS:
...
MQTT topics to subscribe
[env: MQTT_TOPICS=]
[default: #]
OPTIONS:
--buffer-amount
Send the buffer when the amount of messages is reached (or the time)
[default: 1000]
--buffer-seconds
Send the buffer when the timeout in seconds has reached (or the amount)
[default: 28.2]
-h, --help
Print help information
--influx-bucket
InfluxDB v2 bucket to put the values in
[env: INFLUX_BUCKET=]
[default: mqtt]
--influx-database
InfluxDB 1.x database to put the value in
[env: INFLUX_DATABASE=]
--influx-host
HTTP address of InfluxDB
[env: INFLUX_HOST=]
[default: http://localhost:8086/]
--influx-org
InfluxDB v2 organization
[env: INFLUX_ORG=]
--influx-token
InfluxDB api token with write access
[env: INFLUX_TOKEN]
--mqtt-broker
Host on which the MQTT Broker is running
[env: MQTT_BROKER=]
[default: localhost]
--mqtt-password
Password to access the MQTT broker. Passing the password via command line is
insecure as the password can be read from the history!
[env: MQTT_PASSWORD]
--mqtt-port
Port on which the MQTT Broker is running
[env: MQTT_PORT=]
[default: 1883]
--mqtt-user
Username to access the MQTT broker. Anonymous access when not supplied.
[env: MQTT_USERNAME=]
-v, --verbose
Show more details
-V, --version
Print version information
48 Dec 27, 2022
12 Dec 27, 2022
29 Dec 16, 2022
2 Dec 15, 2022
201 Dec 2, 2022
4 Nov 29, 2022
341 Feb 6, 2023
462 Mar 6, 2023
0 Nov 14, 2021
121 Dec 20, 2022
2 Apr 27, 2022
1.3k Dec 30, 2022
7 Oct 3, 2022
11 Oct 17, 2022
32 Oct 6, 2023
1.6k Jan 7, 2023
7.1k Jan 8, 2023
409 Oct 23, 2022
24 Dec 1, 2022