Skip to content
38 changes: 38 additions & 0 deletions pipeline/outputs/influxdb.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@
| `Bucket` | InfluxDB bucket name where records will be inserted. If specified, `database` is ignored and v2 of API is used. | _none_ |
| `Org` | InfluxDB organization name where the bucket is (v2 only). | `fluent` |
| `Sequence_Tag` | The name of the tag whose value is incremented for the consecutive simultaneous events. | `_seq` |
| `Strip_Prefix` | String to be stripped from the front of `tag` when writing influxdb measurement names. | _none_ |

Check warning on line 17 in pipeline/outputs/influxdb.md

View workflow job for this annotation

GitHub Actions / runner / vale

[vale] reported by reviewdog 🐶 [FluentBit.Spelling] Spelling check: 'influxdb'? Raw Output: {"message": "[FluentBit.Spelling] Spelling check: 'influxdb'?", "location": {"path": "pipeline/outputs/influxdb.md", "range": {"start": {"line": 17, "column": 79}}}, "severity": "INFO"}
Comment thread
esmerel marked this conversation as resolved.
Outdated
| `HTTP_User` | Optional username for HTTP Basic Authentication. | _none_ |
| `HTTP_Passwd` | Password for user defined in `HTTP_User`. | _none_ |
| `HTTP_Token` | Authentication token used with InfluxDB v2. If specified, both `HTTP_User` and `HTTP_Passwd` are ignored. | _none_ |
Expand Down Expand Up @@ -191,6 +192,43 @@
{% endtab %}
{% endtabs %}

### Prefix stripping

When collecting data from many inputs into many buckets, it can be helpful to remove a common prefix using `Strip_prefix`.

```python
Comment thread
ueli-g marked this conversation as resolved.
Outdated
[INPUT]
Name cpu
Tag cpu.one

[INPUT]
Name cpu
Tag cpu.two

[INPUT]
Name cpu
Tag gpu.one

[INPUT]
Name cpu
Tag gpu.two

[OUTPUT]
Name influxdb
Match cpu*
Bucket cpubucket
Strip_prefix cpu.

[OUTPUT]
Name influxdb
Match gpu*
Bucket gpubucket
Strip_prefix gpu.
```
Comment thread
eschabell marked this conversation as resolved.

This will result in the buckets `cpubucket` and `gpubucket` each containing two measurement streams named `one` and `two`. Without prefix stripping, the measurement names would be `cpu.one` and `cpu.two (stored in `cpubucket`), and `gpu.one`, `gpu.two` (stored in `gpubucket`).

Check warning on line 229 in pipeline/outputs/influxdb.md

View workflow job for this annotation

GitHub Actions / runner / vale

[vale] reported by reviewdog 🐶 [FluentBit.Spelling] Spelling check: 'cpubucket'? Raw Output: {"message": "[FluentBit.Spelling] Spelling check: 'cpubucket'?", "location": {"path": "pipeline/outputs/influxdb.md", "range": {"start": {"line": 229, "column": 34}}}, "severity": "INFO"}
Comment thread
esmerel marked this conversation as resolved.
Outdated


### Testing

Before starting Fluent Bit, ensure the target database exists on InfluxDB. Using the previous example, insert the data into a `fluentbit` database.
Expand Down