Michal :verified: on Nostr: Any recommendations for #Prometheus long term metric storage? I tweaked Prometheus to ...
Any recommendations for #Prometheus long term metric storage?
I tweaked Prometheus to store a year's worth of data, but one unclean shutdown and I've got a corrupt WAL block, which it doesn't handle well (needs 20GiB RAM at startup).
There are many options (#OpenTSDB, #Graphite, #InfluxDB, ...), any reasonable low-maintenance / low-resource storage which I could write from Prometheus and show in #Grafana dashboards?
Published at
2024-03-03 19:54:44Event JSON
{
"id": "afe854ec6679d032d0e87bf4bc20c63cbf99cc78553d13466c7245b7d945a74e",
"pubkey": "121576905b15c4f5ca6a13b623f817dabd713afbc390ff6750963620fc26a1e6",
"created_at": 1709495684,
"kind": 1,
"tags": [
[
"t",
"prometheus"
],
[
"t",
"opentsdb"
],
[
"t",
"graphite"
],
[
"t",
"influxdb"
],
[
"t",
"grafana"
],
[
"proxy",
"https://toot.kottman.xyz/users/michal/statuses/112033509181329713",
"activitypub"
]
],
"content": "Any recommendations for #Prometheus long term metric storage?\n\nI tweaked Prometheus to store a year's worth of data, but one unclean shutdown and I've got a corrupt WAL block, which it doesn't handle well (needs 20GiB RAM at startup).\n\nThere are many options (#OpenTSDB, #Graphite, #InfluxDB, ...), any reasonable low-maintenance / low-resource storage which I could write from Prometheus and show in #Grafana dashboards?",
"sig": "e4c1a87fa23cc9ffa579fdadce64f6b81266387f3c56fd33de64593a3d61db54122c3258637c58c02cb19de27cf34cd875b05a03e112bd5d417d80dc7447f147"
}