Lead Image © sidewaypics, 123RF.com
Four solutions for Prometheus long-term storage
Titans
One key difference between current IT setups and those of the past is that current setups are typically designed for scalability. Computing power, RAM, disk space – all can ideally be added or removed dynamically in a state-of-the-art setup. For ongoing operations, this results in a few challenges that administrators were unlikely to confront until the advent of OpenStack, Ceph, Kubernetes, and the like. They include, for example, the need to know when it's the right time to add additional resources. "When they are needed" is the easy answer, because that directly prompts the next questions: When exactly are new resources needed, and how do admins work around bottlenecks and delays in delivery of the new equipment?"
Trending software helps answer these questions early enough that you can plan in peace and sleep well at night. Under the hood, you will often find a time series database that collects and saves metrics data from all instances of the entire setup at regular intervals before correlating the acquired data and alerting if defined threshold values are exceeded. Right now, Prometheus is probably the most widely used of the candidates in this field.
If you want to scale or store data in the long term for analysis, four open source approaches stand out from the crowd:
- Thanos is a cluster solution with built-in long-term storage.
- Cortex makes it easy to add a genuine long-term storage engine to Prometheus.
- Mimir, on the other hand, is a Cortex fork that is now very different from its ancestor and has its own functions.
- M3DB is a converter between the worlds, combining central design elements of both Thanos and Cortex.
You therefore need to make a decision. It makes sense to answer three questions first:
- Which solution is best suited to your application?
- What are the individual strengths and weaknesses
Buy this article as PDF
(incl. VAT)
Buy ADMIN Magazine
US / Canada
UK / Australia
Related content
-
Central logging for Kubernetes users
Grafana's Loki is a good replacement candidate for the Elasticsearch, Logstash, and Kibana combination in Kubernetes environments. -
Detect anomalies in metrics data
Anomalies in an environment's metrics data are an important indicator of an attack. The Prometheus time series database automatically detects, alerts, and forecasts anomalous behavior with the Fourier and Prophet models of the Prometheus Anomaly Detector. -
Monitoring container clusters with Prometheus
In native cloud environments, classic monitoring tools reach their limits when monitoring transient objects such as containers. Prometheus closes this gap, which Kubernetes complements, thanks to its conceptual similarity, simple structure, and far-reaching automation. -
Time-series-based monitoring with Prometheus
As Prometheus gave fire to mankind, the distributed monitoring software with the same name illuminates the admin's mind in native cloud environments, offering metrics for monitored systems and applications. -
Make better use of Prometheus with Grafana, Telegraf, and Alerta
The Prometheus monitoring tool might not always look like one of the Titans, but add-ons like Alerta or Telegraf can improve its looks.