Mimir 3.0 Unveiled: Ingest Storage, Query Engine, and a Whole Lot Less Cost

Grafana Grafana

3,740
10 tháng trước
Mimir 3.0 is coming—and it’s faster, more cost effective, and more reliable. Learn how ingest storage and a new streaming query engine make Mimir more scalable and cost-efficient than ever. Get ready for fewer errors and better performance.

Chapters:

00:00 – Welcome + Goals of Mimir 3: Reliability, performance, cost
01:20 – Mimir 2 architecture: How writes and reads flow through ingesters
03:00 – Challenges in Mimir 2: Overloaded ingesters and multi-zone fragility
05:03 – Introducing ingest storage: Kafka-powered decoupling of reads/writes
07:20 – Write path reimagined: How Kafka changes durability and latency
09:01 – Read path in Mimir 3: Complete data from one ingester per partition
10:52 – Improved availability: Lower outage risk with fewer ingesters
11:50 – Real-world results: Cost savings from ingest storage
13:07 – New Mimir query engine: Streamed execution = fewer errors
14:30 – Why expensive queries no longer spike memory
15:53 – Flattening memory usage: Less waste, fewer crashes
17:50 – How Mimir 3 streams data vs. Prometheus’ in-memory method
19:39 – Benchmarks: 92% less memory, 38% faster queries
20:24 – Success rate queries and query deduplication
22:35 – Optimization framework + real cluster improvements
23:25 – Final takeaways: 3x less memory, 80% less CPU, full OSS support

Related links:

Mimir GitHub: https://github.com/grafana/mimir/releases

☁️ Grafana Cloud is the easiest way to get started with Grafana dashboards, metrics, logs, and traces. Our forever-free tier includes access to 10k metrics, 50GB logs, 50GB traces and more. Sign up: https://grafana.com/get/?src=yt&mdm=social&cnt=description

❓ Have a question that isn't related to this video? Check out the Official Grafana Community Forums: https://community.grafana.com/?src=yt&mdm=social&cnt=description

-----
👍 If you found this video useful, be sure to give it a thumbs up and subscribe to our channel for more helpful Grafana videos.

📱 Follow us for the latest and greatest on all things Grafana and our other OSS projects.

X: (https://www.twitter.com/grafana)
LinkedIn: (https://www.linkedin.com/company/grafana-labs/)
Facebook: (https://www.facebook.com/grafana)

#Grafana #Observability #Mimir