I've been shifting focus at work, from performance engineering to observability, and that means learning a whole lot. More learning in public! First up: #loki. It's a databases for logs with some interesting design decisions that make it more performant than other logs databases. Here's a video I made with my colleague, Jay Clifford, to share what we've learned, including a demo app that ties in Loki, Grafana, and Alloy: https://youtu.be/1uk8LtQqsZQ
I'm doing secondary research trying to reconcile multiple #Observability & #AIOps 'research' reports, and am having trouble corroborating this number. It seems ... optimistic?
The Zen of Python states "There should be one-- and preferably only one --obvious way to do it." OpenTelemetry is the obvious choice for traces but bad news for Pythonistas when it comes to metrics because both Prometheus and OpenTelemetry offer compelling choices. Let's look at all of the ways you can tie metrics and traces together with exemplars whether you're working with OTel metrics, Prom metrics, Prom-turned-OTel metrics, or OTel-turned-Prom metrics!
TIL how to enable the new Explore Logs app for #loki . Turns out the latest versions of Loki and #grafana don't work with it yet, so you have to specify the right versions and change a few other things in the Docker Compose config. It's so cool that this is open source and not Cloud-only.
@jchyip I worked on a large program of work once where so much telemetry was being pushed to hosted Elasticsearch in AWS that it broke AWS in that region... Or some such
One of the most difficult things about being a Developer Advocate for a company like @grafana is explaining how everything fits together. I'm (relatively) new to the company myself, having joined through an acquisition, so figuring out what everything does is something that I've had to do as well. Here's a video to help others piece together all the moving parts of the projects that make up Grafana Labs: https://youtu.be/WSW1urIXsfA #observability#reliability#opentelemetry
We recently got a wifi-enabled hot tub. Some enterprising soul had already created a HA addon to work with it, so I set about implementing #observability, #automation and #alerting.
Amongst other things, it now starts heating automatically if there's plunge pricing on #octopusenergy Agile
@ben another monitors for dips in temperature which usually means the wind has blown the spa cover open and alerts us.
I also track total energy usage with a shelly on the circuit of the spa. Which is also useful for alerting if the spa starts consuming energy when it shouldn't
We're releasing #loki 3.0 at #grafanacon today, and I have to learn the new features just like everyone! (But better, because I have to talk to people about them too…)
If anyone is going to @grafana ’s #grafanacon this week in Amsterdam, come say hi!
Tomorrow: I'll be at the "Ask the Experts" booth 16:00-17:00 for k6/Tempo/Pyroscope.
On Wednesday, I'll be there at 09:00-10:30 and then I'm leading the Unconference from 14:45-16:45. Come ready for informal discussions about #observability !
What happens when you go to a work conference (KubeCon in Paris) and then go straight from that to a hobby one (PKM Summit in Utrecht)? Well, in my case, you throw together a talk that's a mix of both of those passions. Here's me rehashing a talk I did at PKM Summit that was all about relating system observability to what it might mean to make your Personal Knowledge Management system observable too: https://youtu.be/i-uNtkre1aE
@nicole I loved this video, so inspiring and got me out of a bit of an overwhelm fug. I wonder what do you do to manage your ideas. You must have so many. Thank you for sharing