@bocytko@hachyderm.io avatar

bocytko

@bocytko@hachyderm.io

Principal Engineer.
#sre #leadership

This profile is from a federated server and may be incomplete. Browse more on the original instance.

paigerduty, to random
@paigerduty@hachyderm.io avatar

when you hear the term "monitoring debt" what comes to mind?

#monitoring #observability #o11y #prometheus #OpenTelemetry #sre

bocytko,
@bocytko@hachyderm.io avatar

@paigerduty 1) lots of alert definitions which once set up are forgotten or ignored; data series captured, written, but never looked at.

  1. manual instrumentation code that's unnecessary as automation caught up or that was not properly adjusted during refactoring.
ifthenelse, to devops
@ifthenelse@hachyderm.io avatar

When I talk to other techies, it's so disturbing how regularly they get paged. They have to sleep on the couch when on-call, figure out how not to scare their children with the sound of PagerDuty, and not be able to go shopping without fear of being paged.
Companies, please fix this, for God's sake!

bocytko,
@bocytko@hachyderm.io avatar

@jimfl @ifthenelse follow-the-sun turns an exception (page) to a full time service. This creates incentives for even more pages. See https://lethain.com/dont-follow-the-sun/ for more context from @lethain

simon, to random
@simon@simonwillison.net avatar

Nasty example here of a prompt injection data exfiltration attack against writer.com - made much worse by Writer's response to the responsible disclosure of the vulnerability that "We do not consider this to be a security issue since the real customer accounts do not have access to any website."

https://promptarmor.substack.com/p/data-exfiltration-from-writercom

I wrote more notes on this here: https://simonwillison.net/2023/Dec/15/writercom-indirect-prompt-injection/

bocytko,
@bocytko@hachyderm.io avatar

@simon ... how does one screen vendors to filter out companies that don't have the right mindset?

thekiwisre, to random

This week on Slight Reliability @paigerduty is back! This time we dive into sampling of distributed traces. We cover...

๐Ÿ•ธ๏ธ What is distributed tracing? What are spans?
๐Ÿงช What is sampling? And why do we need it?
๐Ÿคฏ What constitutes an interesting trace?
๐Ÿฆ˜ No sampling VS head based VS tail based
๐Ÿ‘ฉ๐Ÿพโ€๐Ÿ”ฌ Non-traditional use cases of tracing such as CI/CD
๐Ÿงป The power of napkin math to make informed decisions
...and much more.

https://www.youtube.com/watch?v=GYwjeE9reb8

bocytko,
@bocytko@hachyderm.io avatar

@thekiwisre @paigerduty https://heinrichhartmann.com/sampling/ is a nice sampling error calculator showing impact of sampling traces.

simon, to random
@simon@simonwillison.net avatar

At OpenAI DevDay, a ton of new stuff:

  • gpt-4-turbo (128,000 tokens, faster, cheaper)
  • Ability to pass a seed and get repeatable outputs (maybe we can finally write some automated tests!)
  • Can actually produce valid JSON now - plus call multiple functions in one response
  • Text to speech API (6 voices)
  • Whisper v3 (open model release)
  • Fine tuning for gpt-3.5-turbo 16k (and preview access for GPT-4)
bocytko,
@bocytko@hachyderm.io avatar

@simon Assistant API is an easy way to productize what was already possible through tuning of system message and choosing a set of plugins?

bocytko,
@bocytko@hachyderm.io avatar

@simon nice. It makes a bunch of the orchestration code needed before completely obsolete.

simon, to random
@simon@simonwillison.net avatar

Just stumbled across https://github.com/pypi-diff via a GitHub code search for a keyword in one of my projects

"Daily generated diffs for pypi package releases"

How could that possibly fit in a repo on GitHub? They have a soft limit of around 1-5GB per repo...

Turns out pypi-diff creates a brand new repo for each day to store the diffs from that day!

Looks like it's been running since April - I wonder how long it can keep going like this https://abbbi.github.io/pypidiff/

bocytko,
@bocytko@hachyderm.io avatar

@simon diffs linked to release notes or concise feature descriptions can be great training data for LLMs focused on coding/refactoring.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • โ€ข
  • provamag3
  • kavyap
  • DreamBathrooms
  • Durango
  • magazineikmin
  • InstantRegret
  • ngwrru68w68
  • Youngstown
  • everett
  • slotface
  • tacticalgear
  • cisconetworking
  • khanakhh
  • rosin
  • megavids
  • thenastyranch
  • vwfavf
  • osvaldo12
  • mdbf
  • modclub
  • GTA5RPClips
  • Leos
  • normalnudes
  • cubers
  • ethstaker
  • tester
  • anitta
  • JUstTest
  • All magazines