@kellogh@hachyderm.io
@kellogh@hachyderm.io avatar

kellogh

@kellogh@hachyderm.io

I'm a software engineer and sometimes manager. Currently #Raleigh but also #Seattle. Building ML platform for a healthcare startup. Previously, built an IoT platform for one of "those" companies.

Open source: dura, fossil, Jump-Location, Moq.AutoMock, others

Do I have other interests? No, but I do have kids and they have interests. I think that counts for something. I can braid hair and hunt unicorns!

I put the #rust in frustrate

He/Him

#metal #science #python

This profile is from a federated server and may be incomplete. Browse more on the original instance.

kellogh, to random
@kellogh@hachyderm.io avatar

the news is cool, but now i want to see an embedding model that i can use with a streaming interruptible conversation

kellogh,
@kellogh@hachyderm.io avatar

also, now with , latency is going to be critical if you’re doing streaming audio/video, so may start looking less appealing. what’s the new language? ? ? ? ?

kellogh,
@kellogh@hachyderm.io avatar

there’s a lot of unanswered questions. certainly exciting times ahead (and a new batch of epic fails)

kellogh,
@kellogh@hachyderm.io avatar

@mistersql are you starting that debate? 😂

seriously though, idk, python is not my go to low latency language. so much of the language is written without performance in mind, e.g. a for loop raises a StopIteration error to stop looping. integers use 28 bytes, etc.

kellogh,
@kellogh@hachyderm.io avatar

@dr2chase your totally right. python has an enormous ecosystem, which makes it fantastic for slinging pipelines together. however, the announcement today says that the audio responds within ~350 milliseconds. i’d say your app can add 50-100 more without changing the experience much, but python apps typically add more like 200-400 ms

imo rust might be the next contender. they’ve been building out a lot of new data science & engineering tools with it. idk

kellogh,
@kellogh@hachyderm.io avatar

@dr2chase not that you couldn’t use python, it’s just that it doesn’t have great tools for being latency conscious

kellogh, to random
@kellogh@hachyderm.io avatar

alright, is pretty cool, mainly bc it’s so gosh darn fast

kellogh, to random
@kellogh@hachyderm.io avatar

i watched a demo video of singing a song and, sure it was bad, but it was still better than Laura Trump

simon, to random
@simon@simonwillison.net avatar

My notes on this morning's OpenAI release of the new GPT-4o model - not a huge leap in "intelligence" (whatever that might mean) but still very significant thanks mainly to the impressive new audio capabilities and the drop in price - 50% cheaper via API, and should soon be available for free ChatGPT users as well https://simonwillison.net/2024/May/13/gpt-4o/

kellogh,
@kellogh@hachyderm.io avatar

@simon how do you think embeddings will fit into streaming audio & video? i can’t imagine RAG can go away, but certainly we need new embedding models, right?

kellogh, to random
@kellogh@hachyderm.io avatar

just had a conversation with my neighbor — he’s wearing an NRA tshirt and explaining that the pistol he has strapped to his hip is for shooting copperheads. And also he’s concerned that we leave our garage open too much and that copperheads might get in

kellogh,
@kellogh@hachyderm.io avatar

i’m probably just some hippy to him, but it doesn’t seem like guns are a great solution for snakes. copperheads are docile creatures, just use a turkey stick (everyone has one, right??) to nudge it off into the trees

kellogh,
@kellogh@hachyderm.io avatar

@jimfl well yeah, ofc that’s what i’m talking about. those SNAKES STOLE MY WIRING. i had to use my turkey stick to chase them away!

kellogh, to random
@kellogh@hachyderm.io avatar

i wish “type checking for infrastructure” was a thing

my code declares that there should be a S3 bucket that’s different from that other S3 bucket, etc. —> spin up the type checker, it reads APIs and verifies, “yep, this code should run fine”

kellogh,
@kellogh@hachyderm.io avatar

it seems like a lot of assumptions are lost between code & terraform & k8s, and there’s not a great framework for quickly validating

kellogh,
@kellogh@hachyderm.io avatar

@olafurw i had thought CDK was more of a terraform equivalent, am i wrong? e.g. for creating & synchronizing infra with a code base

i’m saying “type checking” to talk about some process you could run pre-deployment to check if the code is compatible with current infrastructure. doesn’t have to be types, but similar to types it encodes your assumptions and can be automatically verified. just felt like “typechecking” was a good analogy

kellogh,
@kellogh@hachyderm.io avatar

@brianknight @olafurw got a github link?

matthew_mullins_, to random

When pg_vector dropped for Postgres I said it would be a matter of time until vector search was just a standard feature of databases. It's available in OLAP platforms like Snowflake and BigQuery, and now it's come to workhorses like Cassandra too. Data Threads

kellogh,
@kellogh@hachyderm.io avatar

@matthew_mullins_ it’s still not as standard as i thought it would be

ErikJonker, to ai
@ErikJonker@mastodon.social avatar

Somehow the relevance of this research using LLM, AI to train robots is not fully appreciated i think. If we can train robots in simulated worlds and that learning can be applied in real world applications, it seems that learning for Robots has no problems with regard to enough trainingdata or am i missing something ? Also this could really accelerate the applications for all kind of tasks.
https://eureka-research.github.io/dr-eureka/

kellogh,
@kellogh@hachyderm.io avatar

@ErikJonker i don’t think it’s a full answer, but it certainly helps. it probably needs extra fine tuning help from humans

kellogh, to ai
@kellogh@hachyderm.io avatar

a crazy development over the last couple years is the revival of computer architecture

for most of my career, CPUs and GPUs just worked, and while there were some wild ideas, the problems hadn’t yet emerged

with , we’ve moved so far from the low level, that the existing chips aren’t working all that well anymore. I’d argue that computer architecture is now a skill needed for AI engineers these days

kellogh, to random
@kellogh@hachyderm.io avatar

sperm whales have a complex language! they use complex patterns of clicks to communicate

it turns out that the hardest part of the search for intelligent life is recognizing what you’re looking at

https://www.npr.org/2024/05/07/1249546255/sperm-whale-communication-ai-language

kellogh,
@kellogh@hachyderm.io avatar

@jimfl i bet it was an FFT

meganL, to random
@meganL@mas.to avatar

Community participation:

What are your favorite non-monopoly places to shop online? Bonus if they're actually also really cool businesses?

Help folks discover non-Amazon, non-Walmart stores!

Ones I use include:

American Science & Surplus: https://sciplus.com/

Stonemountain & Daughter https://stonemountainfabric.com/

Davis Food Co-op (not mail order, but you can still do "curbside" pick-up) https://davisfood.coop/

kellogh,
@kellogh@hachyderm.io avatar

@WuMargaret @meganL i tried other brands of barefoot shoes years ago, and my general takeaway was that they’re a great way to mess up your feet and calves. i’m sure you can do it safely, but it’s not intuitive and there’s a whole ton of ways to seriously hurt yourself

kellogh, to random
@kellogh@hachyderm.io avatar

the kids are arguing

8yo: yes! honeybees sting!

3yo: no they don’t! when honeybees come over they say hi

kellogh,
@kellogh@hachyderm.io avatar

@amyedge she must have gotten it from somewhere, not sure where though

kellogh,
@kellogh@hachyderm.io avatar

@amyedge lol, apparently it’s something my wife says

kellogh, to llm
@kellogh@hachyderm.io avatar

there’s a big need for something stronger than , but more flexible and cheaper than a giant all-knowing .

A great part about RAG is that it’s just a database. You just issue INSERT/UPDATE and yeah, that’s how you maintain knowledge. No million dollar training process

kellogh,
@kellogh@hachyderm.io avatar

@chromosundrift i suppose it doesn’t, but it’s very hard to imagine it without it. seems like at some point you need precision

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • JUstTest
  • kavyap
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • tacticalgear
  • cubers
  • Youngstown
  • mdbf
  • slotface
  • rosin
  • osvaldo12
  • ngwrru68w68
  • GTA5RPClips
  • provamag3
  • InstantRegret
  • everett
  • Durango
  • cisconetworking
  • khanakhh
  • ethstaker
  • tester
  • anitta
  • Leos
  • normalnudes
  • modclub
  • megavids
  • lostlight
  • All magazines
    •