@kellogh@hachyderm.io
@kellogh@hachyderm.io avatar

kellogh

@kellogh@hachyderm.io

I'm a software engineer and sometimes manager. Currently #Raleigh but also #Seattle. Building ML platform for a healthcare startup. Previously, built an IoT platform for one of "those" companies.

Open source: dura, fossil, Jump-Location, Moq.AutoMock, others

Do I have other interests? No, but I do have kids and they have interests. I think that counts for something. I can braid hair and hunt unicorns!

I put the #rust in frustrate

He/Him

#metal #science #python

This profile is from a federated server and may be incomplete. Browse more on the original instance.

kellogh, to random
@kellogh@hachyderm.io avatar

just had a conversation with my neighbor — he’s wearing an NRA tshirt and explaining that the pistol he has strapped to his hip is for shooting copperheads. And also he’s concerned that we leave our garage open too much and that copperheads might get in

kellogh,
@kellogh@hachyderm.io avatar

i’m probably just some hippy to him, but it doesn’t seem like guns are a great solution for snakes. copperheads are docile creatures, just use a turkey stick (everyone has one, right??) to nudge it off into the trees

kellogh,
@kellogh@hachyderm.io avatar

@jimfl well yeah, ofc that’s what i’m talking about. those SNAKES STOLE MY WIRING. i had to use my turkey stick to chase them away!

kellogh, to random
@kellogh@hachyderm.io avatar

i wish “type checking for infrastructure” was a thing

my code declares that there should be a S3 bucket that’s different from that other S3 bucket, etc. —> spin up the type checker, it reads APIs and verifies, “yep, this code should run fine”

kellogh,
@kellogh@hachyderm.io avatar

it seems like a lot of assumptions are lost between code & terraform & k8s, and there’s not a great framework for quickly validating

kellogh,
@kellogh@hachyderm.io avatar

@olafurw i had thought CDK was more of a terraform equivalent, am i wrong? e.g. for creating & synchronizing infra with a code base

i’m saying “type checking” to talk about some process you could run pre-deployment to check if the code is compatible with current infrastructure. doesn’t have to be types, but similar to types it encodes your assumptions and can be automatically verified. just felt like “typechecking” was a good analogy

kellogh,
@kellogh@hachyderm.io avatar

@brianknight @olafurw got a github link?

ErikJonker, to ai
@ErikJonker@mastodon.social avatar

Somehow the relevance of this research using LLM, AI to train robots is not fully appreciated i think. If we can train robots in simulated worlds and that learning can be applied in real world applications, it seems that learning for Robots has no problems with regard to enough trainingdata or am i missing something ? Also this could really accelerate the applications for all kind of tasks.
https://eureka-research.github.io/dr-eureka/
#AI #Robots #DrEureka #LLM

kellogh,
@kellogh@hachyderm.io avatar

@ErikJonker i don’t think it’s a full answer, but it certainly helps. it probably needs extra fine tuning help from humans

kellogh, to llm
@kellogh@hachyderm.io avatar

there’s a big need for something stronger than , but more flexible and cheaper than a giant all-knowing .

A great part about RAG is that it’s just a database. You just issue INSERT/UPDATE and yeah, that’s how you maintain knowledge. No million dollar training process

kellogh,
@kellogh@hachyderm.io avatar

i just had a case where perplexity (gpt-3.5 + whole internet RAG) failed miserably but gpt-4 did great.

i’m imagining it would be somehow where the embedding + lookup is somehow tightly integrated into the model itself, not just text.

kellogh,
@kellogh@hachyderm.io avatar

it’s one of those things that OpenAI probably won’t do because it doesn’t get us closer to AGI (RAG doesn’t help symbolic reasoning), even though it’s extremely useful and would make for overwhelmingly practical use cases

kellogh,
@kellogh@hachyderm.io avatar

@mako the example i gave — GPT4 got less confused than perplexity — RAG isn’t everything, and the main places it falls apart is in its text interface. it got confused because the context was partitioned across messages, so the embedding used for RAG didn’t have enough information.

the reason we do smaller chunks for embeddings is because, as the chunk size increases, it continues to add information and it gets harder for the embedding to represent the main themes

kellogh,
@kellogh@hachyderm.io avatar

@mako i guess we just need an innovation in embedding models — prompt-able embedding models. give it the full context, but only generate an embedding for the last n-words. I’m not entirely sure that hasn’t been done already…

kellogh,
@kellogh@hachyderm.io avatar

@chromosundrift i suppose it doesn’t, but it’s very hard to imagine it without it. seems like at some point you need precision

kellogh, to random
@kellogh@hachyderm.io avatar

i watched a demo video of singing a song and, sure it was bad, but it was still better than Laura Trump

kellogh, to ai
@kellogh@hachyderm.io avatar

a crazy development over the last couple years is the revival of computer architecture

for most of my career, CPUs and GPUs just worked, and while there were some wild ideas, the problems hadn’t yet emerged

with , we’ve moved so far from the low level, that the existing chips aren’t working all that well anymore. I’d argue that computer architecture is now a skill needed for AI engineers these days

meganL, to random
@meganL@mas.to avatar

Community participation:

What are your favorite non-monopoly places to shop online? Bonus if they're actually also really cool businesses?

Help folks discover non-Amazon, non-Walmart stores!

Ones I use include:

American Science & Surplus: https://sciplus.com/

Stonemountain & Daughter https://stonemountainfabric.com/

Davis Food Co-op (not mail order, but you can still do "curbside" pick-up) https://davisfood.coop/

kellogh,
@kellogh@hachyderm.io avatar

@WuMargaret @meganL i tried other brands of barefoot shoes years ago, and my general takeaway was that they’re a great way to mess up your feet and calves. i’m sure you can do it safely, but it’s not intuitive and there’s a whole ton of ways to seriously hurt yourself

kellogh, to random
@kellogh@hachyderm.io avatar

sperm whales have a complex language! they use complex patterns of clicks to communicate

it turns out that the hardest part of the search for intelligent life is recognizing what you’re looking at

https://www.npr.org/2024/05/07/1249546255/sperm-whale-communication-ai-language

kellogh,
@kellogh@hachyderm.io avatar

@jimfl i bet it was an FFT

futurebird, to random
@futurebird@sauropods.win avatar

Politicians and political commentators whine about young people not buying homes and starting families (not getting married) and then do NOTHING to help the young people (who do exist) who would love to do one or more of these things but can't because it's too damn expensive.

Build housing and coops where young people want to live. Protect their jobs with unions. Make health care not an issue.

Do not make some marriages impossible because you don't like the genders.

Not rocket science.

kellogh,
@kellogh@hachyderm.io avatar

@futurebird i had this same conversation with my dad after he went off about some population crisis. “dad, do you know how expensive it is to have children these days? the whole world is working against you and your family”

kellogh, to random
@kellogh@hachyderm.io avatar

the kids are arguing

8yo: yes! honeybees sting!

3yo: no they don’t! when honeybees come over they say hi

kellogh,
@kellogh@hachyderm.io avatar

@amyedge she must have gotten it from somewhere, not sure where though

kellogh,
@kellogh@hachyderm.io avatar

@amyedge lol, apparently it’s something my wife says

nicola, to ADHD
@nicola@fosstodon.org avatar

I read ADHD—A Lifelong Struggle today. It’s the best thing I’ve read on ADHD so far. Its advice is grounded in experience and applies to everyone: those who think ADHD is a crock or, worse, an excuse, those who suffer from it, and those who have family members or friends who suffer from it.

https://gekk.info/articles/adhd.html

kellogh,
@kellogh@hachyderm.io avatar

@nicola this is best book i’ve read on the subject. it’s got a good explanation of what it is, how it happens, who it happens to, what it looks like, and what to do about it. Everyone i’ve recommended it to has read it more than once

https://a.co/d/2zZSggx

kellogh, to ai
@kellogh@hachyderm.io avatar

is there a framework like STRIDE for evaluating ethics? seems like something @DAIR would have

kellogh, to random
@kellogh@hachyderm.io avatar

there’s no 3d printing in space

kellogh, to random
@kellogh@hachyderm.io avatar

actually yeah, now that all the white moms and dads are smoking pot, might as well make it more legal

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • JUstTest
  • GTA5RPClips
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • everett
  • InstantRegret
  • Youngstown
  • mdbf
  • slotface
  • rosin
  • modclub
  • kavyap
  • Leos
  • normalnudes
  • cubers
  • osvaldo12
  • tacticalgear
  • Durango
  • khanakhh
  • ngwrru68w68
  • provamag3
  • anitta
  • tester
  • cisconetworking
  • ethstaker
  • megavids
  • lostlight
  • All magazines
    •