kellogh

kellogh, 1 hour ago to LLMs

i’m very excited about the interpretability work that #anthropic has been doing with #LLMs.

in this paper, they used classical machine learning algorithms to discover concepts. if a concept like “golden gate bridge” is present in the text, then they discover the associated pattern of neuron activations.

this means that you can monitor LLM responses for concepts and behaviors, like “illicit behavior” or “fart jokes”

https://www.anthropic.com/research/mapping-mind-language-model

kellogh, 17 hours ago to ai

iTerm2 developer caves to the bullies and moves the #AI feature to a plugin

https://news.ycombinator.com/item?id=40458135

kellogh, 21 hours ago to LLMs

if i had more time, i'd love to investigate PII coming from #LLMs. i've seen it generate phone numbers and secrets, but i wonder if these are real or not. i imagine you could look at the logits to figure out if phone number digits were randomly chosen or if the sequence is meaningful to the LLM. anyone aware of researchers who have already done this?

kellogh, 1 day ago to random

this has been bugging me a lot. like, yeah, there’s definitely AI scams out there. and yeah, a lot of people are using it from the wrong end, but it’s also clearly a substantial technology. time to realize that
https://mas.to/@carnage4life/112484753548884371

kellogh, 1 day ago to random

“One House Republican called the incident "vile" and said it has caused concern among GOP lawmakers.”

anonymous coward, show thyself!

https://www.axios.com/2024/05/22/rnc-vials-blood-capitol-police-suspicious

kellogh, 2 days ago to ai

thinking about my education growing up, my k-6 teachers were wretched with getting facts right. one teacher didn’t have a single science experiment work. lots of stuff i was taught k-12 was outright wrong.

the thing is, students exceed their teachers all the time. a teacher isn’t the limiting factor for a student

i keep hearing that #AI is worthless bc it hallucinates. yet it’s taught me functioning skills within UI dev, graphic design, 3D printing, 3D design

maybe i didn’t actually learn?

kellogh, 3 days ago to random

alternative title: Scientific Study with Dubious Methods Produces Shocking Results
https://noc.social/@todayilearned/112474329186430771

kellogh, 4 days ago to random

this is in reference to super-alignment & safety, but my cousin also had her DEI team disbanded and “distributed” in the same way

on the surface, i think safety, DEI, and similar topics should be embedded in the culture and not centralized into a specific team. centralization would cause people to say, “oh that’s not my job”.

then again, any time a centralized team is disbanded, my immediate thought is, “apparently safety/DEI/etc. doesn’t matter to this company”. it’s a paradox, i suppose

kellogh, 7 days ago to ai

i get a whole lot of emails about “generative #AI expert immediately available for new role”… 🤔 expert?

kellogh, 8 days ago to random

holy shit

yesterday while trail running i came across this fallen tree. it looks like a thick vine wrapped and choked the life out of it, and the storm this weekend finally took it out. i couldn’t easily identify the vine, but whatever

this morning i wake up and i’m breaking tf out with what sure looks like poison ivy rashes.

i came back, and identified the vine as, yep, poison ivy. thick woody 1/3” vines up and down the full tree

A close-up of two green leaves with visible veins and black specks on their surfaces. The leaves are attached to a thin branch with a blurred background of other foliage and tree bark.

kellogh, 9 days ago to random

i can’t believe tomorrow is friday already

kellogh, 9 days ago to random

rain is cathartic

kellogh, 10 days ago to random

the #gpt4o news is cool, but now i want to see an embedding model that i can use with a streaming interruptible conversation

kellogh, 10 days ago to random

just had a conversation with my neighbor — he’s wearing an NRA tshirt and explaining that the pistol he has strapped to his hip is for shooting copperheads. And also he’s concerned that we leave our garage open too much and that copperheads might get in

kellogh, 10 days ago to random

i wish “type checking for infrastructure” was a thing

my code declares that there should be a S3 bucket that’s different from that other S3 bucket, etc. —> spin up the type checker, it reads APIs and verifies, “yep, this code should run fine”

kellogh, 10 days ago to random

sperm whales have a complex language! they use complex patterns of clicks to communicate

it turns out that the hardest part of the search for intelligent life is recognizing what you’re looking at

https://www.npr.org/2024/05/07/1249546255/sperm-whale-communication-ai-language

kellogh, 10 days ago to ai

a crazy development over the last couple years is the revival of computer architecture

for most of my career, CPUs and GPUs just worked, and while there were some wild ideas, the problems hadn’t yet emerged

with #AI, we’ve moved so far from the low level, that the existing chips aren’t working all that well anymore. I’d argue that computer architecture is now a skill needed for AI engineers these days

kellogh, 11 days ago to llm

there’s a big need for something stronger than #RAG, but more flexible and cheaper than a giant all-knowing #LLM.

A great part about RAG is that it’s just a database. You just issue INSERT/UPDATE and yeah, that’s how you maintain knowledge. No million dollar training process

kellogh, 11 days ago to random

the kids are arguing

8yo: yes! honeybees sting!

3yo: no they don’t! when honeybees come over they say hi

kellogh, 12 days ago to random

there’s no 3d printing in space

kellogh, 13 days ago to random

actually yeah, now that all the white moms and dads are smoking pot, might as well make it more legal

kellogh, 13 days ago to fediverse

so is #ActivityPub basically just bidirectional #RSS?

kellogh, 14 days ago to random

the power of wanting to gtfo https://noc.social/@todayilearned/112414756941559961

kellogh, 15 days ago to python

what's the word when, in #python, the declared types are wrong, so you have to butcher the code with assert statements? dark types?

kellogh, 15 days ago to random

are there mastodon clients that are scriptable?

i keep wishing for something good, like @ivory, but extremely customizable that lets me display toots differently, or filter in non-standard ways, or include links to resources that others might not find useful