@kellogh@hachyderm.io
@kellogh@hachyderm.io avatar

kellogh

@kellogh@hachyderm.io

I'm a software engineer and sometimes manager. Currently #Raleigh but also #Seattle. Building ML platform for a healthcare startup. Previously, built an IoT platform for one of "those" companies.

Open source: dura, fossil, Jump-Location, Moq.AutoMock, others

Do I have other interests? No, but I do have kids and they have interests. I think that counts for something. I can braid hair and hunt unicorns!

I put the #rust in frustrate

He/Him

#metal #science #python

This profile is from a federated server and may be incomplete. Browse more on the original instance.

kellogh, to fediverse
@kellogh@hachyderm.io avatar

so is basically just bidirectional ?

kellogh, to random
@kellogh@hachyderm.io avatar

PSA save your old cameras. we’re to the point where most smartphone pics are heavily processed by AI to the point where they don’t really reflect reality. in 1-2 years those old pre-AI cameras are gonna be real hot

kellogh, to random
@kellogh@hachyderm.io avatar

i wish openai embedding models had an option to NOT normalize vectors

most of the time, normalizing is exactly what you want, but every now and then normalization squashes valuable info

futurebird, to random
@futurebird@sauropods.win avatar

I love the fedi only more for being the only place I know full of exasperated FORTRAN defenders. How can we insult the original word? Yea, when it was first written we were not yet even born! 🥰

kellogh,
@kellogh@hachyderm.io avatar

@futurebird ha, BLAS and LAPACK are written in fortran and almost all linear algebra libraries use them for array operations, e.g. numpy. so there’s a chance several of the programs you use are running fortran, especially anything ML/AI related

smach, to LLMs
@smach@masto.machlis.com avatar

“The general problem of mixing data with commands is at the root of many of our computer security vulnerabilities.” Great explainer by security researcher Bruce Schneier on why large language models may not be a great choice for tasks like processing your emails.
https://cacm.acm.org/opinion/llms-data-control-path-insecurity/

kellogh,
@kellogh@hachyderm.io avatar

@smach yay! i had the same thought a while ago. if you can separate the data & control, you can make it safe

https://timkellogg.me/blog/2024/01/11/application-phishing

kellogh,
@kellogh@hachyderm.io avatar

@smach after writing that, i found out about control vectors, which is sort of close, but the control still goes through the same channel as data https://vgel.me/posts/representation-engineering/#Control_Vectors_v.s._Prompt_Engineering

kellogh, to random
@kellogh@hachyderm.io avatar
kellogh, to Metal
@kellogh@hachyderm.io avatar
futurebird, to random
@futurebird@sauropods.win avatar

Four more years?
or five more brain worms?

kellogh,
@kellogh@hachyderm.io avatar

@futurebird is that a reference to the Host of Saturday Night Live Worms?

sminez, to random
@sminez@hachyderm.io avatar

If the light is like this tomorrow when I have some time to explore Madrid then hopefully I should be able to have some success with a bit of street photography 🤞

kellogh,
@kellogh@hachyderm.io avatar

@sminez that’s rendered, right? has a CGI/AI vibe

kellogh,
@kellogh@hachyderm.io avatar

@sminez yeah, i think phone cameras are halfway to CGI at this point

KathyReid, to stackoverflow
@KathyReid@aus.social avatar

Like many other technologists, I gave my time and expertise for free to because the content was licensed CC-BY-SA - meaning that it was a public good. It brought me joy to help people figure out why their code wasn't working, or assist with a bug.

Now that a deal has been struck with to scrape all the questions and answers in Stack Overflow, to train models, like , without attribution to authors (as required under the CC-BY-SA license under which Stack Overflow content is licensed), to be sold back to us (the SA clause requires derivative works to be shared under the same license), I have issued a Data Deletion request to Stack Overflow to disassociate my username from my Stack Overflow username, and am closing my account, just like I did with Reddit, Inc.

https://policies.stackoverflow.co/data-request/

The data I helped create is going to be bundled in an and sold back to me.

In a single move, Stack Overflow has alienated its community - which is also its main source of competitive advantage, in exchange for token lucre.

Stack Exchange, Stack Overflow's former instantiation, used to fulfill a psychological contract - help others out when you can, for the expectation that others may in turn assist you in the future. Now it's not an exchange, it's .

Programmers now join artists and copywriters, whose works have been snaffled up to create solutions.

The silver lining I see is that once OpenAI creates LLMs that generate code - like Microsoft has done with Copilot on GitHub - where will they go to get help with the bugs that the generative AI models introduce, particularly, given the recent GitClear report, of the "downward pressure on code quality" caused by these tools?

While this is just one more example of , it's also a salient lesson for folks - if your community is your source of advantage, don't upset them.

kellogh,
@kellogh@hachyderm.io avatar

@ErikJonker @KathyReid i stopped contributing to SO about 10 years ago bc i realized i was generating value for a company and little to none for myself. at best, someone sees my profile and thinks, “gee, 8000 points, wow”. but i haven’t ever been able to convert that into jobs or money, whereas i have with open source contributions.

if anything, i’m a little suprised that people are just now realizing the cost of “free” corporate services

kellogh,
@kellogh@hachyderm.io avatar

@ErikJonker @KathyReid right, i’m pretty sure it was already being used. by every model. just they’re actually getting paid for it now

personality_of_colt, to random

It is wild to think there are so many Americans who would vote for a convicted rapist and conman over Joe Biden, solely because Biden is "a career politician." When you hate lifetime civil servants more than you hate rape, theft and insurrection, there's not much else that can be said.

kellogh,
@kellogh@hachyderm.io avatar

@personality_of_colt i told my dad that RFK has brain worms and he replied, “well, at least he’s less compromised than Biden”

carnage4life, to random
@carnage4life@mas.to avatar

I saw a headline saying RFK Jr had brain worms but didn’t realize until just now that it was a true statement. A worm literally ate part of his brain. 🙀

kellogh,
@kellogh@hachyderm.io avatar

@carnage4life right? tbh i didn’t even realize that was actually a thing that happens. i thought it was just something people say

kellogh, to random
@kellogh@hachyderm.io avatar

i don’t tell the kids to shut the windows, i tell them, “if any spiders crawl in, just push them out”. the problem solves itself

KathyReid, to stackoverflow
@KathyReid@aus.social avatar

I just issued a data deletion request to #StackOverflow to erase all of the associations between my name and the questions, answers and comments I have on the platform.

One of the key ways in which #RAG works to supplement #LLMs is based on proven associations. Higher ranked Stack Overflow members' answers will carry more weight in any #LLM that is produced.

By asking for my name to be disassociated from the textual data, it removes a semantic relationship that is helpful for determining which tokens of text to use in an #LLM.

If you sell out your user base without consultation, expect a backlash.

kellogh,
@kellogh@hachyderm.io avatar

@KathyReid is that really true? did they say that?

kellogh,
@kellogh@hachyderm.io avatar

@KathyReid no, about it being weighted by user prevalence. i would’ve thought PII is removed from training data…

kellogh,
@kellogh@hachyderm.io avatar

@KathyReid idk, if you really wanted to fuck with stack overflow, find the worst answers and upvote them as much as possible, have a whole upvote chain that completely erases the value of the point system. that would do a little to harm the model, and a lot to punish the company

AnnemarieBridy, to random
@AnnemarieBridy@mastodon.social avatar
kellogh,
@kellogh@hachyderm.io avatar
kellogh, to Metal
@kellogh@hachyderm.io avatar

i’ve taken to playing #knockedloose while taking naps, it keeps the kids away but my dreams get weird
#metal

kellogh, to random
@kellogh@hachyderm.io avatar

tbqh my life is worse knowing that RFK has brain worms, in that now i know that's a real thing. i was happy believing it was just a thing mean people said

softwaredoug, to random
@softwaredoug@hachyderm.io avatar

Insulate your career: not with F-you money, but with your F-You network

https://softwaredoug.com/blog/2024/05/08/build-an-f-you-network

kellogh,
@kellogh@hachyderm.io avatar

@softwaredoug awwww, sure that's good advice, but i like money

kellogh, to random
@kellogh@hachyderm.io avatar

boxes were checked

kellogh, to python
@kellogh@hachyderm.io avatar

what's the word when, in , the declared types are wrong, so you have to butcher the code with assert statements? dark types?

kellogh,
@kellogh@hachyderm.io avatar

@slott56 ship it

  • All
  • Subscribed
  • Moderated
  • Favorites
  • anitta
  • thenastyranch
  • magazineikmin
  • tacticalgear
  • InstantRegret
  • ngwrru68w68
  • Durango
  • Youngstown
  • slotface
  • mdbf
  • rosin
  • PowerRangers
  • kavyap
  • DreamBathrooms
  • normalnudes
  • vwfavf
  • hgfsjryuu7
  • cisconetworking
  • osvaldo12
  • everett
  • ethstaker
  • GTA5RPClips
  • khanakhh
  • tester
  • modclub
  • cubers
  • Leos
  • provamag3
  • All magazines