@KathyReid@aus.social
@KathyReid@aus.social avatar

KathyReid

@KathyReid@aus.social

Doing a #PhD https://aus.social/@anucybernetics in #opensource #voice and #data #bias #FairML. Into #linux, #IoT. Built @SenseBreast. She/her pronouns. Ex @mycroft_ai https://fosstodon.org/@linuxaustralia @deakin @mozilla
Living in Australia on Waddawurrung land but with connections in #Northumberland
#MastoAdmin for fediverse.au

This profile is from a federated server and may be incomplete. Browse more on the original instance.

KathyReid, to random
@KathyReid@aus.social avatar

Sam Altman has recently suggested as an alternative to .

Apart from being egregiously out of touch, it's also a huge power move, one that I don't think people grasp.

The polarisation of society into those deriving an income from return on capital - capitalists - and those deriving an income from labour - workers - has been driven in large part by venture capital and their hunger for new asset classes.

Housing is an asset class, it's no longer social infrastructure.

Stocks are an asset class - they're no longer a way to ensure survival of the best organisations - because many companies with little revenue have high valuations.

Compute is now an asset class. It allows organisations to gain advantage, and create a moat from their competitors. Compute is an asset.

By substituting compute for money (another asset class), Altman is trying to substitute compute for currency more broadly.

And who creates currency?

Typically, the state. Who now creates currency, sorry I mean compute? The MAANGs that have taken the place of the state.

Compute is currency.

Replacing currency with compute is a form of wrestling control from the state.

As we say in Australia, yeah, nah.

KathyReid,
@KathyReid@aus.social avatar

@danstowell Interesting perspective, thank you!

KathyReid, to FiberArts
@KathyReid@aus.social avatar

This is incredible - Tracey Clement, a lecturer at , used to visualise the devastating in Australia.

Her work is rage expressed in thread, each stitch a jibe at the people who continue to vacillate in the face of a climate emergency.

Incredible.

https://theconversation.com/15-000-squares-500-hours-19-months-how-i-used-embroidery-to-make-sense-of-australias-catastrophic-fires-227907

Unixbigot, to random
@Unixbigot@aus.social avatar

Venture Capital is dynamite fishing. You sprinkle some “free service” on the waters until you have a nice thick shoal of users. Then you detonate.

KathyReid,
@KathyReid@aus.social avatar

@Unixbigot we should call it Vulture Capital

KathyReid, to random
@KathyReid@aus.social avatar

In the most glorious "fuck you" I have seen in a while, you know the book that Cumberland City Council banned because they're homophobic bigots - Holly Duhig's "A focus on Same Sex Parents"? Well, the publisher, BookLife Publishing, have made a PDF version of the book available for free.

Sure be a shame if it was shared far and wide now, wouldn't it?

Every time you ban a book filled with hope and kindness, and care and love, we will resist.

https://www.booklifepublishing.co.uk/a-focus-on/same-sex-parents/

KathyReid,
@KathyReid@aus.social avatar

@crone beautifully put!

KathyReid,
@KathyReid@aus.social avatar

@vruz @wendypalmer ❤️

KathyReid,
@KathyReid@aus.social avatar

@RupertReynolds ❤️

KathyReid,
@KathyReid@aus.social avatar

@Snowshadow ❤️

DanielEriksson, to random
@DanielEriksson@mstdn.science avatar

@KathyReid
Small world - I've students at the ANU Research School of Biology (Williams lab, structural biology of plant innate immunity).

Seems I'll need to explore more of the campus next time I'm in Canberra!

KathyReid,
@KathyReid@aus.social avatar

@DanielEriksson small world indeed! 👋 from many thousands of km away

KathyReid,
@KathyReid@aus.social avatar

@DanielEriksson ;-)

KathyReid,
@KathyReid@aus.social avatar

@DanielEriksson Ah sorry I saw the flag and assumed Sweden! I am just down the road in Geelong :D

KathyReid, to stackoverflow
@KathyReid@aus.social avatar

Like many other technologists, I gave my time and expertise for free to because the content was licensed CC-BY-SA - meaning that it was a public good. It brought me joy to help people figure out why their code wasn't working, or assist with a bug.

Now that a deal has been struck with to scrape all the questions and answers in Stack Overflow, to train models, like , without attribution to authors (as required under the CC-BY-SA license under which Stack Overflow content is licensed), to be sold back to us (the SA clause requires derivative works to be shared under the same license), I have issued a Data Deletion request to Stack Overflow to disassociate my username from my Stack Overflow username, and am closing my account, just like I did with Reddit, Inc.

https://policies.stackoverflow.co/data-request/

The data I helped create is going to be bundled in an and sold back to me.

In a single move, Stack Overflow has alienated its community - which is also its main source of competitive advantage, in exchange for token lucre.

Stack Exchange, Stack Overflow's former instantiation, used to fulfill a psychological contract - help others out when you can, for the expectation that others may in turn assist you in the future. Now it's not an exchange, it's .

Programmers now join artists and copywriters, whose works have been snaffled up to create solutions.

The silver lining I see is that once OpenAI creates LLMs that generate code - like Microsoft has done with Copilot on GitHub - where will they go to get help with the bugs that the generative AI models introduce, particularly, given the recent GitClear report, of the "downward pressure on code quality" caused by these tools?

While this is just one more example of , it's also a salient lesson for folks - if your community is your source of advantage, don't upset them.

KathyReid,
@KathyReid@aus.social avatar

@MoBaAusbWerk120 Good question, not that I know of. I also think it would be an enormous undertaking.

KathyReid,
@KathyReid@aus.social avatar

@kellogh @ErikJonker That's a good point. Your example is where SO is hoarding the power and profits, from contributors. There's another type of scale happening here with OpenAI - where they're essentially eating the profits of Stack Overflow by vacuuming up the text into an LLM.

It's a concentration effect.

How do individuals effectively resist this type of power concentration?

KathyReid,
@KathyReid@aus.social avatar

@scruss @wraptile @krans

Strong agree.

I think there's also a danger here that by not writing code, and going through the learning journey that writing code provides, people are less able to debug code, and understand what it's doing.

It's a form of abstraction where the complexity - writing code - is abstracted away for faster development. But what do we lose in that process?

In a way, there will be a higher dependency on people who have coded for decades to be able to do debugging and more complex programming tasks.

It's like cars - as they've become easier to drive, they're harder to debug and fix, so there's an increased dependency on mechanics (and in turn, on car manufacturers who don't let mechanics do as much).

KathyReid,
@KathyReid@aus.social avatar

@hcs probably not, because SO owns the copyright in the material - so it's a copyright vs creative commons interplay

KathyReid,
@KathyReid@aus.social avatar

@futurebird yes

KathyReid,
@KathyReid@aus.social avatar

@patrickleavy well, except it's now populated with so much LLM-generated bullshit it would be impossible to tell what's LLM-generated and what's human-generated.

KathyReid,
@KathyReid@aus.social avatar

@astrojuanlu @j3j5 @blogdiva

Except that copyright laws are different in different countries - not all countries have a fair use exemption in copyright law

KathyReid,
@KathyReid@aus.social avatar

@ErikJonker good question. By fully open source, I am assuming the weights, biases and the source data, and training algorithm, are openly available.

This would be a situation I am a lot more comfortable with, but it still would not fulfil the requirements of the CC-BY license (requiring attribution).

If the LLM was used with RAG, and RAG was used to provide attribution, I think I would be comfortable with that.

KathyReid,
@KathyReid@aus.social avatar

@blogdiva Right, but their position seems to be very generative AI friendly, which aligns with their remix, reuse ethos.

They are unlikely to sue because generative AI fulfils parts of the mission of Creative Commons - to use creative works in new, creative ways.

KathyReid,
@KathyReid@aus.social avatar

@LLS @blogdiva Right, so this comes down to the definition of creativity.

If a person re-mixes content in a new or unique way, we consider that creative. Possibly derivative, but creative.

If an LLM does it, is it still creative?

I would argue no, because I see LLMs as bullshit generators that regurgitate what they were fed on, but others are likely to take a different philosophical view.

KathyReid,
@KathyReid@aus.social avatar

@njsg that is a good point, so there may also be copyright violations here.

KathyReid, to stackoverflow
@KathyReid@aus.social avatar

I just issued a data deletion request to to erase all of the associations between my name and the questions, answers and comments I have on the platform.

One of the key ways in which works to supplement is based on proven associations. Higher ranked Stack Overflow members' answers will carry more weight in any that is produced.

By asking for my name to be disassociated from the textual data, it removes a semantic relationship that is helpful for determining which tokens of text to use in an .

If you sell out your user base without consultation, expect a backlash.

KathyReid,
@KathyReid@aus.social avatar

@arestelle @kellogh excellent points

KathyReid,
@KathyReid@aus.social avatar

@sean Good questions. The way I see a RAG being constructed / or other knowledge graph would be to associate Contributors with Questions and Answers - so you need the Question Answer relationship to generate plausible answers, but the Contributor Answer relationship lets you rank Answers higher from higher rated contributors:

See something like this:
He, Xiaoxin, Yijun Tian, Yifei Sun, Nitesh V. Chawla, Thomas Laurent, Yann LeCun, Xavier Bresson, and Bryan Hooi. "G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering." arXiv preprint arXiv:2402.07630 (2024).

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • Leos
  • everett
  • magazineikmin
  • thenastyranch
  • Youngstown
  • vwfavf
  • rosin
  • slotface
  • khanakhh
  • InstantRegret
  • PowerRangers
  • kavyap
  • tsrsr
  • DreamBathrooms
  • normalnudes
  • mdbf
  • hgfsjryuu7
  • tacticalgear
  • ethstaker
  • osvaldo12
  • ngwrru68w68
  • GTA5RPClips
  • Durango
  • modclub
  • cisconetworking
  • cubers
  • tester
  • anitta
  • All magazines
    •