stefan,
@stefan@stefanbohacek.online avatar

I know some fediverse apps use various text/image detection technologies, so I was curious if this encourages the use of alt text.

The main thing I learned: Out of nearly 30,000 fediverse posts I looked at, almost 80% did not have information about the client app.

That was a bit surprising. And it makes doing this sort of analysis difficult.

cragsand,
@cragsand@mastodon.social avatar

@stefan
Having a specific feature for suggesting alt text on the fediverse would be helpful while avoiding the new users experiencing alt text nag negatively.

I.e. "This user suggests the following alt text for your image: Text. Accept, deny."

Clicking accept automatically edits your post and inserts what they wrote. If it already has an alt text you never get any notification.

jupiter_rowland,

@Cragsand :catjam: If you want to make this a Fediverse-wide feature that works the same everywhere across the Fediverse, you'd first have to add it to ActivityPub. And then you'll have to hope that over a hundred Fediverse projects implement it, most of which are developed completely independently from Mastodon.

If it becomes a Mastodon feature, it won't work outside Mastodon.

#FediMeta #FediverseMeta #CWFediMeta #CWFediverseMeta #AltText #AltTextMeta #CWAltTextMeta

cragsand,
@cragsand@mastodon.social avatar

@jupiter_rowland
Yeah it would be tricky. I guess the best would be if Mastodon implements it I their API and then other developers follow suit.

jupiter_rowland,

@Cragsand :catjam: You won't get @Mario Vavti and @Mike Macgirvin 🖥️ to build Hubzilla and the streams repository respectively against the Mastodon API any more than necessary. Read, ideally at all.

Neither have anything to do with Mastodon. The streams repository is the latest in a series of developments that started yesterday 14 years ago with Mistpark. That was six years before Mastodon when Eugen Rochko was still a school kid. And Hubzilla is one of the stopovers on this path and ten months older than Mastodon itself, created by Mike as well.

Not to mention that both have absolutely nothing in common with Mastodon, technologically-wise, except for supporting ActivityPub. And both Mike and Mario hate Mastodon and its home-brew, non-standard, proprietary wanna-be "standards" while rejecting actual standards with a flaming passion because it hinders innovation in the Fediverse.

#Long #LongPost #CWLong #CWLongPost #FediMeta #FediverseMeta #CWFediMeta #CWFediverseMeta

cragsand,
@cragsand@mastodon.social avatar

@jupiter_rowland
@mikedev @mario
This is relevant once again I guess :KEKW:
https://xkcd.com/927/

stefan,
@stefan@stefanbohacek.online avatar

Interesting, casually browsing my feed, I am now noticing that this really does check out.

Do most people choose to hide this information? I vaguely remember seeing a setting for that.

I know folks here care about privacy a lot, but this is still a bit surprising.

Neblib,
@Neblib@mastodo.neoliber.al avatar

@stefan I think mastodon at least only shares the app info for local posts, not federated posts. I'll see if I can find a doc saying one way or another.

stefan,
@stefan@stefanbohacek.online avatar

@Neblib Thank you, really appreciate it!

stefan,
@stefan@stefanbohacek.online avatar
Neblib,
@Neblib@mastodo.neoliber.al avatar

@stefan mastodon.py has a similar comment https://mastodonpy.readthedocs.io/en/stable/02_return_values.html#status-dict but I'm only seeing an "Optional" marking on the official docs. https://docs.joinmastodon.org/entities/Status/#application . I tried to scan the source, but got a bit lost and hit the timecap I was wanting to spend looking. Probably could use a github issue asking the docs to be updated.

stefan,
@stefan@stefanbohacek.online avatar

@Neblib Very helpful, thank you!

stefan,
@stefan@stefanbohacek.online avatar

Here's the final CSV file (contains no private information), if anyone's interested: https://static.stefanbohacek.dev/dataviz/fediverse/fediverse-client-alt-text-data-2024-05-12.csv

stefan,
@stefan@stefanbohacek.online avatar

Some explanations:

  • descriptions_all: all attached media files have alt text
  • descriptions_some: at least one of the attached media files has alt text
  • descriptions_none: none of the attached media files have alt text
stefan,
@stefan@stefanbohacek.online avatar

You can still see some trends, for example, people who use Ivory for iOS posted 49% of their images with alt text, compared to Mastodon's 17.8% for Android and 20% for iOS users.

But I am not sure if there is enough data to draw solid conclusions.

stefan,
@stefan@stefanbohacek.online avatar

Hmm, I thought was one of the apps that uses AI to generate alt text from images, but I can't seem to be able to find anything about this.

Can someone who uses it confirm?

johnjolley,
@johnjolley@mas.to avatar

@stefan The cost of is a major obstacle for me, and I imagine for many other Mastodon users as well. I find the prospect of having to pay for a “subscription” to a Mastodon client, when there are apps available that only have to be paid for once, upon purchasing (such as !), incredibly distasteful - and I imagine a lot of other users without much expendable income do as well

stefan,
@stefan@stefanbohacek.online avatar

@johnjolley Yeah, I don't like everything turning into a subscription these days.

On the other hand, I do get the need for a sustainable business model that doesn't exploit their users through ads and data extraction, so I'm hoping that's what's going on here.

Either way, at least there's plenty of alternatives, so we can all find what best suits us.

johnjolley,
@johnjolley@mas.to avatar

@stefan ! does heavily encourage alt-text when posting photos - it requires several steps to opt-out of posting without alt-text, which provides a lot of friction to users who’s prefer to post images without descriptions - anecdotally, I expect I’d post alt-text on my photos much less frequently if Toot! didn’t encourage users to add descriptions as heavily as it does

stefan,
@stefan@stefanbohacek.online avatar

@johnjolley This is another thing I'd like to look into some day, the impact of required alt text on the quality of it. Would it encourage people to use generic, non-descriptive image description just to get past it?

Glad that is not the case for you!

boogah,
@boogah@simian.rodeo avatar

@stefan AFAIK, the closest that Ivory comes to using AI/ML for alt text is the inbuilt iOS photo feature (Live Text) that'll detect words in an image and copy them over to the image description.

(Daily user of Ivory here.)

stefan,
@stefan@stefanbohacek.online avatar

@boogah Got it, thank you!

Klumpmeister,
@Klumpmeister@mstdn.games avatar

@stefan IceCubes has AI alt text that describes an image while Ivory will just scan text in a photo to alt text.

stefan,
@stefan@stefanbohacek.online avatar

@Klumpmeister Good to know, thank you for the explanation!

FluidEscence,

@stefan Nope, that's Icecubes.

stefan,
@stefan@stefanbohacek.online avatar

@FluidEscence Yes, thank you!

  • All
  • Subscribed
  • Moderated
  • Favorites
  • fediverse
  • GTA5RPClips
  • magazineikmin
  • InstantRegret
  • everett
  • cisconetworking
  • Youngstown
  • mdbf
  • slotface
  • rosin
  • kavyap
  • khanakhh
  • ngwrru68w68
  • thenastyranch
  • DreamBathrooms
  • anitta
  • osvaldo12
  • Durango
  • provamag3
  • modclub
  • normalnudes
  • tacticalgear
  • cubers
  • ethstaker
  • megavids
  • Leos
  • tester
  • JUstTest
  • lostlight
  • All magazines