renchap,
@renchap@oisaur.com avatar

After 8 months working on Mastodon, in particular on infrastructure for mastodon.social and mastodon.online, I have been able to articulate my vision for the future of Trust & Safery for Mastodon : https://renchap.com/blog/post/evolving_mastodon_trust_and_safety/

We need better tools to go along the growth of the Fediverse, and they need to enable multiple instances to work together on those topics and keep our loved network safe for everyone!

jdp23,

@renchap Thanks for the writeup, and it's great to hear that Mastodon gGmbH has heard that the community is asking for more effort in this area.

As things move forward, it's critical to get the input of people communities who are targeted by hate speech and most at risk from harassment -- including women, BIPOC, trans and non-binary people, Muslims, Dalits, disabled people, and especially people at the intersections. They're the experts, but their input is often ignored -- Twitter for example repeatedly rolled out moderation solutions they thought would help but had obvious holes, and Bluesky's making the same mistake. So this is a chance for the fediverse to do better -- while also making progress on some of its equity issues.

oemb1905,
@oemb1905@gnulinux.social avatar

deleted_by_author

  • Loading...
  • renchap, (edited )
    @renchap@oisaur.com avatar
    kevinrns,
    @kevinrns@mstdn.social avatar

    @renchap

    And hidden urls MUST always be dusplayed in plain text next to the hidden url.

    Allowing hidden urls is one of Mastodon's biggest threats to users.

    idjy,

    @renchap At this point, I wonder if we could learn from the Amish (or Simon Sinek's "Leaders eat last") and maybe limit the size of instances to 150-250 members, making the content-aspect manageable by one human with no advanced-tech background, and maybe have one "shaman" for the tech-aspects of several "villages", as maintaining seems to me easier than installing.

    What's your take on this?

    nemobis,
    @nemobis@mamot.fr avatar

    @renchap Thanks for sharing (I assume) well ahead of the design phase.

    There's a lot to unpack here. Are you able to share what previous research and experiences you've considered so far? Do you welcome suggestions?

    For example, the proposal reminded me of "Toxicity in the Decentralized Web and the Potential for Model Sharing".
    https://arxiv.org/abs/2204.12709

    renchap,
    @renchap@oisaur.com avatar

    @nemobis I am not an expert in these topics, and I hope people with more experience than me (and who read the existing research) will join forces to make this happen in the best way possible.
    This is my personal point of view on the topic, and I hope it will kickstart some work around it. I always welcome feedback and suggestions!

    nemobis,
    @nemobis@mamot.fr avatar

    @renchap Got it.

    One idea could be to post your current idea as a FEP (Fediverse Enhancement Proposal).
    https://codeberg.org/fediverse/fep

    That would be useful even if the initial version is focused on Mastodon. (You never know, maybe the developers of some other apps will come along and adopt the idea.)

    An advantage is that people could add links, there would be a wiki-like document with the latest thinking, there's already a forum where to gather comments etc.

    adb,
    @adb@todon.eu avatar

    @renchap An excellent vision - thankyou for your work

    M8_,

    @renchap thank you for great works 👍🏼

    housepanther,

    @renchap Along that same line, the tools need to play well with each other. I hope that we don't see projects like Akkoma and Calckey as competition but variation and all working together to achieve the same goal - kicking corporate out of social media.

    ocdtrekkie,
    @ocdtrekkie@mastodon.social avatar

    @housepanther @renchap One of the top perks of separating the moderation tools out from Mastodon itself would be that other fediverse software could use those same tools.

    One of those immediate lessons from the Lemmy/Kbin spike was that fediverse moderation tools are very, very unequally available to different platforms.

    melroy,
    @melroy@mastodon.melroy.org avatar

    @renchap we also need improvements in the protocol I think.

    luis_in_brief,
    @luis_in_brief@social.coop avatar
    rightsduff,

    thx for flagging @luis_in_brief@. @renchap cc'ing @yoyoel who's thinking deeply about TS and fediverse issues these days

    jaz,
    @jaz@mastodon.iftas.org avatar
    MadcapJake,

    @renchap sounds like you want to have moderation turned into a service and provide the ability to integrate several of these services into an instance with rules and controls for how they are fed/consumed and the level of action that their response will incur. As long as trust and transparency is marched forward in lockstep with scalability, I think this could be a solid approach.

    antifawarlord,
    @antifawarlord@mastodon.social avatar

    @renchap I like these thoughts on the future of moderation / safety. I can anticipate the same people who dislike shared blocklists saying "centralization", but I see it as decoupling and modularization, only giving more options to people. This could even increase decentralization by enabling more people to selfhost without being forced to do their own moderation.

    renchap,
    @renchap@oisaur.com avatar

    @antifawarlord I 100% agree :)
    I like decentralisation, but I also know first hand what the limits are, and what challenges we are (and will be) facing.
    Also decentralisation is not isolation, something many forget.

    schmubba,
    @schmubba@ioc.exchange avatar

    @antifawarlord @renchap@tchambers
    There seems to be an evolutionary option to create curated blocking lists with different levels of strictness on different problem areas. An enhanced block list “bank” could potentially be a seed of a solution.
    Each block list is based upon a particular group of problems allowing admins to supplement their block lists based upon their policies and provide feedback into the block list bank.

    1/

    schmubba,
    @schmubba@ioc.exchange avatar

    @antifawarlord @renchap @tchambers

    The admins who administer a particular policy could curate the list with their policy and contribute it to a blocklist bank that can be hosted and replicated (think rsync) to anyone who wants to use it.
    2/2

    mike,
    @mike@thecanadian.social avatar

    @schmubba @antifawarlord @renchap @tchambers I find the entire idea of blocklists extremely problematic. Unless there is a clearly defined policy of why an instance gets added to a blocklist and a process of review that's transparent there will always be the opportunity to weaponize a block list. Automating the distribution of the block list exacerbates the problem 10 fold.

    schmubba,
    @schmubba@ioc.exchange avatar

    @mike @antifawarlord @renchap @tchambers

    I guess I was considering them as individual account block lists rather than full instance block lists.

    mike,
    @mike@thecanadian.social avatar

    @schmubba @antifawarlord @renchap @tchambers Even so... A no fly list for the fediverse?

    schmubba,
    @schmubba@ioc.exchange avatar

    @mike @antifawarlord @renchap @tchambers
    I see the irony.
    It would really be fact sharing about who you blocked and why on your instance in a structured way so other admins could make intelligent decisions about their instance. More of a bad actor sharing rather than a system wide ban list (which I think exists now).

    crumbleneedy,
    @crumbleneedy@aus.social avatar

    @mike @schmubba @antifawarlord @renchap @tchambers

    nearly any social media affordance can we weaponized for good or ill. they're extremely useful for efficiently blocking fascists, racists, misogynists, transphobes, etc. the fact that a fascist can create a blocklist for progressives doesn't bother me - they have been out-organizing the left for years - it's about time we used some of those techniques.

    mike,
    @mike@thecanadian.social avatar

    @crumbleneedy @schmubba @antifawarlord @renchap @tchambers I'd prefer to take on that responsibility rather than delegate it to unknown entities no matter how well intentioned. Our tools for moderation and the autonomy of instances are what set us apart, trying to reconsolidate these powers centrally is the philosophy that drove most of us here in the first place.

    crumbleneedy,
    @crumbleneedy@aus.social avatar

    @mike @schmubba @antifawarlord @renchap @tchambers my experience with blocklists on twitter is that someone makes one and shares it, and it's up to the individual as to whether they use it (and modify it) or not. not sure about other use cases.

    mike,
    @mike@thecanadian.social avatar

    @crumbleneedy @schmubba @antifawarlord @renchap @tchambers I was speaking more to admins and block lists of instances. Whatever the user wants to do at their level is completely up to them. Another great feature of the fediverse

    FinchHaven,
    @FinchHaven@hachyderm.io avatar

    @renchap

    I am astonished by the parallels between what you seem to be proposing as a forward vision for and Jack Dorsey's 2022 manifesto

    "[An] native internet protocol for social media"

    here:

    https://americanbuddhist.net/2022/12/14/a-native-internet-protocol-for-social-media-jack-dorsey/

    and what / are implementing via user-created Labels and third-party Labeling Services

    Salient quote:

    1. Moderation is best implemented by algorithmic choice."

    Off-loading moderation onto third-party enterprises which themselves must be moderated

    renchap,
    @renchap@oisaur.com avatar

    @FinchHaven I dont know about AT/BlueSky (and not really interested in it), but my proposal is not about having moderation being implemented by algorithms, nor off-loading it to enterprises.
    I thought is was clear from my article.

    FinchHaven,
    @FinchHaven@hachyderm.io avatar

    @renchap

    To quote (not exhaustively):

    "I envision the implementation in Mastodon’s software to be mostly around a few areas"

    "Most of what I discussed above could probably be implemented with the existing Mastodon API & Webhook, but I strongly think we need to work on a specific protocol for this purpose"

    "protocol would be based on HTTP, versioned, and would use simple and common interfaces such as a REST API and Webhooks..."

    If this does not involve algorithms, how is it manifested?

    renchap,
    @renchap@oisaur.com avatar

    @FinchHaven A protocol is not an algorithm.

    FinchHaven,
    @FinchHaven@hachyderm.io avatar

    @renchap

    Protocols are implement in source code, many parts of which are directed by algorithm

    They are not identical, no

    No one would claim that, and I've written nothing here that would let you reasonably imply I have

    FinchHaven,
    @FinchHaven@hachyderm.io avatar

    @renchap

    "I dont know about AT/BlueSky (and not really interested in it),"

    This is disingenuous at best

    If you (and Gargron) are not paying attention to what BlueSky is doing, what are you watching?

    vyr,

    @renchap glad to see i'm not the only one who thinks it needs more webhooks (i'm the person who added status.created, status.updated, and account.updated)

    vyr,

    @renchap being able to evolve the moderation tools separately from the main project is a must

    vyr,

    @renchap still waiting for a report.updated hook btw, can't fully integrate with external ticketing without one https://github.com/mastodon/mastodon/pull/24211

    renchap,
    @renchap@oisaur.com avatar

    @vyr I am not sure the status webhooks are a good idea, they lack the granularity and control over data that I envision. They are good in the short/medium term, but we need something more complex that those privacy-wise, but this can be achieved with what I described :)

    vyr,

    @renchap being able to create one-off webhooks with more granular permissions and property filtering seems like the way to go, especially given connecting third parties directly is now a possibility

  • All
  • Subscribed
  • Moderated
  • Favorites
  • mastodon
  • Durango
  • DreamBathrooms
  • thenastyranch
  • magazineikmin
  • tacticalgear
  • khanakhh
  • Youngstown
  • mdbf
  • slotface
  • rosin
  • everett
  • ngwrru68w68
  • kavyap
  • InstantRegret
  • JUstTest
  • cubers
  • GTA5RPClips
  • cisconetworking
  • ethstaker
  • osvaldo12
  • modclub
  • normalnudes
  • provamag3
  • tester
  • anitta
  • Leos
  • megavids
  • lostlight
  • All magazines