Chocobozzz, to fediverse
@Chocobozzz@framapiaf.org avatar

is your companion for finding videos, playlists and channels from the PeerTube federation

We're currently testing in favour of to index the data.

As it's difficult to know if the results are relevant in all languages, we're looking for public feedback!

So don't hesitate to test this new engine on https://meilisearch.sepiasearch.org/ and let us know what you think :)

Natanox, to random
@Natanox@chaos.social avatar

Does have to be reachable from the internet or just the service it's used with (e.g. Mastodon, Nextcloud)?

FoW, to random Korean
@FoW@netsphere.one avatar

엘라스틱 엔지니어 행사 구경 왔어요.

fell, to random
@fell@ma.fellr.net avatar

So, apparently I have ElasticSearch now? I had to hard reset my server in the middle of indexing because it ran out of memory and came to a complete halt. (See https://ma.fellr.net/@fell/111375959444602138)

It seems to be working though? I don't care if it hasn't indexed everything as long as it indexes new posts.

elduvelle, to twitter
@elduvelle@neuromatch.social avatar

So let me get this right..

1-Scientists go to Twitter, invest time and effort in it to build their profile, post cool content, help optimize it, attract readers to it etc.

2-Jack Dorsey (& others) sells Twitter to Elon Musk

3-Elon Musk destroys Twitter

4-Jack Dorsey creates a new platform, Bluesky

5-Scientists go to BlueSky, invest time and effort to build their profile … … …

…am I missing something? Why are they doing it again? 😳

Edits: sorry, acting up with my formatting again

kofanchen,
@kofanchen@drosophila.social avatar

@elduvelle @odr_k4tana
@feditips
I just encountered a time consuming process on 🦣: a paper I boosted got published and I was hoping to replied to you original booted post so make the information continuous...it took me 30 mins to find the post only becus I had an earlier reply that contain images so I can retrieve from my media tool in , I had tried and neither of it helped me....and unfortunately my instance cannot afford .😞

elduvelle,
@elduvelle@neuromatch.social avatar

@kofanchen @odr_k4tana @feditips
In any case, I hope your instance can get eventually because it is really a game changer, especially for scientists! @jonny got it to work for us and I’m sure they’ll be happy to provide some pointers (or tricks) about it.

elduvelle, to random
@elduvelle@neuromatch.social avatar

Remember: if your server has the new Search enabled, you should decide if you want to be included in it or not (Settings > Public Profile > Privacy & Reach) and tick (or not) the “Include public posts in search results” box.

It’s disabled by default so please enable it to make Mastodon more searchable and useful!! #MastoTip #ElasticSearch

DeltaWye, to random
@DeltaWye@mstdn.social avatar

I took some time to work out the exact that demands. If you think this might be useful, go ahead and boost. If you find any errors or would like to suggest additions, please also post a reply!

Hopefully this can help prevent a lot of frustration and trouble people might encounter and give them a better Mastodon experience!

(Updated to Revision 2)

fabian, to PostgreSQL
@fabian@floss.social avatar
tim, to mastodon
@tim@mastodon.timnolte.com avatar

Well, I finally got myself up to v4.1.9, and now to begin the v4.2.0 upgrade. Not going to bother with setup for now, though would probably go for probably anyways.

See y'all on the upgrade flip-side. 👋

wood, to mastodon
@wood@federated.press avatar

Masto admins:

I'm currently running the Elasticsearch update after upgrading to Mastodon 4.2.0, and it was running really fast until it got to "PublicStatusesIndex" — now it's still importing documents, but it's really slow. It says 406 docs/s, w/ 54M to go, and the ETA keeps getting longer. Anyone else experience this?

michael, to random
@michael@thms.uk avatar

I've noticed a lot of chatter about setting up Elasticsearch for Mastodon 4.2's new full text search over the last few days, including what hardware is required, how difficult is it, etc.

So I thought I’d write down my experience, including the hardware I'm running Elasticsearch on for my single user instance:

https://blog.thms.uk/2023/09/mastodon-elasticsearch?utm_source=mastodon

nebyoolae, to mastodon
@nebyoolae@masto.neb.host avatar

@enusbaum I went to check if I needed to update on my server and then realized that I don't have Elasticsearch on my server because I have 4GB of RAM on my server and Elasticsearch would die on my server.

shochdoerfer, to Symfony German
@shochdoerfer@phpc.social avatar

How to use Elasticsuite to boost the search results by a manually defined sorting relevance? This can be solved just by configuring Elasticsuite, no code adaptions are needed. I've documented the steps in my bitExpert blog post https://blog.bitexpert.de/blog/elasticsuite_sort_relevance_boost

kikobar, to mastodon
@kikobar@acc4e.com avatar

I tried to enable in my solo instance, and it triggered a huge workload to index around 17 million documents.

This process would have taken several days to complete with the current resources allocated to the instance.

I opted for terminating the process and disabling Elasticsearch, but I'd like to hear other experiences:

  • Is this only a temporary behavior? (ie. after initial indexation it becomes easier on the server).

  • Is there any periodic 'cleanup' process? (ie. my server ingest many GB of toots every day, will I end up with a huge Elasticsearch database?).

  • Am I missing something valuable for not implementing Elasticsearch?

Looking forward to hear your thoughts.

jcrabapple, to random

deleted_by_author

  • Loading...
  • jeff,
    @jeff@honeytree.social avatar

    @jcrabapple

    Lots of pain caused by in the update.

    We're still indexing.... some 24 hours later. no end in sight.

    chris, to mastodon
    @chris@mstdn.chrisalemany.ca avatar

    can confirm. The new fulltext search works great, and is awesome! I just searched for "footiMac" which I know only I use and it returned results very very quickly. I can go way back. Including to it's very first mention back in January!

    This ability is so very important for the usability and attractiveness of Mastodon!

    https://mstdn.chrisalemany.ca/@chris/109705623945932203

    scott, to random
    @scott@tams.tech avatar
    chris, to random
    @chris@mstdn.chrisalemany.ca avatar

    @umiamz are there configuration options to bring down the usage? I admit I didnt delve deeply.

    umiamz,

    @chris Yes - create a file in

    /etc/elasticsearch/jvm.options.d/

    e.g. memory.options, containing

    -Xms2048M
    -Xmx2048M

    then restart Elasticsearch. That will reduce it to around 2GB. By default it takes half the RAM, hence your 7-8GB usage :)

    You can always raise it if it's too little for it to work properly.

    wir, to mastodon German
    @wir@graz.social avatar

    Unsere Instanz wurde gestern auf die neue Version 4.2.0 aktualisiert. :tux: Es bietet viele Verbesserungen, von der Suche, dem Onboarding-Prozess, bis zur Oberfläche und viele mehr!

    Darüber hinaus betreiben wir nun auch im Hintergrund, also einen Suchindex. Wir werden deshalb auch bald unserem Server mehr Power geben müssen.

    Profilbeschreibungen werden nun auch in der erfasst, genauso wie eure Posts, wenn ihr dies optional einstellt.

    https://blog.joinmastodon.org/2023/09/mastodon-4.2/

    jimmyb, to mastodon
    @jimmyb@selfhosted.cafe avatar

    Updated my instances to 4.2.0 this evening. Just awaiting one of them to finish re-indexing things in . :docker: :mastodondance:

    toni, to random
    @toni@pancake.place avatar

    Very much interested to deploy Mastodon 4.2 full text search functionality on my small instance.

    Anyone experienced how much additional resources takes? Is it better to dedicate separate VM for it?

    Marcus, to mastodon
    @Marcus@k8s.social avatar

    Will the 4.2 update now require or will it still be an optional feature?

    xeraa, to random
    @xeraa@mastodon.social avatar

    and the full stack 8.10.1 is out. was leaking sensitive information in its logs (see https://discuss.elastic.co/t/kibana-8-10-1-security-update/343287), so upgrade away
    elastic cloud should be patched up by us and it was the first time that we had to pull a release — fun weekend operation 🙈

    chris, to random
    @chris@mstdn.chrisalemany.ca avatar

    So I'm deploying on my server right now. It’s importing the "accountsIndex”. It says ###/561466. Does that mean 561,466 accounts have interacted with my server in some way? If so. That's pretty wild. But also, if Mastodon ever got big... that number would likely go up exponentially and my little server would?? 🔥🤯🤪

  • All
  • Subscribed
  • Moderated
  • Favorites
  • JUstTest
  • mdbf
  • Durango
  • thenastyranch
  • ngwrru68w68
  • InstantRegret
  • DreamBathrooms
  • modclub
  • magazineikmin
  • Youngstown
  • everett
  • ethstaker
  • slotface
  • rosin
  • anitta
  • kavyap
  • osvaldo12
  • GTA5RPClips
  • cisconetworking
  • provamag3
  • khanakhh
  • tacticalgear
  • cubers
  • Leos
  • normalnudes
  • megavids
  • tester
  • lostlight
  • All magazines