Behind search for masto is a resource-hungry #java application called #elasticSearch. Sure you might be able to get Masto to run on a #raspberrypi4, but you won't be running elastic search with it.
Having recently moved my instance to a much more powerful system, I now run ES, and WOW what a difference being able to search post makes! Soooo many times I wanted to reference a toot that had scrolled by but had no way of finding it. Now I do!
Even though I've put some serious resource limits on ES, it's bar none the most resource intensive service running (out of around 25).
Please consider sending a few bucks to the #MastodonAdmin of your instance. Better yet, if you can afford it, sign up for a monthly donation. They need it.
ES|QL is a great new query language for #Elasticsearch, and my team is building integrations into the client libraries. Here's an overview of our #PHP integration that lets you turn your results into PHP objects.
After reading a massive tome about #ElasticSearch earlier this week I realised it was complete overkill and just used the full-text capabilities of #PostgreSQL instead.
Currently PieFed has 46,000 posts and results are fast. It'll be interesting to see how well it copes when there are more posts. Anyone want to make a guess when it'll bog down?
Great to see more people catching on to ClickHouseDB. We’re using ClickHouse at @honeybadger to power our upcoming logging/observability tool (Honeybadger Insights).
We’re also benchmarking a replacement backend for #Elasticsearch. Looks like quite a performance gain so far!
Will hopefully have more to share soon, but in the meantime we discussed this on the latest episode of @FounderQuest. Give it a listen:
I'm planning to write an updated homelab guide on my blog this year but I think I'm about to rebuild some parts for a new purpose 😅
It might be time to try out OpenCTI given what I do in my lab should be representative of what I do during < dayjob >. That also means I need to tear down Wazuh and configure an ELK stack instead (resource constraint). #Homelab#ELK#CTI#ThreatIntel#elasticsearch
Q for people who have used Elastic Search, esp. for a Mastodon instance: how should I configure it to use less memory (while still having enough)? Right now it seems to eat as much as it wants (~4 GB)...
It's a single-user instance, so the total data size it reports is 40 MB now.
Delighted to let everyone know that https://fediverse.au has been successfully upgraded to 4.2.5 of #Mastodon software (thank you, Claire!).
Additionally, #ElasticSearch has been installed for a better user experience.
Fediverse AU is exclusively for #research organisations and #university schools, centres and #faculties in the Australasian region - as most Mastodon instances don't allow these sorts of corporate accounts.
Please let me know if you experience any issues or glitches.
@xeraa@moira I don't care about the data, I can reindex any time. This is, and always has been, a single-node installation.
Here's the funny part, even after deleting both /var/lib/elasticsearch and /etc/elasticsearch the problem persists. I'm starting to believe the package has a bug. Is it easy to build #ElasticSearch from source?
Looking to build a simple #python#app on top of my search project for a nicer #UI and eventually doing some #monitoring & #logging of user activity. Haven’t worked on this since uni when we used #flask and sometimes a bit of #django. Anyone have any good insights / best practices / favorite reference for something like this?
Under-the-radar late night launch: RSS Parrot is live! It talks like Mastodon, but it doesn't walk like Mastodon. BUT! It will relay any RSS feed straight into your timeline.
Turn Mastodon into your very own feed reader. Follow anything that has an RSS feed and get a toot about new posts.
How? Mention @birb with the address you want to follow.
@kellogh I just rediscovered RSS & apart from feeds which are by design or for me read-only, I'm finding it invaluable to (a) keep track of my must-read people (& click through if I wish to read or join a Fediverse conversation), (b) to index my own posts on Mastodon so that I can relocate them without endless scrolling! (My instance does not yet have search options - & the RSS reader is fast.) @twilliability #RSS#Elasticsearch#OpenWeb
Schade - der Arbeitstag endet etwas unbefriedigend da das HowTo für den ELK Stack kaputt ist. Heute fehlt mir die Motivation da was selbst aufzubauen. Es ging aber eh erstmal um einen lokalen Test und nicht um ein Deployment.