I am interested in checking out the historical growth of a particular community. Lemmy Explorer crawls for data about the Lemmyverse every 24 hours or something, and that data is made available on their website. But I can only find where to download the latest data. Is there somewhere that I can find historical data? Does Lemmy Explorer archive these anywhere, or does it just overwrite the previous data each time it crawls?
I think it over-writes every time. If you just want subscriber numbers, I've got data going back to to last July. Let me know what community you're after, and I'll send it to you.
(same person on different account, just so I can preview what the table will look like)
Hmmm. This might not help you much. That community was launched on 2024-01-22, with a page full of posts, so by the time the crawler picked up on it, it was already at 501 subs, 23 posts.
It lost 15 posts on 2024-02-12 (Stamets?).
There’s data missing from 2024-02-26 - 2024-03-01 (this data is from the bot at !trendingcommunities; I think those days are missing because I changed it from measuring Active Users Month (AUM) to Active Users Week (AUW)).
In terms of active users, the jump on 2024-03-04 is due to lemmy.world ‘upgrading’ to 0.19.3.
Yeah. It seems like the kind of community he’d post in. I think there was some drama between him and startrek.website, resulting in him or the admins deleting the account.
Yeah, but the community started before the bot at !trendingcommunities did, lemmy.world had a broken API for much of August (hence the jump), and the subscriber count never changes that much otherwise, but here's what I have:
day
subs
2023-07-24
70
2023-07-26
71
2023-07-28
75
2023-08-03
76
2023-08-05
77
2023-09-03
86
2023-09-04
87
2023-09-05
88
2023-09-11
89
2023-09-29
90
2023-10-08
89
2023-10-14
90
2023-10-15
91
2023-10-18
92
2023-10-21
93
2023-10-22
94
2023-11-12
93
2023-11-17
96
2023-11-19
97
2023-11-20
96
2023-12-15
97
2024-01-05
98
2024-01-10
99
2024-03-08
100
2024-03-10
101
2024-03-11
102
2024-03-15
103
2024-03-22
104
2024-04-04
105
Incidentally, if you want to know how broken the Fediverse is right now, lemmy.ml is the only version that has both of your comments. piefed.social (my instance) has 1, lemmy.one (OP's instance) had the other one, and lemmy.world (where this community is hosted) had none (edit: this was before I made this comment, which has forced a bit of a re-sync).
Oh, right. The chat on GitHub is over my head, but I would have thought that solving the problem of instances sending every activity 2 or 3 times would help with that, since even rejecting something as a duplicate must eat up some time.
Yes but now it must wait for acknowledgement of a request (activity), before sending the next one. If one request takes 333ms means you can do max 3 requests per second. Now big instances like lemmy.world have activity above that so instances too far will perpetual lag behind
Add comment