nurkiewicz, to random
@nurkiewicz@fosstodon.org avatar

" Migrates 1 Trillion Records from to LedgerStore to Save $6 Million Annually". The interesting part was the migration itself that took 3 months. This means about 130k records/s running 24/7 for 90 days. https://www.infoq.com/news/2024/05/uber-dynamodb-ledgerstore/

nurkiewicz, to Java
@nurkiewicz@fosstodon.org avatar

I don't expect anyone to still believe that is slow. But if you do, remember that the following tools are all written in Java or other languages: , , , , , ...

schizanon, to AWS

I'm still getting my head around #dynamodb

In order to sort items in a table you use a "sort key", but then when you want to delete one of the items in the table you then have to provide the primary key and the sort key.

I get why; it's partitioning based on keys, and the sort key is part of the compound key, so it needs it to fully address the row you're deleting.

It's just... unusual.

#AWS #noSQL #database #webDev #databases

falken, to email
@falken@qoto.org avatar

I open sourced a thing for aggregation of DMARC reports from multiple domains.

https://codeberg.org/falken/dmarc-report

schizanon, to mastodon

I want to build something and I need to say my plans out loud, but I don't have any friends let alone any that use or so I'm just gonna info dump here:

#🦆 #🧵

schizanon,

I'll be doing this in --either in a Lambda or the browser--so I'll probably use

I've never really done in before so I'll have my work cut out for me.

I understand the high level process; tokenize, calculate a vector space, so some crazy matrix multiplication.

The real trick will be how to persist the vectors in and efficiently calculate the scores with fast moving timelines.

kerfuffle, (edited ) to AWS
@kerfuffle@mastodon.online avatar

I wrote a blog describing how I translated a feature request into a , where the events we're interested in convey nothing happening for a certain amount of time.

But before I arrived at my current solution, I considered other solutions. I describe those as well, and explain their shortcomings.

It involves , DynamoDB Streams, and (), with some context mapping considerations thrown into the mix.

https://blog.jdriven.com/2023/10/handling-dynamodb-ttl-expiry-events-with-aws-lambda-and-dynamodb-streams/

schizanon, to AWS

I fixed https://schizo.social's auth; had to index my with a composite primary key ( is an art)

I'm a bit stumped about what to work on next.

The load time for the timelines bothers me; it's still occasionally timing out just loading 20 toots from two servers. I feel like introducing a is my only choice, but I don't like the idea of adding client-side rendering.

schizanon, to AWS

I've already hit 's default 5s timeout fetching just two timelines with https://schizo.social. I'm going to need a more clever solution for making multiple API requests to build a single page. Maybe prefetching, maybe spawning a background process and updating the UI via a when they complete? I'm trying to keep it as client-side free as I can, but waiting on multiple masto servers just isn't going to work...

schizanon,

@licked testing is plenty helpful! I have lots of options; https://arc.codes supports , and webSockets. I'm just trying to keep it as simple as I can, so I'm being conservative. I made the repo public if you want to have a look; https://github.com/jessehattabaugh/schizo-social

schizanon, (edited ) to webdev
brianleroux, to random

Managed vendor solutions performance compared by @tbeseda (spoiler: is fast)

https://begin.com/blog/posts/2023-06-06-dbaas-in-lambda

estherschindler, to random
@estherschindler@hachyderm.io avatar

We benchmarked read and update performance by running common workloads with a fixed dataset size of 50GB (plus replications) and multiple throughput levels (measured by operations per second) across two popular SDBaaS solutions: Amazon and Enterprise Cloud. No matter which workload we tested, Redis Enterprise Cloud maintained an end-to-end latency of 0.5-0.6 msec.
https://redis.com/blog/serverless-databases-as-a-service/

  • All
  • Subscribed
  • Moderated
  • Favorites
  • megavids
  • mdbf
  • ngwrru68w68
  • tester
  • magazineikmin
  • thenastyranch
  • rosin
  • khanakhh
  • InstantRegret
  • Youngstown
  • slotface
  • Durango
  • kavyap
  • DreamBathrooms
  • JUstTest
  • tacticalgear
  • osvaldo12
  • normalnudes
  • cubers
  • cisconetworking
  • everett
  • GTA5RPClips
  • ethstaker
  • Leos
  • provamag3
  • anitta
  • modclub
  • lostlight
  • All magazines