sigh The #postgresql logical replication process that has been running for around 3 weeks failed upon completion last night.
ERROR: table copy could not finish transaction on publisher: FATAL: terminating connection due to idle-in-transaction timeout
SSL connection has been closed unexpectedly
Time for google I suppose and an email to our on-retainer postgres expert.
Moving billions of records from one database to another is a PITA yo.
@ascherbaum@argv_minus_one Yeah. We’ve got 1.5 billion records that we’re trying to move from one AWS RDS instance to another and the pub is v12 and the sub is v16. From what I’ve read having the pub be v12 limits us on the options and tooling we have at our disposal to reduce records to replicate.
FWIW I had created a user which is executing the replication and set the statement_timeout to 0. And I was wrong, I think this takes about 10 days to do.
Add comment