jan, to linux
@jan@kcore.org avatar

Has anyone ever seen the effect that a top-level recursive shows no more changes, but then going in the sub directories and doing individual rsyncs does give a lot of diff?

We're trying to figure out why that happens, and coming up empty.

Both FS are ext4, source server has been quieted (and FS even mounted r/o to make sure)

Rhel7 to rhel8. Rsync 3.1.2
Please boost.

abcdw, to hosting
@abcdw@fosstodon.org avatar

Found a cool SSH Apps project:
https://pico.sh/

Static sites, RSS feed to email digest, reverse ssh tunnels (for exposing local socket with public domain name), blog engine, pastebin and couple more.

All available via ssh/rsync.

tallship, to random
@tallship@fedia.social avatar

Yes! Yes! Yes!

As the saying goes, "Real BOFH use tar and rsync!"

The blog article is an excellent treatment of using tar along with SSH to effect a reliable backup plan and schedule.

Another couple of great fav GoTo solutions of mine have always been Duplicity and Duply for those not comfortable rolling their own scripts w/SSH, tar, and/or rsync ​:batman:​

Thank you very much for sharing this @nixCraft !!!

#tallship #DR #backup #tar #rsync #SSH #Systems_Administration You can haz #Cheezburgerz! 🍔

.

RE: mastodon.social/users/nixCraft/statuses/112276456842443382

defanor, to random

It is the "world day", at least according to WorldBackupDay.com. I like the idea of having such a day, to serve as another nudge and a reminder to make and check backups, though WorldBackupDay.com is awkward, does not mention rsync in its software section. The "com" TLD looks suspicious, too, but it is better than nothing (except for potential private data leaks with online backup services).

I use primarily encrypted external HDDs ( or with ) and for personal backups, including rsync with "--dry-run --checksum" for scrubbing and checking before synchronization; quite happy that such tools are available, even though they are usually taken for granted, as are many other neat FLOSS tools we use regularly. Planning to add a USB stick to the list of storage devices, since it should be less fragile mechanically (even though less reliable otherwise).

kzimmermann, to random
@kzimmermann@fosstodon.org avatar

I swear, using 's standard UI copy and paste into USB drives is infuriatingly slow. Frustrating to see the dialog file get stuck at 99% for many minutes when the copying took 30 seconds to complete.

Just open a terminal and run instead!

Zergy, to linux French
@Zergy@mastodon.zergy.net avatar

Ce week-end, j'ai testé la migration d'un système en faisant uniquement un RSync entre l'ancien et le nouveau disque d'un serveur.

ça a fonctionné sans problème. :rp_justok:

FiLiS, to FreeBSD
@FiLiS@mastodon.social avatar

'ing a ~10GB package directory /usr/local/poudriere/data/packages/foo elsewhere gets me a ~130GB target directory? What am I missing?
compression is turned on for both and compressratio is not really great, so that's not it. Using rsync -a, so nothing really special

unfa, to Help
@unfa@mastodon.social avatar

Any wizards in here? :)
I need some !

I've got some corruption on a 4TB Btrfs filesystem. I have all files in safe and ready to restore, but... I can't figure out HOW to restore them.

So far I've tried this:

rsync --verbose --human-readable --progress --checksum --archive --inplace --update --whole-file --existing --stats --times --partial --ignore-errors /backup/data /data/

However this failed to overwrite the corrupted files throwing an input/output error...

🤔

schenklklopfer, to random German
@schenklklopfer@chaos.social avatar

Ich brauch mal eure Hilfe!

Ich suche nach einem -Script/-Tool, das Daten von A nach B kopieren kann.
Es sollte nach Möglichkeit KEIN und verwenden.
Inkrementell.
Gerne mit ner kleinen Datenbank oder so...

Ansonsten bin ich für alles offen.

Will das kommerziell in der Firma nutzen, eine passende Lizenz wäre daher gut.

Idden?

320x200, to random
@320x200@post.lurk.org avatar

Syncthing and other similar software are great, but sometimes you just want a simple, lightweight, and fast way to mirror things, specially if the remote and/or local machines have limited resources.

Here is my ultra minimalistic set and forget (I hope) 2-in-1 rsync based mirror script that can be used in a cron and called manually at the same time. If there is a problem with the transfer, you even get an email.

https://things.bleu255.com/runyourown/One_way_fast_and_lightweight_file_mirroring

#rsync #ssh #shell #backup #mirror #sync

jschauma, to sysadmin
@jschauma@mstdn.social avatar

Hey Fediverse! The Spring semester is about to start, and I'll be teaching System Administration again:

https://stevens.netmeister.org/615/

Topics covered include: basic operating system & filesystem concepts, software installation & package management, config management, automation, tools development, TCP/IP networking, common services, system security.

All lectures are online as free videos; if you'd like to follow along, here's the playlist for Week 1:

https://www.youtube.com/playlist?list=PLDadzdouM0VCV7tjurqM8FHY6APK9wvJl

jschauma,
@jschauma@mstdn.social avatar

This week, our syllabus covers backups and restores, including use of dump(8), , and flux-capacitors (e.g., ZFS snapshots, Apple TimeMachine, NetApp's WAFL). We also were supposed to talk about and monitoring, but honestly, chances are we'll spend most of our time on the .

Playlist of lecture videos on :

https://www.youtube.com/playlist?list=PLDadzdouM0VArSooGALeG1U0y4_eYqJu8

sergi, to blogging
@sergi@floss.social avatar

I want to hear what you folks use to sync blogs/webpages over SFTP.

So, the setup is that you have a bunch of files (HTML, CSS, etc) on your local computer, and you want to update your hosting with the latest version, having only SFTP access.

I am mounting it locally with sshfs and then using "rsync -vuz --delete --recursive <source> <destination>", but I feel like there is a better way (or better rsync options).

#blogging #SFTP #FTP #sync #rsync

abcdw, to til
@abcdw@fosstodon.org avatar

Today I learned: if the scp (utility for copying files over SSH) process was interrupted, you can resume the transfer of the file(s) with rsync!

Especially handy with low-bandwidth and unstable connection.

Experimenting with almost forgotten old good stuff can have its own perks!

governa, to random
@governa@fosstodon.org avatar
mattkenworthy, to ai
@mattkenworthy@mastodon.social avatar

Possibly a foolish question for the Mastodon mind, but with now willing to trawl my data for purposes, is the concept of an invasive-free cloud drive impossible? Or should I stop worrying and learn to love over again?

osm_tech, to random
@osm_tech@en.osm.town avatar

Do you run a mirror of the data on planet.openstreetmap.org? We're changing how we serve planet files in a way that will impact you. Currently we have a medium amount of historic files available by HTTP and , but we're going to have all historic data available by HTTP with a redirect and limited data available by rsync. Rsync will eventually be shut down, but this is some time away.

Details at https://github.com/openstreetmap/operations/issues/961

fosslife, to linux
@fosslife@fosstodon.org avatar

Learn how to synchronize your data on a local or remote computer with rsync https://www.fosslife.org/synchronize-your-data-rsync

yisraeldov, to linux
@yisraeldov@linuxrocks.online avatar

Ok, so this seems like an obvious thing, but is there a better cp and mv command for , I want something that shows progress and speed etc. I know I can use but that seems like overkill

jhx, to linux
@jhx@fosstodon.org avatar

To anyone:

Use - one of the most amazing tools ever.
This is by far one of the first tools I install on any or system. 😎

On I use and install there 🙂

TerryHancock, to random
@TerryHancock@realsocial.life avatar

#AskFedi #Rsync

Hmm.

How does rsync know that a file has "changed"?

Relative to what?

Does it keep track of when it was last run?

Is there some kind of hidden file that it's using? Is it marking the files somehow?

Or does "changed" just mean "relative to the destination"?

And if it's that, then why is there an "update" option?

The man page is kind of vague on this.

Just want to make sure I'm not going to accidentally destroy important data.

saaste, to random Finnish
@saaste@mementomori.social avatar

Oletko rakentanut itsellesi varmuuskopiosysteemiä johonkin ulkoiseen palveluun? Onko suosituksia?

Itselläni on tällä hetkellä vain paikalliset backupit, jotka sijaitsevat erillisellä NAS:lla. Se on sijoitettu niin, että pystyn esimerkiksi tulipalon sattuessa ottamaan sen nopeasti matkaan ja viemään talosta ulos. Tästä on kuitenkin apua vain jos olen kotona ja moiseen temppuiluun on ylipäätään aikaa.

Itselleni mieluisin ratkaisu oli se, että saisin nykyisen NAS:in vietyä erilliseen rakennukseen ja olisin täysin riippumaton palveluista ja yrityksistä. Se ei vaan juuri nyt onnistu kovin helposti. Toiseksi paras vaihtoehto lienee siis tuo pilvitallennus.

Backblaze B2 on tullut monessa vastaan ja vaikuttaa varsin asialliselta ja yllättävän edulliselta. Saa jakaa kokemuksia jos sellaisia on. Myös vaihtoehdot ovat tervetulleita ☺️

amadeus, (edited ) to AdobePhotoshop
@amadeus@mstdn.social avatar
techsaviours, to AdGuard
@techsaviours@fosstodon.org avatar

A new "Your own extras" is available:

Check the new "Donation list" to support your favourite free and open source software.
It includes all the links with all the listed and we provide.

https://wiki.techsaviours.org/en/extras/donation_list

Still missing links:

chpietsch, to sysadmin
@chpietsch@digitalcourage.social avatar

Dear rsync pros, I have a question:

How can I filter a file that is being transferred? Rsync has a --filter option, but that can only filter the list of files – not the file contents.

I'd like to run sed on the file stream before it is stored.

Is there any way to do this?

jgoerzen, to random
@jgoerzen@floss.social avatar

If you're like me, you wish would work asynchronously.

It won't.

But it turns out the , which already is asynchronous-capable, can work like .

I wrote up how over here: https://www.complete.org/an-asynchronous-rsync-with-dar/

  • All
  • Subscribed
  • Moderated
  • Favorites
  • JUstTest
  • mdbf
  • Durango
  • thenastyranch
  • ngwrru68w68
  • InstantRegret
  • DreamBathrooms
  • modclub
  • magazineikmin
  • Youngstown
  • everett
  • ethstaker
  • slotface
  • rosin
  • anitta
  • kavyap
  • osvaldo12
  • GTA5RPClips
  • cisconetworking
  • provamag3
  • khanakhh
  • tacticalgear
  • cubers
  • Leos
  • normalnudes
  • megavids
  • tester
  • lostlight
  • All magazines