I've written a little post about the National Library of Australia's collection of archived websites in Pandora and the new #GLAMWorkbench section that helps you to work with the data.
Want to find websites from Australian elections back to 1996? Just go to Pandora. Want all the urls in a spreadsheet? Just run my new notebook.
If you haven't used it before browsertrix-crawler is an amazing tool that lets you create standardized #webarchives using a browser-based crawler on your computer using Docker.
It's kinda like wget but it actually renders the pages, and lets you write site specific, customized behaviors for archiving especially difficult to collect content.
UNT are always pushing the boundaries of what can be done in digital libraries and #webarchives in particular. On a call yesterday I learned from Lauren Ko that they have started to archive web resources cited in student's dissertations.
Each archived page is bundled into a dissertation specific WACZ file (a ZIP with metadata), which can then "played back" on the dissertation's web page using @webrecorder's ReplayWebPage web component.
#Twitter just #shadowbanned my PhD advisor Michael L. Nelson. He was covering how the wife of the US Speaker of the House had an anti-#LBTQ+ website and just took it down, but it’s still in #webarchives. Due to the #shadowban, we can view the tweets by URL, but cannot view the whole thread. He’s asked us to #retweet him in hopes of: (1) getting the word out about the shadowban, and (2) overcoming the shadowban (unlikely).
A screenshot of four posts from a Twitter thread that read “This Post is unavailable. Learn more.”
A screenshot of a tweet from @phonedude_mln, somehow half blocked. The tweet above it in the thread reads “This Post is unavailable. Learn more” but the tweet under that reads: But the problematic text (pictured) is not in the website, it’s in the: “OPERATING AGREEMENT of ONWARD CHRISTIAN COUNSELING SERVICES, LLC" Which is a PDF linked from the web site. Underneath this is an image of text that reads: Marriage and Sexuality. We believe the term "marriage" has only one meaning and that is marriage sanctioned by God which joins one man and one woman in a single, exclusive union, as delineated in Scripture. We believe that God intends sexual intimacy to only occur between a man and a woman who are married to each other. We believe that God has commanded that no intimate sexual activity be engaged in outside of a marriage between a man and a woman. We believe and the Bible teaches that any form of sexual immorality, such as adultery, fornication, homosexuality, bisexual conduct, bestiality, incest, pornography or any attempt to change one's sex, or disagreement with one's biological sex, is sinful and offensive to God. We believe that in order to preserve the function and integrity of the Company, and to provide a biblical role model to the clients and the community, it is imperative that all persons employed by the Company in any capacity should abide by and agree to this statement on marriage and sexuality and conduct themselves accordingly. Because we believe in ...
A screenshot of a tweet from @phonedude_mln Michael L. Nelson that reads: The original @HuffPost article has a copy of the PDF hosted in scribd. There appears to be an original (?) copy of the pdf still available at: https://6ea37b86-6bd5-478a-93e4-d7e6f6a280b0.filesusr.com/ugd/a430fd_5bf898e6d0c044cfb4a8b4c5f387c63f.pdf "fileusr. com" is apparently a hosting service for Wix.