#EOTArchive
Hell. Yes. More info @eotarchive.org / #EOTArchive
The Internet Archive has to date downloaded 500 terabytes of US government websites, which it crawls at the end of every presidential term. The whole archive is fully searchable. This effort's housed by a donation-funded nonprofit, not a branch of the US government. blog.archive.org/2024/05/08/e...
End of Term Web Archive – Preserving the Transition of a Nation | Internet Archive Blogs
blog.archive.org
February 1, 2025 at 11:14 PM
looks like the #EOTArchive blog post has been shared quite a bit
February 1, 2025 at 8:00 PM
Among the other things the @internetarchive does; make archives of government websites at the end of each presidential term.

#InternetArchive #memoryhole

https://blog.archive.org/2024/05/08/end-of-term-web-archive/
End of Term Web Archive – Preserving the Transition of a Nation
<p>It’s that time again. The 2024 <a href="https://eotarchive.org/">End of Term crawl</a> has officially begun! The End of Term Web Archive #EOTArchive hosts an initiative named the End of Term crawl to archive U.S. government websites in the .gov and .mil web domains — as well as those harder-to-find government websites hosted on .org, .edu, and other top level domains (TLDs) — as one administrative term ends and a new term begins. </p> <p>End of Term crawls have been completed for term transitions in <a href="https://eotarchive.org/data/data-2004/">2004</a>, <a href="https://eotarchive.org/data/data-2008/">2008</a>, <a href="https://eotarchive.org/data/data-2012/">2012</a>, <a href="https://eotarchive.org/data/data-2016/">2016</a>, and <a href="https://eotarchive.org/data/data-2020/">2020</a>. The results of these efforts is preserved in the End of Term Web Archive. In total, over 500 terabytes of government websites and data have been archived through the End of Term Web Archive efforts. These archives can be searched full-text via the <a href="https://web.archive.org/">Internet Archive’s collections search</a> and also downloaded as bulk data for machine-assisted analysis.</p> <p>The purpose of the End of Term Web Archive is to preserve a record of government websites for historical and research purposes. It is important to capture these websites because they can provide a snapshot of government messaging before and after the transition of terms. The End of Term Web Archive preserves information that may no longer be available on the live web for open access.</p> <p>The End of Term Archive is a collaborative effort by the <a href="https://www.archive.org/">Internet Archive</a> along with the <a href="https://library.unt.edu/">University of North Texas</a> (UNT), Stanford University, <a href="https://www.loc.gov/">Library of Congress</a> (LC), U.S. <a href="https://www.gpo.gov/">Government Publishing Office</a> (GPO), and <a href="https://www.archives.gov/">National Archives and Records Administration</a> (NARA). Past partners include the <a href="http://www.cdlib.org/">University of CA’s California Digital Library</a> (CDL), <a href="https://www.gwu.edu/">George Washington University</a>, and the <a href="https://envirodatagov.org/">Environmental Data and Governance Initiative</a> (EDGI).</p> <figure class="wp-block-image size-large is-resized"><a href="http://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage.png"><img alt="Four images of Whitehouse.gov captured between 2008 and 2020" class="wp-image-27400" decoding="async" height="466" sizes="(max-width: 654px) 100vw, 654px" src="http://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-1024x731.png" srcset="https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-1024x731.png 1024w, https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-300x214.png 300w, https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-1536x1097.png 1536w, https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-2048x1463.png 2048w, https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-624x446.png 624w" width="654"/></a><figcaption class="wp-element-caption"><em>Whitehouse.gov captures from: <a href="https://web.archive.org/web/20080915222725/http://www.whitehouse.gov/">2008 Sept. 15</a>; <a href="https://web.archive.org/web/20130321232018/http://www.whitehouse.gov//">2013 Mar. 21</a>; <a href="https://web.archive.org/web/20170203225337/https://www.whitehouse.gov/">2017 Feb. 3</a>; and <a href="https://web.archive.org/web/20210225225137/https://www.whitehouse.gov/">2021 Feb. 25</a></em><br/></figcaption></figure> <p>We are committed to preserving a record of U.S. government websites. But we need your help to complete the 2024 End of Term crawl. </p> <div class="wp-block-image"> <figure class="alignleft size-large is-resized"><a href="http://blog.archive.org/wp-content/uploads/2024/05/NASA_We-Need-You-e1715046603410.png"><img alt="NASA/KSC We Need You Mars Poster" class="wp-image-27404" decoding="async" height="346" loading="lazy" src="http://blog.archive.org/wp-content/uploads/2024/05/NASA_We-Need-You-640x1024.png" width="216"/></a><figcaption class="wp-element-caption"><em>NASA <a href="http://science.nasa.gov/resource/we-need-you">We Need You Mars Poster</a></em></figcaption></figure></div> <p><strong>How can you help?! </strong></p> <p>We have a list of top level domains from the General Services Administration (GSA) and from previous End of term crawls. But we need volunteers to help us out. We are currently accepting nominations for websites to be included in the 2024 End of Term Web Archive.</p> <p>Submit a url nomination by going to <a href="https://digital2.library.unt.edu/nomination/eth2024/">digital2.library.unt.edu/nomination/eth2024/</a>. <br/>We encourage you to nominate any and all U.S. federal government websites that you want to make sure get captured. Nominating urls deep within .gov/.mil websites helps to make our web crawls as thorough and complete as possible. </p> <p>Individuals and institutions nominating seed urls are recognized on the <a href="https://digital2.library.unt.edu/nomination/eth2024/reports/metadata/nominator/">individual contributors leaderboard</a> and the <a href="https://digital2.library.unt.edu/nomination/eth2024/reports/metadata/institution/">institutions leaderboard</a>!<br/><br/><strong>Explore the End of Term Web Archive with </strong><a href="https://web.archive.org/EndOfTerm2020WebCrawls/search/Climate"><strong>full text search</strong></a><strong> and </strong><a href="https://eotarchive.org/data/"><strong>download the data</strong></a><strong>!</strong></p>
blog.archive.org
February 3, 2025 at 6:54 PM
While not on Mastodon, the End of Term archive has bridged their Bluesky account over

@eotarchive.org

#datahoarder #eotarchive
February 5, 2025 at 5:00 AM
Just emailed this info- How to Access the EOT Web Archives

Visit web.archive.org
Scroll to 🔎Collection Search section
Select "End Of Term (US Gov 2024)" from the menu
Type in your query term and click search

Or download bulk WARC files from eotarchive.org/data/
#EOT2024 #EOTArchive
Wayback MachineHamburger iconInternet Archive logoWeb iconTexts iconVideo iconAudio iconSoftware iconImages iconDonate iconEllipses iconDonate iconUser iconUpload iconSearch iconSearch iconSearch icon...
web.archive.org
February 1, 2025 at 3:16 PM
University of North Texas is now accepting seed nominations for post-EOT crawls:
digital2.library.unt.edu/nomination/G...

Crawls from this seed list will not be a part of the #EOT2024 #EOTArchive
digital2.library.unt.edu
April 1, 2025 at 5:15 PM
We are wrapping up seed list nominations for #EOT2024.

Going forward, you can submit government URL nominations using a similar tool: digital2.library.unt.edu/nomination/G...

Crawls of post-EOT seeds won’t be part of the #EOTArchive, but will appear in the @archive.org Wayback Machine
Nomination Tool: About Project
digital2.library.unt.edu
April 1, 2025 at 4:17 AM
@archive.org is an #EOTArchive team member, that has been archiving the public web since 1996.

As with many supporting orgs they crawl every seeded federal government URL. These crawl efforts contribute to our 700+ terabytes of public WebArchive (WARC) files #EOT2024
npr.org NPR @npr.org · Mar 24
The Trump administration's erasure of federal data has put the Internet Archive in the spotlight. The organization, with its small but mighty team, is working to help save the world's digital history.
As the Trump administration purges web pages, this group is rushing to save them
The Trump administration's erasure of federal data has put the Internet Archive in the spotlight. The organization, with its small but mighty team, is working to help save the world's digital history.
www.npr.org
March 26, 2025 at 12:34 AM
🗽 Give us your hidden, your overlooked,

Your orphaned Gov URLs yearning to be preserved,

The forgotten databases of your civic shore.

Send these, the neglected, the soon-to-vanish, to us—

We lift our crawler beside the open web. 🗽

#EOTArchive #EOT2024
March 21, 2025 at 3:15 PM
Some federal webpages contain interactive elements that are best preserved using high-fidelity web archiving. Our team member @webrecorder.net has written about handling these efforts in a blog by @ilya.webrecorder.net

#EOTArchive #EOT2024
Preserving Government Websites with Browsertrix • Webrecorder Blog
A collaborative effort alongside the End of Term Web Archive to capture and save history.
webrecorder.net
March 1, 2025 at 5:20 AM
The US Constitution states that the power of the President changes at noon on the 20th. At noon in DC (3hrs ago) the WH homepage changed as well from
web.archive.org/web/20250105... to www.whitehouse.gov

We'll include both versions in the End Of Term web archive #EOT2024 #EOTArchive
January 20, 2025 at 8:12 PM
For those interested in a deep dive. Last weeks End Of Term web archive presentation by James R Jacobs @freegovinfo.bsky.social to Gov Info Watch is online at:
archive.org/details/eot-presentation-jacobs-20241205
And the slides are available at
govinfowatch.net

#EOTArchive #EOT2024
EOT Presentation Jacobs 20241205 : James R. Jacobs : Free Download, Borrow, and Streaming : Internet Archive
Zoom presentation by James R. Jacobs about the End of Term project (https://eotarchive.org). This talk was organized by Patrice McDermott of Government...
archive.org
December 12, 2024 at 9:32 PM
How to Access the EOT Web Archives

Visit web.archive.org
Scroll to 🔎Collection Search section
Select "End Of Term (US Gov 2024)" from the menu
Type in your query term and click search

Or download bulk WARC files from eotarchive.org/data/
#EOT2024 #EOTArchive
December 9, 2024 at 6:38 PM
Every US presidential election period we do a wide crawl of all federal websites.

YOU can contribute to the 2024 End of Term Web Archive eotarchive.org/contribute/

- Nominate Gov URLs
- Upload bulk seed lists
- Help surface database deep links
- Spread the word #EOT2024 #EOTArchive
Contribute
The End of Term Web Archive is a collaborative initiative that collects, preserves, and makes accessible United States Government websites at the end of presidential administrations.
eotarchive.org
November 25, 2024 at 8:28 PM
End of Term Web Archive | The End of Term Web Archive is a collaborative initiative that collects, preserves, and makes accessible United States Government websites at the end of presidential administrations. https://eotarchive.org/
eotarchive.org eotarchive end-of-termeot-info@archive.org The End of Term Web Archive is a collaborative initiative that collects, preserves, and makes accessible United States Government websites at the end of presidential administrations.
eotarchive.org
February 1, 2025 at 3:49 PM
End of Term Web Archive – Preserving the Transition of a Nation
<p>It’s that time again. The 2024 <a href="https://eotarchive.org/">End of Term crawl</a> has officially begun! The End of Term Web Archive #EOTArchive hosts an initiative named the End of Term crawl to archive U.S. government websites in the .gov and .mil web domains — as well as those harder-to-find government websites hosted on .org, .edu, and other top level domains (TLDs) — as one administrative term ends and a new term begins. </p> <p>End of Term crawls have been completed for term transitions in <a href="https://eotarchive.org/data/data-2004/">2004</a>, <a href="https://eotarchive.org/data/data-2008/">2008</a>, <a href="https://eotarchive.org/data/data-2012/">2012</a>, <a href="https://eotarchive.org/data/data-2016/">2016</a>, and <a href="https://eotarchive.org/data/data-2020/">2020</a>. The results of these efforts is preserved in the End of Term Web Archive. In total, over 500 terabytes of government websites and data have been archived through the End of Term Web Archive efforts. These archives can be searched full-text via the <a href="https://web.archive.org/">Internet Archive’s collections search</a> and also downloaded as bulk data for machine-assisted analysis.</p> <p>The purpose of the End of Term Web Archive is to preserve a record of government websites for historical and research purposes. It is important to capture these websites because they can provide a snapshot of government messaging before and after the transition of terms. The End of Term Web Archive preserves information that may no longer be available on the live web for open access.</p> <p>The End of Term Archive is a collaborative effort by the <a href="https://www.archive.org/">Internet Archive</a> along with the <a href="https://library.unt.edu/">University of North Texas</a> (UNT), Stanford University, <a href="https://www.loc.gov/">Library of Congress</a> (LC), U.S. <a href="https://www.gpo.gov/">Government Publishing Office</a> (GPO), and <a href="https://www.archives.gov/">National Archives and Records Administration</a> (NARA). Past partners include the <a href="http://www.cdlib.org/">University of CA’s California Digital Library</a> (CDL), <a href="https://www.gwu.edu/">George Washington University</a>, and the <a href="https://envirodatagov.org/">Environmental Data and Governance Initiative</a> (EDGI).</p> <figure class="wp-block-image size-large is-resized"><a href="http://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage.png"><img alt="Four images of Whitehouse.gov captured between 2008 and 2020" class="wp-image-27400" decoding="async" height="466" sizes="(max-width: 654px) 100vw, 654px" src="http://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-1024x731.png" srcset="https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-1024x731.png 1024w, https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-300x214.png 300w, https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-1536x1097.png 1536w, https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-2048x1463.png 2048w, https://blog.archive.org/wp-content/uploads/2024/05/Whitehouse_Homepage-624x446.png 624w" width="654"/></a><figcaption class="wp-element-caption"><em>Whitehouse.gov captures from: <a href="https://web.archive.org/web/20080915222725/http://www.whitehouse.gov/">2008 Sept. 15</a>; <a href="https://web.archive.org/web/20130321232018/http://www.whitehouse.gov//">2013 Mar. 21</a>; <a href="https://web.archive.org/web/20170203225337/https://www.whitehouse.gov/">2017 Feb. 3</a>; and <a href="https://web.archive.org/web/20210225225137/https://www.whitehouse.gov/">2021 Feb. 25</a></em><br/></figcaption></figure> <p>We are committed to preserving a record of U.S. government websites. But we need your help to complete the 2024 End of Term crawl. </p> <div class="wp-block-image"> <figure class="alignleft size-large is-resized"><a href="http://blog.archive.org/wp-content/uploads/2024/05/NASA_We-Need-You-e1715046603410.png"><img alt="NASA/KSC We Need You Mars Poster" class="wp-image-27404" decoding="async" height="346" loading="lazy" src="http://blog.archive.org/wp-content/uploads/2024/05/NASA_We-Need-You-640x1024.png" width="216"/></a><figcaption class="wp-element-caption"><em>NASA <a href="http://science.nasa.gov/resource/we-need-you">We Need You Mars Poster</a></em></figcaption></figure></div> <p><strong>How can you help?! </strong></p> <p>We have a list of top level domains from the General Services Administration (GSA) and from previous End of term crawls. But we need volunteers to help us out. We are currently accepting nominations for websites to be included in the 2024 End of Term Web Archive.</p> <p>Submit a url nomination by going to <a href="https://digital2.library.unt.edu/nomination/eth2024/">digital2.library.unt.edu/nomination/eth2024/</a>. <br/>We encourage you to nominate any and all U.S. federal government websites that you want to make sure get captured. Nominating urls deep within .gov/.mil websites helps to make our web crawls as thorough and complete as possible. </p> <p>Individuals and institutions nominating seed urls are recognized on the <a href="https://digital2.library.unt.edu/nomination/eth2024/reports/metadata/nominator/">individual contributors leaderboard</a> and the <a href="https://digital2.library.unt.edu/nomination/eth2024/reports/metadata/institution/">institutions leaderboard</a>!<br/><br/><strong>Explore the End of Term Web Archive with </strong><a href="https://web.archive.org/EndOfTerm2020WebCrawls/search/Climate"><strong>full text search</strong></a><strong> and </strong><a href="https://eotarchive.org/data/"><strong>download the data</strong></a><strong>!</strong></p>
blog.archive.org
February 1, 2025 at 2:38 AM
@davidho.bsky.social

Fortunately, backups have been made by a number of organizations including :

https://eotarchive.org/
eotarchive.org eotarchive end-of-termeot-info@archive.org The End of Term Web Archive is a collaborative initiative that collects, preserves, and makes accessible United States Government websites at the end of presidential administrations.
eotarchive.org
February 3, 2025 at 5:03 AM
Full data.gov backup available for anyone to access / copy (~100GB)

"This does not include webpages themselves, as those have already largely been archived by projects like EOTArchive and the Wayback Machine."

https://www.reddit.com/r/DataHoarder/comments/1ife9p1/datacdcgov_full_archive/ […]
Original post on cosocial.ca
cosocial.ca
February 1, 2025 at 9:39 PM
Please share this widely...digital history is just as fragile and ephemeral as the analog kind, maybe more so in these days of power outages, hackings and oligarchs intent on rewriting it.

https://eotarchive.org/
eotarchive.org eotarchive end-of-termeot-info@archive.org The End of Term Web Archive is a collaborative initiative that collects, preserves, and makes accessible United States Government websites at the end of presidential administrations.
eotarchive.org
January 9, 2025 at 5:40 PM
Yes, the eotarchive "contains federal government websites (.gov, .mil, etc) in the Legislative, Executive, or Judicial branches of the government. Websites that were at risk of changing (i.e., whitehouse.gov) or disappearing altogether during government transitions were captured."

eotarchive.org
End of Term Web Archive
The End of Term Web Archive is a collaborative initiative that collects, preserves, and makes accessible United States Government websites at the end of presidential administrations.
eotarchive.org
March 5, 2025 at 3:36 PM
Hi 👋 sorry to interrupt.
Just wanted to let you know that @eotarchive.org is still taking URL nominations. We are still archiving U.S. government websites.
#EOTArchive #EOT2024
March 20, 2025 at 11:49 PM
The #EOT2024 is still taking Gov URL nominations up until inauguration day. So please send them in ASAP #EOTArchive
Thank you for your government URL nominations!

Bulk Nomination - 886,998 Nominated URLs
Human Nominations - 9,267
More than 200 Nominators!

Gov URLs for the End Of Term web crawl are still welcomed, but send them urgently, we cutoff nominations in a few days.
January 16, 2025 at 10:12 PM
🏛️ The End of Term Web Crawl has begun!

Submit any government URLs for inclusion into the 2024 #EOTArchive

Check out the preserved 2008 to 2020 transitions and help us add URLs to the current effort, more details in the announcement blog:
blog.archive.org/2024/05/08/e...
End of Term Web Archive – Preserving the Transition of a Nation | Internet Archive Blogs
blog.archive.org
May 13, 2024 at 7:37 PM