{"id":3964,"date":"2019-12-15T14:49:19","date_gmt":"2019-12-15T14:49:19","guid":{"rendered":"https:\/\/miloserdov.org\/?p=3964"},"modified":"2019-12-15T14:49:19","modified_gmt":"2019-12-15T14:49:19","slug":"internet-archives-how-to-retrieve-deleted-information-how-to-restore-sites-from-internet-archives","status":"publish","type":"post","link":"https:\/\/miloserdov.org\/?p=3964","title":{"rendered":"Internet archives: how to retrieve deleted information. How to restore sites from Internet archives"},"content":{"rendered":"<div class=\"0b20205ac99e89c6cabdb919fd9d1a8a\" data-index=\"1\" style=\"float: none; margin:10px 0 10px 0; text-align:center;\">\n<script async src=\"\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block; text-align:center;\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout=\"in-article\"\r\n     data-ad-client=\"ca-pub-7219829351026140\"\r\n     data-ad-slot=\"9942251718\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script>\r\n\r\n\n<\/div>\n<h2 style=\"text-align: justify;\">\n\tWhat is Wayback Machine and the Internet Archives<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tIn this article we will consider Web Archives of sites or Internet archives: how to recover removed from sites information, how to download non-existent anymore sites and other examples and use cases.\n<\/p>\n<p style=\"text-align: justify;\">\n\tThe principle of operation of all Internet Archives is similar: someone (any user) indicates a page to save. The Internet Archive downloads it, including text, images and design styles, and then saves it. Upon request, the saved page can be viewed from the Internet Archive, and it does not matter if the original page has changed or the site is currently unavailable or completely ceased to exist.\n<\/p>\n<p style=\"text-align: justify;\">\n\tMany Internet Archives store several versions of the same page, taking a snapshot of it at different times. Thanks to this, you can trace the history of changes to the site or web page throughout the years of its existence.\n<\/p>\n<p style=\"text-align: justify;\">\n\tThis article will show how to find deleted or changed information, how to use the Internet Archives to restore sites, individual pages or files, as well as some other use cases.\n<\/p>\n<p style=\"text-align: justify;\">\n\tWayback Machine is the name of one of the popular Internet archive sites. Sometimes the Wayback Machine is used as a synonym for Internet Archive.\n<\/p>\n<h2 style=\"text-align: justify;\">\n\tWhat Internet archives exist?<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tI know about three archives of websites (if you know more, then write them in the comments):\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"https:\/\/web.archive.org\/\" rel=\"noopener noreferrer\" target=\"_blank\">https:\/\/web.archive.org\/<\/a>\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"http:\/\/archive.md\/\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/archive.md\/<\/a> (also uses the <a href=\"http:\/\/archive.ph\/\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/archive.ph\/<\/a> and <a href=\"http:\/\/archive.today\/\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/archive.today\/<\/a> domains)\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"http:\/\/web-arhive.ru\/\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/web-arhive.ru\/<\/a>\n\t<\/li>\n<\/ul>\n<h2 style=\"text-align: justify;\">\n\tweb.archive.org<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tThis web archive service is also known as the <a href=\"https:\/\/web.archive.org\/\" rel=\"noopener noreferrer\" target=\"_blank\">Wayback Machine<\/a>. It has various additional functions, most often used by tools to restore sites and information.\n<\/p>\n<p style=\"text-align: justify;\">\n\tTo save the page to the archive, go to <a href=\"https:\/\/archive.org\/web\/\" rel=\"noopener noreferrer\" target=\"_blank\">https:\/\/archive.org\/web\/<\/a> enter the address of the page you are interested in and click the &lsquo;<strong>SAVE PAGE<\/strong>&rsquo; button.\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-3.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3979\" height=\"148\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-3.png\" width=\"530\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tTo view the available saved versions of the web page, go to <a href=\"https:\/\/archive.org\/web\/\" rel=\"noopener noreferrer\" target=\"_blank\">https:\/\/archive.org\/web\/<\/a>, enter the address of the page you are interested in or the domain of the website and click &lsquo;<strong>BROWSE HISTORY<\/strong>&rsquo;:\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org_.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3981\" height=\"114\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org_.png\" width=\"818\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org_.png 818w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org_-768x107.png 768w\" sizes=\"(max-width: 818px) 100vw, 818px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tAt the very top it says how many total snapshots of the page have been taken, the date of the first and last snapshot.\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org-2.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3980\" height=\"851\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org-2.png\" width=\"1231\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org-2.png 1231w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org-2-1000x691.png 1000w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.org-2-768x531.png 768w\" sizes=\"(max-width: 1231px) 100vw, 1231px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tThen there is a time scale on which you can select the year of interest, when choosing a year, the calendar will be updated.\n<\/p>\n<p style=\"text-align: justify;\">\n\tPlease note that the calendar does not show the number of changes on the site, but the number of times the page was archived.\n<\/p>\n<p style=\"text-align: justify;\">\n\tDots on the calendar mean different events, different colors have different meanings about web capture. <span style=\"background-color:#40E0D0;\">Blue<\/span> means that when archiving the page from the web server, a 2nn response code was received (everything is fine); <span style=\"background-color:#00FF00;\">green<\/span> means that the crawler has received the status 3nn (redirection); <span style=\"background-color:#FFA500;\">orange<\/span> means that the status is 4nn (error on the client side, for example, the page was not found), and <span style=\"background-color:#FF0000;\">red<\/span> means that the archiving received a 5nn error (server problems). Most likely, you should be interested in blue and green dots and links.\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/calendar.jpg\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3966\" height=\"667\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/calendar.jpg\" width=\"976\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/calendar.jpg 976w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/calendar-768x525.jpg 768w\" sizes=\"(max-width: 976px) 100vw, 976px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tWhen you click on the selected time, a link will be opened, for example, http:\/\/web.archive.org\/web\/20160803222240\/https:\/\/hackware.ru\/ and you will be shown how the page looked at that time:\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-4.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3978\" height=\"756\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-4.png\" width=\"1208\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-4.png 1208w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-4-1000x626.png 1000w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-4-768x481.png 768w\" sizes=\"(max-width: 1208px) 100vw, 1208px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tUsing these icons, you can go to the next page snapshot, or jump to the desired date:\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-6.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3977\" height=\"70\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-6.png\" width=\"235\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tThe best way to see all the files that have been archived for a particular site is to open a link like http:\/\/web.archive.org\/*\/www.yoursite.com\/*, for example, <a href=\"http:\/\/web.archive.org\/*\/hackware.ru\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/web.archive.org\/*\/hackware.ru<\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tIn addition to the calendar, the following pages are available:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\t<strong>Collections<\/strong>. Available as additional features for registered users and by subscription.\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<strong>Changes<\/strong>\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<strong>Summary<\/strong>\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<strong>Site map<\/strong>\n\t<\/li>\n<\/ul>\n<h3 style=\"text-align: justify;\">\n\tChanges<br \/>\n<\/h3>\n<p style=\"text-align: justify;\">\n\t&lsquo;Changes&rsquo; is a tool that you can use to identify and display changes to the contents of archived URLs.\n<\/p>\n<p style=\"text-align: justify;\">\n\tYou can start by selecting two different days of a URL. To do this, click on the appropriate points:\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-7.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3976\" height=\"550\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-7.png\" width=\"876\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-7.png 876w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-7-768x482.png 768w\" sizes=\"(max-width: 876px) 100vw, 876px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tAnd click the Compare button. As a result, two page options will be shown. <span style=\"background-color:#FFFF00;\">Yellow<\/span> indicates deleted content, and <span style=\"background-color:#ADD8E6;\">blue<\/span> indicates added content.\n<\/p>\n<h3 style=\"text-align: justify;\">\n\tSummary<br \/>\n<\/h3>\n<p style=\"text-align: justify;\">\n\tIn this tab, statistics on the number of changes of MIME types.\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-8.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3975\" height=\"935\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-8.png\" width=\"1147\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-8.png 1147w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-8-1000x815.png 1000w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-8-768x626.png 768w\" sizes=\"(max-width: 1147px) 100vw, 1147px\" \/><\/a>\n<\/p>\n<h3 style=\"text-align: justify;\">\n\tSite map<br \/>\n<\/h3>\n<p style=\"text-align: justify;\">\n\tAs the name implies, a site map diagram is shown here, using which you can go to the archive of the page you are interested in.\n<\/p>\n<h3 style=\"text-align: justify;\">\n\tSearch the Internet archive<br \/>\n<\/h3>\n<p style=\"text-align: justify;\">\n\tIf instead of the page address you enter something else, a search will be performed on the archived sites:\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-9.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3974\" height=\"851\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-9.png\" width=\"823\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-9.png 823w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/web.archive.org-9-768x794.png 768w\" sizes=\"(max-width: 823px) 100vw, 823px\" \/><\/a>\n<\/p>\n<h3 style=\"text-align: justify;\">\n\tDisplay page for a specific date<br \/>\n<\/h3>\n<p style=\"text-align: justify;\">\n\tIn addition to using the calendar to go to the desired date, you can view the page for the desired date using the following link: <strong>http:\/\/web.archive.org\/web\/YYYYMMDDHHMMSS\/PAGE_ADDRESS\/<\/strong>\n<\/p>\n<p style=\"text-align: justify;\">\n\tPlease note that in the line <strong>YYYYMMDDHHMMSS<\/strong> you can skip any numbers of trailing digits.\n<\/p>\n<p style=\"text-align: justify;\">\n\tIf no archive copy is found on the required date, the version for the closest available date will be displayed.\n<\/p>\n<h2 style=\"text-align: justify;\">\n\tarchive.md<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tAddresses of this Internet Archive:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"http:\/\/archive.md\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/archive.md<\/a>\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"http:\/\/archive.ph\/\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/archive.ph\/<\/a>\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"http:\/\/archive.today\/\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/archive.today\/<\/a>\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tOn the main page, the self-explanatory fields are:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\t<strong>Archive page that is now online<\/strong>\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<strong>Search saved pages<\/strong>\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.today_.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3973\" height=\"672\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.today_.png\" width=\"994\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.today_.png 994w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/archive.today_-768x519.png 768w\" sizes=\"(max-width: 994px) 100vw, 994px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tTo search the saved pages, you can specify either a specific URL or domains, for example:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\t<strong>microsoft.com<\/strong> will show pictures from host microsoft.com\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<strong>*.microsoft.com<\/strong> will show pictures from the host microsoft.com and all its subdomains (for example, www.microsoft.com)\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<strong>http:\/\/twitter.com\/burgerkingfor<\/strong> will show the archive of the given url (search is case sensitive)\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<strong>http:\/\/twitter.com\/burg*<\/strong> search for archived url starting with http:\/\/twitter.com\/burg\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tThis service saves the following parts of the page:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\tWeb page text content\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\tImages\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\tFrame content\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\tContent and images uploaded or generated using Javascript on Web 2.0 sites\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\tScreenshots of 1024&#215;768 pixels.\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tThe following parts of web pages are not saved:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\tFlash and the content it uploads\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\tVideo and Sounds\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\tPdf\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\tRSS and other XML pages are unreliable. Most of them are not saved, or saved as blank pages.\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tThe archived page and all images must be less than 50 megabytes.\n<\/p>\n<p style=\"text-align: justify;\">\n\tFor each archived page, a link of the form <strong>http:\/\/archive.is\/XXXXX<\/strong> is created, where <strong>XXXXX<\/strong> is the unique identifier of the page. Also, any saved page can be accessed as follows:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/2013\/http:\/\/www.google.de\/ is the newest snapshot in 2013.\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/201301\/http:\/\/www.google.de\/ &#8211; the newest snapshot in January 2013.\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/20130101\/http:\/\/www.google.de\/ &#8211; the newest snapshot on the day of January 1, 2013.\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tThe date can be continued further by indicating hours, minutes and seconds:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/2013010103\/http:\/\/www.google.de\/\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/201301010313\/http:\/\/www.google.de\/\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/20130101031355\/http:\/\/www.google.de\/\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tTo improve readability, the year, month, day, hours, minutes, and seconds can be separated by periods, dashes, or colons:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/2013-04-17\/http:\/\/blog.bo.lt\/\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/2013.04.17-12:08:20\/http:\/\/blog.bo.lt\/\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tIt is also possible to refer to all snapshots of the specified URL:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/http:\/\/www.google.de\/\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tAll saved domain pages:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/www.google.de\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tAll saved pages of all subdomains\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/*.google.de\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tTo access the latest version of a page in the archive or the oldest, addresses of the form are supported:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/newest\/http:\/\/reddit.com\/\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/oldest\/http:\/\/reddit.com\/\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tTo access a specific part of a long page, there are two options:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\tadd a hashtag (<strong>#<\/strong>) with a scroll position in the quality of which the number is between 0 (top of the page) and 100 (bottom of the page). For example, <a href=\"http:\/\/archive.md\/dva4n#95%\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/archive.md\/dva4n#95%<\/a>\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\tselect the text on the pages and get the URL with a hashtag pointing to this section. For example, <a href=\"http:\/\/archive.is\/FWVL#selection-1493.0-1493.53\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/archive.is\/FWVL#selection-1493.0-1493.53<\/a>\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tDomains support national characters:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/www.maro&ntilde;as.com.uy\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/archive.is\/*.\u6d4b\u8bd5\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tPlease note that when creating an archive copy of the page, the IP address of the person creating the page snapshot is sent to the archived site. This is done through the X-Forwarded-For header to correctly identify your region and display relevant content.\n<\/p>\n<h2 style=\"text-align: justify;\">\n\tweb-arhive.ru<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\t<a href=\"http:\/\/web-arhive.ru\/\" rel=\"noopener noreferrer\" target=\"_blank\">Archive of Internet<\/a> (Web archive) is a free service for finding archival copies of sites. Using this service, you can check the appearance and contents of a page on the Internet for a specific date.\n<\/p>\n<p style=\"text-align: justify;\">\n\tAt the time of writing, this service, it seems, does not work normally (&quot;Database Exception (# 2002)&quot;). If you have any news on it, then write them in the comments.\n<\/p>\n<h2 style=\"text-align: justify;\">\n\tSearch all Web archives at once<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tIt may happen that the page or file of interest is not in the web archive. In this case, you can try to find the saved page of interest in another Internet Archive. Especially for this, I made a fairly simple service, which for the entered address provides links to page snapshots in the three archives considered.\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip-web-arhive.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3969\" height=\"170\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip-web-arhive.png\" width=\"786\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip-web-arhive.png 786w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip-web-arhive-768x166.png 768w\" sizes=\"(max-width: 786px) 100vw, 786px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tService address: <a href=\"https:\/\/w-e-b.site\/?act=web-arhive\" rel=\"noopener noreferrer\" target=\"_blank\">https:\/\/w-e-b.site\/?act=web-arhive<\/a>\n<\/p>\n<h2 style=\"text-align: justify;\">\n\tWhat if the deleted page is not saved in any of the archives?<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tInternet archives save pages only if some user requested this action &ndash; they do not have crawler functions and don&rsquo;t look for new pages and links. For this reason, it is possible that the page you are interested in may have been deleted before it was saved in any Internet archive.\n<\/p>\n<p style=\"text-align: justify;\">\n\tNevertheless, you can use the services of search engines that are actively looking for new links and quickly save new pages. To display a page from the Google cache, you need to enter in Google search\n<\/p>\n<pre class=\"brush:plain;\">\r\ncache:URL<\/pre>\n<p style=\"text-align: justify;\">\n\tFor example:\n<\/p>\n<pre class=\"brush:plain;\">\r\ncache:https:\/\/hackware.ru\/?p=6045<\/pre>\n<p style=\"text-align: justify;\">\n\tIf you enter a similar query into a Google search, the page from the cache will immediately open.\n<\/p>\n<p style=\"text-align: justify;\">\n\tTo view the text version, you can use the link of the form:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/webcache.googleusercontent.com\/search?q=cache:<strong>URL<\/strong>&amp;strip=1&amp;vwsrc=0\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tTo view the source code of a web page from the Google cache, use the link of the form:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\thttp:\/\/webcache.googleusercontent.com\/search?q=cache:<strong>URL<\/strong>&amp;strip=0&amp;vwsrc=1\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tFor example, a text view:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"http:\/\/webcache.googleusercontent.com\/search?q=cache:https:\/\/hackware.ru\/?p=6045&amp;strip=1&amp;vwsrc=0\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/webcache.googleusercontent.com\/search?q=cache:https:\/\/hackware.ru\/?p=6045&amp;strip=1&amp;vwsrc=0<\/a>\n\t<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">\n\tSource HTML code:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"http:\/\/webcache.googleusercontent.com\/search?q=cache:https:\/\/hackware.ru\/?p=6045&amp;strip=0&amp;vwsrc=1\" rel=\"noopener noreferrer\" target=\"_blank\">http:\/\/webcache.googleusercontent.com\/search?q=cache:https:\/\/hackware.ru\/?p=6045&amp;strip=0&amp;vwsrc=1<\/a>\n\t<\/li>\n<\/ul>\n<h2 style=\"text-align: justify;\">\n\tHow to completely download a site from a web archive<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tIf you want to recover a deleted site, <strong>Wayback Machine Downloader<\/strong> will help you.\n<\/p>\n<p style=\"text-align: justify;\">\n\tThe program will download the latest version of each file present in the Wayback Machine Internet Archive and save it in a folder of the form <strong>.\/websites\/example.com\/<\/strong>. It will also recreate the directory structure and automatically create index.html pages so that the downloaded site can be placed on the Apache or Nginx web server without any changes.\n<\/p>\n<p style=\"text-align: justify;\">\n\tTo install Wayback Machine Downloader on Kali Linux:\n<\/p>\n<pre class=\"brush:bash;\">\r\ngem install wayback_machine_downloader\r\nwayback_machine_downloader --help<\/pre>\n<p style=\"text-align: justify;\">\n\tTo install Wayback Machine Downloader on BlackArch\n<\/p>\n<pre class=\"brush:bash;\">\r\ngem install wayback_machine_downloader\r\nsudo mv ~\/.gem\/ruby\/2.6.0\/bin\/wayback_machine_downloader \/usr\/local\/bin\/\r\nwayback_machine_downloader --help<\/pre>\n<p style=\"text-align: justify;\">\n\tUsage:\n<\/p>\n<pre class=\"brush:bash;\">\r\nwayback_machine_downloader http:\/\/example.com<\/pre>\n<p style=\"text-align: justify;\">\n\tOptions\n<\/p>\n<pre class=\"brush:plain;\" style=\"text-align: justify;\">\r\nOptional options:\r\n    -d, --directory PATH             Directory to save the downloaded files into\r\n                                     Default is .\/websites\/ plus the domain name\r\n    -s, --all-timestamps             Download all snapshots\/timestamps for a given website\r\n    -f, --from TIMESTAMP             Only files on or after timestamp supplied (ie. 20060716231334)\r\n    -t, --to TIMESTAMP               Only files on or before timestamp supplied (ie. 20100916231334)\r\n    -e, --exact-url                  Download only the url provied and not the full site\r\n    -o, --only ONLY_FILTER           Restrict downloading to urls that match this filter\r\n                                     (use \/\/ notation for the filter to be treated as a regex)\r\n    -x, --exclude EXCLUDE_FILTER     Skip downloading of urls that match this filter\r\n                                     (use \/\/ notation for the filter to be treated as a regex)\r\n    -a, --all                        Expand downloading to error files (40x and 50x) and redirections (30x)\r\n    -c, --concurrency NUMBER         Number of multiple files to dowload at a time\r\n                                     Default is one file at a time (ie. 20)\r\n    -p, --maximum-snapshot NUMBER    Maximum snapshot pages to consider (Default is 100)\r\n                                     Count an average of 150,000 snapshots per page\r\n    -l, --list                       Only list file urls in a JSON format with the archived timestamps, won&#39;t download anything\r\n    -v, --version                    Display version<\/pre>\n<p style=\"text-align: justify;\">\n\tExample of downloading a full copy of the suip.biz website from the Internet archive:\n<\/p>\n<pre class=\"brush:bash;\">\r\nwayback_machine_downloader https:\/\/suip.biz<\/pre>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/wayback_machine_downloader.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3972\" height=\"855\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/wayback_machine_downloader.png\" width=\"1296\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/wayback_machine_downloader.png 1296w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/wayback_machine_downloader-1000x660.png 1000w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/wayback_machine_downloader-768x507.png 768w\" sizes=\"(max-width: 1296px) 100vw, 1296px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tThe structure of the downloaded files:\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/tree.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3971\" height=\"912\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/tree.png\" width=\"755\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tLocal copy of the site, pay attention to the Internet service provider:\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip.biz-local.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3970\" height=\"996\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip.biz-local.png\" width=\"1138\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip.biz-local.png 1138w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip.biz-local-1000x875.png 1000w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/suip.biz-local-768x672.png 768w\" sizes=\"(max-width: 1138px) 100vw, 1138px\" \/><\/a>\n<\/p>\n<h2 style=\"text-align: justify;\">\n\tHow to download all page changes from a web archive<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tIf you are not interested in the whole site, but a specific page, but you need to track all the changes on it, then use the <strong>Waybackpack<\/strong> program.\n<\/p>\n<p style=\"text-align: justify;\">\n\tTo install Waybackpack on Kali Linux\n<\/p>\n<pre class=\"brush:bash;\">\r\nsudo apt install python3-pip\r\nsudo pip3 install waybackpack<\/pre>\n<p style=\"text-align: justify;\">\n\tTo install Waybackpack on BlackArch\n<\/p>\n<pre class=\"brush:bash;\">\r\nsudo pacman -S waybackpack<\/pre>\n<p style=\"text-align: justify;\">\n\tUsage:\n<\/p>\n<pre class=\"brush:bash;\" style=\"text-align: justify;\">\r\nwaybackpack [-h] [--version] (-d DIR | --list) [--raw] [--root ROOT] [--from-date FROM_DATE] [--to-date TO_DATE] [--user-agent USER_AGENT] [--follow-redirects] [--uniques-only]\r\n                   [--collapse COLLAPSE] [--ignore-errors] [--quiet]\r\n                   url<\/pre>\n<p style=\"text-align: justify;\">\n\tOptions:\n<\/p>\n<pre class=\"brush:plain;\" style=\"text-align: justify;\">\r\npositional arguments:\r\n  url                   The URL of the resource you want to download.\r\n\r\noptional arguments:\r\n  -h, --help            show this help message and exit\r\n  --version             show program&#39;s version number and exit\r\n  -d DIR, --dir DIR     Directory to save the files. Will create this directory if it doesn&#39;t already exist.\r\n  --list                Instead of downloading the files, only print the list of snapshots.\r\n  --raw                 Fetch file in its original state, without any processing by the Wayback Machine or waybackpack.\r\n  --root ROOT           The root URL from which to serve snapshotted resources. Default: &#39;https:\/\/web.archive.org&#39;\r\n  --from-date FROM_DATE\r\n                        Timestamp-string indicating the earliest snapshot to download. Should take the format YYYYMMDDhhss, though you can omit as many of the trailing digits as you like.\r\n                        E.g., &#39;201501&#39; is valid.\r\n  --to-date TO_DATE     Timestamp-string indicating the latest snapshot to download. Should take the format YYYYMMDDhhss, though you can omit as many of the trailing digits as you like.\r\n                        E.g., &#39;201604&#39; is valid.\r\n  --user-agent USER_AGENT\r\n                        The User-Agent header to send along with your requests to the Wayback Machine. If possible, please include the phrase &#39;waybackpack&#39; and your email address. That\r\n                        way, if you&#39;re battering their servers, they know who to contact. Default: &#39;waybackpack&#39;.\r\n  --follow-redirects    Follow redirects.\r\n  --uniques-only        Download only the first version of duplicate files.\r\n  --collapse COLLAPSE   An archive.org `collapse` parameter. Cf.: https:\/\/github.com\/internetarchive\/wayback\/blob\/master\/wayback-cdx-server\/README.md#collapsing\r\n  --ignore-errors       Don&#39;t crash on non-HTTP errors e.g., the requests library&#39;s ChunkedEncodingError. Instead, log error and continue. Cf.\r\n                        https:\/\/github.com\/jsvine\/waybackpack\/issues\/19\r\n  --quiet               Don&#39;t log progress to stderr.<\/pre>\n<p style=\"text-align: justify;\">\n\tFor example, to download all copies of the main page of the suip.biz website, starting from the date <em><strong>(&#8211;to-date 2017)<\/strong><\/em>, these pages should be placed in the folder <em><strong>(-d \/home\/mial\/test)<\/strong><\/em>, while the program must follow HTTP redirects <em><strong>(&#8211;follow-redirects)<\/strong><\/em>:\n<\/p>\n<pre class=\"brush:bash;\">\r\nwaybackpack suip.biz -d .\/suip.biz-copy --to-date 2017 --follow-redirects<\/pre>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/waybackpack.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3968\" height=\"801\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/waybackpack.png\" width=\"1084\" srcset=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/waybackpack.png 1084w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/waybackpack-1000x739.png 1000w, https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/waybackpack-768x567.png 768w\" sizes=\"(max-width: 1084px) 100vw, 1084px\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tDirectory structure:\n<\/p>\n<p style=\"text-align: justify;\">\n\t<a href=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/tree-2.png\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" class=\"alignnone size-full wp-image-3967\" height=\"832\" src=\"https:\/\/miloserdov.org\/wp-content\/uploads\/2019\/12\/tree-2.png\" width=\"733\" \/><\/a>\n<\/p>\n<p style=\"text-align: justify;\">\n\tTo display a list of all available copies in the Internet archive (&#8211;list) for the specified site (hackware.ru):\n<\/p>\n<pre class=\"brush:bash;\">\r\nwaybackpack hackware.ru --list<\/pre>\n<h2 style=\"text-align: justify;\">\n\tHow to find out all the pages of a site that are saved in the Internet archive<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tTo obtain links that are stored in the Internet Archive, use the <strong>waybackurls<\/strong> program.\n<\/p>\n<p style=\"text-align: justify;\">\n\tThis program retrieves all the URLs of the specified domain that Wayback Machine knows about. This can be used to quickly map a site.\n<\/p>\n<h3 style=\"text-align: justify;\">\n\tHow to install waybackurls on Kali Linux<br \/>\n<\/h3>\n<p style=\"text-align: justify;\">\n\tStart by installing Go, to do this, go to the article &ldquo;<a href=\"https:\/\/miloserdov.org\/?p=3252\" target=\"_blank\" rel=\"noopener noreferrer\">How to install Go (compiler and tools) on Linux<\/a>&rdquo; and select &ldquo;<strong>Manual installation of the latest version of the Go compiler<\/strong>&rdquo;.\n<\/p>\n<p style=\"text-align: justify;\">\n\tThen type:\n<\/p>\n<pre class=\"brush:bash;\">\r\ngo get github.com\/tomnomnom\/waybackurls\r\nwaybackurls --help<\/pre>\n<h3 style=\"text-align: justify;\">\n\tHow to install waybackurls on BlackArch<br \/>\n<\/h3>\n<pre class=\"brush:bash;\">\r\nsudo pacman -S waybackurls<\/pre>\n<p style=\"text-align: justify;\">\n\tIt can work with a list of domains getting it from standard input. In this list, each domain should be written on a separate line.\n<\/p>\n<p style=\"text-align: justify;\">\n\tThe program reads domains from standard input, therefore, to start receiving page addresses of one domain, you need to use a command like that:\n<\/p>\n<pre class=\"brush:bash;\">\r\necho DOMAIN | waybackurls<\/pre>\n<p style=\"text-align: justify;\">\n\tTo get all the URLs of many sites as <strong>DOMAINS.txt<\/strong>, you need to specify a file that lists all domains in the format of one domain per line:\n<\/p>\n<pre class=\"brush:bash;\">\r\ncat DOMAINS.txt | waybackurls<\/pre>\n<p style=\"text-align: justify;\">\n\tOptions:\n<\/p>\n<pre class=\"brush:plain;\" style=\"text-align: justify;\">\r\n  -dates\r\n    \tshow date of fetch in the first column\r\n  -no-subs\r\n    \tdon&#39;t include subdomains of the target domain<\/pre>\n<p style=\"text-align: justify;\">\n\tTo get a list of all the pages Wayback Machine knows about for the suip.biz domain:\n<\/p>\n<pre class=\"brush:bash;\">\r\necho suip.biz | waybackurls<\/pre>\n<h2 style=\"text-align: justify;\">\n\tConclusion<br \/>\n<\/h2>\n<p style=\"text-align: justify;\">\n\tA couple more programs that work with the Internet archive as well:\n<\/p>\n<ul>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"https:\/\/github.com\/relrelb\/wayback-downloader\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/github.com\/relrelb\/wayback-downloader<\/a>\n\t<\/li>\n<li style=\"text-align: justify;\">\n\t\t<a href=\"https:\/\/github.com\/erlange\/wbm-dl\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/github.com\/erlange\/wbm-dl<\/a>\n\t<\/li>\n<\/ul>\n\n<div style=\"font-size: 0px; height: 0px; line-height: 0px; margin: 0; padding: 0; clear: both;\"><\/div>","protected":false},"excerpt":{"rendered":"<p>What is Wayback Machine and the Internet Archives In this article we will consider Web Archives of sites or Internet archives: how to recover removed from sites information, how to download non-existent anymore sites and other examples and use cases. The principle of operation of all Internet Archives is similar:<a href=\"https:\/\/miloserdov.org\/?p=3964\" class=\"read-more\">Read More<\/a><\/p>\n","protected":false},"author":1,"featured_media":3976,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12,31],"tags":[389,52,386,388,387,51,104],"class_list":["post-3964","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-information-gathering","category-web-applications","tag-clone-website","tag-infogathering","tag-internet-archive","tag-mirror-website","tag-web-site-archive","tag-web-sites","tag-webapps"],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/miloserdov.org\/index.php?rest_route=\/wp\/v2\/posts\/3964"}],"collection":[{"href":"https:\/\/miloserdov.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/miloserdov.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/miloserdov.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/miloserdov.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3964"}],"version-history":[{"count":5,"href":"https:\/\/miloserdov.org\/index.php?rest_route=\/wp\/v2\/posts\/3964\/revisions"}],"predecessor-version":[{"id":3985,"href":"https:\/\/miloserdov.org\/index.php?rest_route=\/wp\/v2\/posts\/3964\/revisions\/3985"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/miloserdov.org\/index.php?rest_route=\/wp\/v2\/media\/3976"}],"wp:attachment":[{"href":"https:\/\/miloserdov.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3964"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/miloserdov.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3964"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/miloserdov.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3964"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}