Cloudflare and the Wayback Machine, Joining Forces For a More Reliable Web (archive.org) 17
Cloudflare and the Internet Archive are now working together to help make the web more reliable. Websites that enable Cloudflare's Always Online service will now have their content automatically archived, and if by chance the original host is not available to Cloudflare, then the Internet Archive will step in to make sure the pages get through to users. From a report: Cloudflare has become core infrastructure for the Web, and we are glad we can be helpful in making a more reliable web for everyone."The Internet Archive's Wayback Machine has an impressive infrastructure that can archive the web at scale," said Matthew Prince, co-founder and CEO of Cloudflare. "By working together, we can take another step toward making the Internet more resilient by stopping server issues for our customers and in turn from interrupting businesses and users online."
For more than 20 years the Internet Archive's Wayback Machine has been archiving much of the public Web, and making those archives available to journalists, researchers, activists, academics and the general public, in total to hundreds of thousands of people a day. To date more than 468 billion Web pages are available via the Wayback Machine and we are adding more than 1 billion new archived URLs/day. We archive URLs that are identified via a variety of different methods, such as "crawling" from lists of millions of sites, as submitted by users via the Wayback Machine's "Save Page Now" feature, added to Wikipedia articles, referenced in Tweets, and based on a number of other "signals" and sources, such multiple feeds of "news" stories. An additional source of URLs we will preserve now originates from customers of Cloudflare's Always Online service. As new URLs are added to sites that use that service they are submitted for archiving to the Wayback Machine. In some cases this will be the first time a URL will be seen by our system and result in a "First Archive" event.
For more than 20 years the Internet Archive's Wayback Machine has been archiving much of the public Web, and making those archives available to journalists, researchers, activists, academics and the general public, in total to hundreds of thousands of people a day. To date more than 468 billion Web pages are available via the Wayback Machine and we are adding more than 1 billion new archived URLs/day. We archive URLs that are identified via a variety of different methods, such as "crawling" from lists of millions of sites, as submitted by users via the Wayback Machine's "Save Page Now" feature, added to Wikipedia articles, referenced in Tweets, and based on a number of other "signals" and sources, such multiple feeds of "news" stories. An additional source of URLs we will preserve now originates from customers of Cloudflare's Always Online service. As new URLs are added to sites that use that service they are submitted for archiving to the Wayback Machine. In some cases this will be the first time a URL will be seen by our system and result in a "First Archive" event.
Re: (Score:1)
An old ditty from Spike Jones (Score:2)
When der Führer says we is de master race
We heil (pffft) heil (pffft) right in der Fuehrer's face
Not to love der Führer is a great disgrace
So we heil (pffft) heil (pffft) right in der Fuehrer's face
When Herr Goebbels says we own the world and space
We heil (pffft) heil (pffft) right in Herr Goebbels' face
When Herr GÃring says they'll never bomb dis place
We heil (pffft) heil (pffft) right in Herr Goering's face
Are we not the supermen?
Aryan pure supermen?
Ja, we is the supermen
Super d
I wonder if this a reaction to Archive.is (Score:2)
Re: (Score:2)
Re: (Score:1)
Good, google needs some competition in that space.
Definitely agree, Google needs more competition in all the markets they are in.
What we need now is a cloudflare browser.
Oh! I would love to see what a cloudfare browser would be like. Probably just another Chromium browser, but hey, who knows!
Re: (Score:2)
Oh! I would love to see what a cloudfare browser would be like. Probably just another Chromium browser, but hey, who knows!
Or another fork of Firefox. Neither of which I feel is really necessary today...
Re: (Score:2)
I wonder if this is going to corrupt/destroy IA (Score:2)
This can't be good, despite how it looks on the surface.
It isn't too hard to guess who will be 'wearing the pants' in this relationship (Hint: It won't be Internet Archive).
With that said, please tell me that somebody is backing up Google's Usenet archive. Google has started to fuck around with that as well ("Fresh new look! Blah blah blah") and that is a good sign that it may end up on the chopping block soon.
excellent (Score:2)
WTG, Brewster. Keep it going... it's working.
Just so you know (Score:2)
Cloudflare probably trying to do CYA (Score:2)
Step 1: team up with the Internet Archive
Step 2: make it so every time cloudflare goes down, traffic quietly reroutes to the most recent snapshot at the Internet Archive
Step 3: save face
Re: (Score:2)