Archivists Make Sure the Internet Doesn't Forget Russia's War on Ukraine (vice.com) 43
From news reports and social media posts to Ukraine University and government websites, archivists are in a mad dash to preserve the country's online history. From a report: As the Russian invasion of Ukraine accelerates, professional and hobbyist archivists alike are rushing to preserve Ukraine's online history, cataloging and storing everything from Ukrainian government and university websites, to the torrent of news and social media posts related to the accelerating conflict. The Internet Archive has been archiving the broader conflict in Ukraine since 2014. But as Ukraine government websites face prolonged outages due to sustained cyber attack -- as well as the looming risk of defacement or deletion -- the organization has taken on another monumental task: backing up the entirety of the Ukrainian Internet.
Using the crowdsourced auto-archiving software running on a virtual machine they've dubbed Archive Team Warrior, the organization has leveraged volunteers around the world, many of whom have donated countless terabytes of storage capacity for the project. These volunteers have been steadily backing up the Ukrainian Internet since before the war began. All told, 68 million items (web pages, documents, and other files) comprising more than 2.5 TB of data have already been hoovered up from various websites across the .ua top level Ukrainian domain. A second project dubbed Ukr-net aims to preserve tens of millions of additional items and terabytes of additional data across the Ukrainian Internet. Elsewhere, organizations like the Center For Information Resilience have built a crowdsourced map attempting to document every single war-related post to social media made in the region, ranging from civilian photos of the movement of heavy Russian weaponry, to Ukranian government claims of alleged bombing raids on kindergardens.
Using the crowdsourced auto-archiving software running on a virtual machine they've dubbed Archive Team Warrior, the organization has leveraged volunteers around the world, many of whom have donated countless terabytes of storage capacity for the project. These volunteers have been steadily backing up the Ukrainian Internet since before the war began. All told, 68 million items (web pages, documents, and other files) comprising more than 2.5 TB of data have already been hoovered up from various websites across the .ua top level Ukrainian domain. A second project dubbed Ukr-net aims to preserve tens of millions of additional items and terabytes of additional data across the Ukrainian Internet. Elsewhere, organizations like the Center For Information Resilience have built a crowdsourced map attempting to document every single war-related post to social media made in the region, ranging from civilian photos of the movement of heavy Russian weaponry, to Ukranian government claims of alleged bombing raids on kindergardens.
also need no copyright or dmca takedonws robots.tx (Score:2)
also need no copyright or dmca takedonws or even any take downs due to new robots.txt rules.
Re: (Score:1)
As FPs go, pretty obscure. Care to clarify, Mr Dragon? Now you're free of the time pressure to FP. We already know the Internet never forgets. Elephants don't have it as good.
But I already know what I'm looking for in the discussion. And not expecting to find. Consideration of recording the credibility of the sources, both for the original sources and for the propagators. But especially the sock-puppet propagators who try to obscure or distort the facts as they spread stuff. The motivations are crucial in c
Re: (Score:2)
As FPs go, pretty obscure.
Presumably they're referring to the Internet Archive's tendency to shoot first and ask questions later when it comes to removing content on the Wayback Machine. For example:
take downs due to new robots.txt rules.
This is a major issue with the Wayback Machine. If someone buys a domain previously owned by someone else and uses a robots.txt that disallows crawling, the entire history of crawls for that site disappears from Wayback (and is presumably deleted).
Of course they're just doing this as a CYA stance, but it's ripe for abuse.
Re: (Score:2)
It's not deleted, just marked as inaccessible. If the site owner removes the robots.txt rule, the historical data pops up again.
That was the case a few years ago. I assume that it's still the same now.
Re: (Score:1)
I still don't know what Mr Dragon was talking about, but my tweet of the day is related to the media war:
I think it's a real story about letting Russian mothers retrieve their POW sons in Ukraine. Unfortunately Twitter is NOT the best channel to tell them.
But you know Putin REALLY hates this idea. If it raises Putin's BP, I say yay!
https://wt.social/post/russiau... [wt.social]
Nuclear war (Score:2)
In case of nuclear war; we need to backup Wikipedia and the whole patent archive to something that has a long shelf life. The problem is all our storage media is SSD or magnetic media nowadays .. both of which degrade in the time scale of a few years. Rebuilding civilization after a nuclear war will be a pain.
Re: Nuclear war (Score:2)
When I say we, I mean random individuals worldwide.
Re: (Score:3)
Re: (Score:2)
Re: (Score:2)
Re: Nuclear war (Score:2)
The survivors are going to want Wikipedia, it has a shit ton of information they will want.
Re: (Score:2)
Several projects and apps can already give you an offline version of Wikipedia.
To cite but one example: Kiwix [kiwix.org]. The archived (uneditable) "wikis" are anywhere from a month to years old. The "maxi" version of the English wikipedia comes in at 93GB, the "nopic" version at a "mere" 50GB. The Kiwix site also contains downloads for other free internet resources like Project Gutenberg and TED Talks.
Re: (Score:2)
Paper has a poor shelf life as well. Perhaps if stored in a vacuum in a vault?
Why is life mimicking The Foundation now?
Re: (Score:2)
Re: (Score:2)
There's probably a name for it but I have heard a theory posited that since we have already exploited all the easily accessible oil and coal resources it would be far far more difficult for another human civilization after a collapse to rebuild the technology back up, basically we get one industrial revolution so best not to blow it all up.
Re: (Score:1)
The biggest problem after a full nuclear exchange would be re-building safe agricultural supply lines. I would expect the number of people who die due to starvation is greater than those who die in the initial attacks.
Paper books are obviously the best way to preserve knowledge in that situation, as the technology supply line could take decades to rebuild. Computer equipment will all be "vintage" before such a rebuilding is complete.
Some societies may regard all advanced technology with suspicion and burn
Where are all those MCU heros? (Score:2)
World War Wired (Score:2)
This is the first war to be thoroughly documented due to the wide availability of the internet, cell phones, etc.
No place to hide from war crimes. The victor will not get to re-write history.
Re: (Score:2)
Re: (Score:2)
The amount of blatant propaganda I have seen with this conflict was astonishing. The fake pictures, the old repurposed footage, the "anonymous" posts making stupid claims... And of course the stupid heroic titles given to random soldiers that got crazier and crazier The "Ghost of Kiev" who takes down squadrons on his own, the "Iron Man of Kiev" who killed 50 on his own, the fucking "Ass Goblin of Kiev" who raped 1000 Russian soldiers in a night...
I frequent several high profile websites, and the number of p
Re: World War Wired (Score:2)
"And don't get me started about the TV channels who's wet dream is a nuclear war."
Don't worry, in the event of global nuclear war, they will hop into the escape jet with suitcases full of money and fly to..."aww fuck"
Re: (Score:2)
Re: World War Wired (Score:2)
I don't think they had cell phones and the internet then.
What we got was what the three news networks gave us. Limited and biased as later analysis has shown.
Bad Headline (Score:3)
Also Dont Forget History (Score:1)
There was Gen. Mikhail Muryavov who killed anyone caught speaking Ukrainian. There were the Bolshevik "activists" who found out anyone with
Re: Also Dont Forget History (Score:3)
"not unlike todays left who like to covet others property"
The wealthy get more redirected tax money than the poor every year, yet here you are still believing this shit.
I gotta ask (Score:1)
Did they archive Iraq has WMDs too?
Why would anyone continue to believe those who have worked so hard at establishing a track record of lying?
too little, too late; then too much (Score:2)
Where were these archivists when Atlantis went down? And what about the mysterious disappearance of the Great Library of Alexandria that may or may not have happened in AD 391? Where was the independent free press in Jesus' time, huh? We only got one side of that story.
But now; now we will know what everyone had for breakfast on the day of the Russian invasion. We will know if and when Putin blinked or Zelenskyy flinched. Now we suffer from a mind boggling excess of data for each moment of the war. It's alm
Re: (Score:2)
Good, I hope they do more (Score:2)
Re: (Score:2)
Bad stuff https://en.wikipedia.org/wiki/... [wikipedia.org]
in soviet russia we forget you! (Score:3)
in soviet russia we forget you!
Re: (Score:2)
OG /.
Archive link doesn't work (Score:1)
It'll be interesting to see what's saved... (Score:2)
I'm sure the "Ghost of Kyiv" will be remembered fondly in their history books.
Preserving videogame footage? (Score:2)
We'll prepare a wikipedia entry to celebrate the myth.
It doesn't matter if the internet remembers (Score:1)
It's called a Gish Gallop. You spread too much misinformation and lies to be effectively debunked. You force the other side to waste all their energy trying to disprove your insane claims by
fake archive (Score:1)
What about Yemen? Syria? Donbas? (Score:1)
hopefully they are also including (Score:1)
all the historical information about what led up to Russia taking action against Ukraine, and the foreign players involved.
turn to you for help (Score:1)