Air Force Has Lost 100,000 Inspector General Records (thehill.com) 116
schwit1 shares an article from The Hill: The Air Force announced on Friday that it has lost thousands of records belonging to the service's inspector general due to a database crash. "We estimate we've lost information for 100,000 cases dating back to 2004," Air Force spokeswoman Ann Stefanek told The Hill in an email. "The database crashed and there is no data..." The database, called the Automated Case Tracking System (ACTS), holds all records related to IG complaints, investigations, appeals and Freedom of Information Act requests.... "We also use ACTS to track congressional/constituent inquiries."
The Air Force said they were "aggressively" trying to recover the data, adding that they had no evidence of malicious intent.
The Air Force said they were "aggressively" trying to recover the data, adding that they had no evidence of malicious intent.
Simple: Restore from your backup (Score:5, Insightful)
You... do... have a backup, ... right?
E
Re: (Score:1)
"Real men don't do backups - but they often cry."
Re:Simple: Restore from your backup (Score:5, Funny)
Ask Israel or PRC or Russia, they probably have a copy.
Re: (Score:1)
Ask Israel or PRC or Russia, they probably have a copy.
Why so complicated man ? Just ask the NSA, I'm sure they'd be happy to oblige.
Re: Simple: Restore from your backup (Score:1)
The NSA, they have a copy but can't find it anymore...
Re: (Score:2)
That's my problem with this story.
It's 2016. We know how to make backups. And databases compress nicely so the backup won't take anywhere near as much space as the original.
We'll see ... but I'm willing to bet that there won't be ANY higher officers fired for this. Even though it means that some IG investigations/reports are now lost. Unless that is a feature that they wanted.
Re: (Score:1, Informative)
You did read (the very short ) article right?
"The Air Force said it was notified on June 6 by a contractor that administers the database of records that the data within was "corrupted," according to a statement."
Since the military thinks all their data and networks are safe in the hands of contractors, they'll probably just fire one contractor, put the blame all on them and hire another contractor.
I really don't understand all the military confidence in contractors. IMO they use contractors far too often. T
Re:Simple: Restore from your backup (Score:4, Interesting)
The reason why contractors are used is simple... Campaign contributions.
Campaign contributions are only part of the problem. Another big factor is revolving door jobs. Most senior military officers serve for 30 years, from their early 20s to their early 50s. Then they "retire" on 75% pay, and are ready to move on to a civilian career. If they steer deals to the contractor during their service, there is often a wink-wink deal that they will get a job offer upon retirement. Then they can use their connections and contacts to work out similar deals with their former subordinates who have now moved up in rank.
I used to work for a defence contractor, and all the senior executives were former generals or colonels.
Of course, you can avoid all the expense of hiring they officers, by instead just providing them with hookers and cigars [wikipedia.org].
Re: (Score:1)
Just in time to save Hillary's ass in the coming investigations.
The Chair-Force may have just screwed the nation completely.
Re: (Score:2)
You don't ground a showerhead.
What incompetent electricians will do is use the cold water pipe as a ground. Still more incompetent electricians will attach a hot wire to the the cold water pipe (that isn't even grounded because it's attached to plastic pipe).
Re: (Score:1)
Re: (Score:2)
Wonder how much of the lost data pertained to investigations of the DB contractor . . .
Re: (Score:2)
Contractors are used because they often fall outside regulations. Requirements are stipulated as part of their contract which is physical and the size of a phone book. This is also how the executive branch of government currently gets around laws. And intentionally lose information. And lie.
A contractor can be fired. He can then go bankrupt and or reform under a new business name and then be rehired. We don't currently hold the government responsible for the actions of it's contractors. There is no buck sto
Re: (Score:3)
It is the job of the Inspector General to ensure that proper procedures and best practices are followed. I would say it was ironic that the IG office itself is the one with no backups, but then someone would say "That's not what 'ironic' means".
Re: (Score:1)
There's more than five types of irony. The irony is most don't understand even the most commonly used type.
Re: Simple: Restore from your backup (Score:1)
The DoD has a severe problem of not recognizing and retaining real talent. In the last forced riff, they randomly deleted jobs. In fact, most of their knowledge level of leadership in IT is extremely low). It surprises me not one bit that they don't have backups, they probably fired a key person that maintained them, replaced by someone who does three jobs and not well, and never realized the difference.
Mission Accomplished! (Score:2)
We'll see ... but I'm willing to bet that there won't be ANY higher officers fired for this. Even though it means that some IG investigations/reports are now lost. Unless that is a feature that they wanted.
Money quote. Corruption is the feature, oversight/inspections are the bugs. Now you're thinking like upper brass and/or contractors.
Re: Simple: Restore from your backup (Score:1)
The linked article does not state there are no backups. It does not provide data to assume that this is anything more than a temporary access issue which is being investigated. Keep in mind that this is the military. Investigative reports are a matter of course for all deviating events affecting efficiency (whether catastrophic or circumstantial) in order to prevent or mitigate occurrences which could adversely affect combat effectiveness. (IE, Incident reports are SOP, as opposed to the civilian world wher
Re: (Score:2)
Re:Simple: Restore from your backup (Score:5, Informative)
You... do... have a backup, ... right?
E
Exactly what I came here to say.
At this point, people employed by a Government Agency claiming "Lost Data" that cannot be restored from a Backup should be CRIMINALLY culpable for Obstruction of Justice and Breach of the Public Trust. Period.
It's 2016, FFS, there is ABSOLUTELY no excuse for not having Backups. Especially not with the Goddamn AIR FORCE'S Budget!!!
Re: (Score:3)
Hey, Mr. General in charge of ACTS; no backup, no job, no pension ...
Re: (Score:1)
"I'm sorry, sir, we have no record of you earning a pension. I'm afraid those records were lost and there were no backups. If only someone had done a better job..."
Re: (Score:2)
Re: (Score:2)
The best way to prove to your constituents that government doesn't work is to break it yourself.
Re: (Score:2)
Why would you have to? It's plenty broken, mostly by the do gooders trying to make it do stupid things.
Re: (Score:1)
Naa, that would be professional and efficient use of taxpayer money. The military is not in the habit of doing that.
Re: (Score:2)
You... do... have a backup, ... right?
"Backups? We ain't got no backups. We don' need no backups. I don't have to show you any stinkin' backups!" [youtube.com]
Re: Simple: Restore from your backup (Score:2)
Re: (Score:2)
Re: (Score:2, Interesting)
You... do... have a backup, ... right?
E
Sadly, I can attest to this being frighteningly common. I work in the data storage industry (on the software side) and some of our customers don't have proper backups. I don't want to think of all the times we've had a customer escalation that was almost exactly like this. The customers frequently expected our support staff to be able to wave a magic wand and get their data back. It's really impressive how incompetent some system and storage administrators can be. And incidentally, only one of the ones I re
Re: (Score:2)
Re: (Score:1)
Re: (Score:1)
We're throwing them into a fire as fast as we can in our attempt to recover the data.
Re: (Score:2)
Re:Lucky bastards! (Score:5, Interesting)
Yep. Something was in those records someone wanted disappeared. This is SOP in government now; systematically destroying disk drives, deleting PST file content, wiping servers.... just another cover-up.
Re: (Score:2)
Re: (Score:2)
That's a point generally forgotten when setting up backup systems; do test restores frequently to verify that they work and that you're still backing up the data you need. Nothing like having supposedly successful error-free backups for months, then when you need to restore something finding that all the tapes are blank (thanks Backup Exec!)
Re: (Score:1)
Blame the BBC for that one
Whose airforce? (Score:1)
Re:Whose airforce? (Score:4, Funny)
Let's see, it's a US Capitol Hill newspaper, and the article shows US airmen and a US transport in the photo. So, obviously, it's about the Kenyan Air Force.
This calls for a Congressional Inquiry! (Score:2)
I wonder where they'll store the request?
Obama's Razor (Score:5, Funny)
Never attribute to happenstance which can be attributed to a cover up.
Obama does what he wants. Clinton cover-up since (Score:3)
I don't know about that; Obama has been pretty open about wiping his ass with the Constitution.
Contrast Hilary Clinton, who has been involved in government since 1977 and her primary responsibility for 38 years has been cover ups and white-washing.
Trump is another who is pretty open about doing and saying things that people don't like.
Re: (Score:1)
Ah, I remember stage 1 (Score:2)
I remember when I said stuff like that. You're pissed that parties are partisan. So cute. At this stage, you're still rooting for the team you picked, thinking that they aren't just as corrupt, playing you like a piano. Clinton has your name on a list of people like you. At this stage, you don't quite know the politicians' names (Chaney and Regan lol), but you're sure that the politicians on the other team are evil, while the politicians on the team you chose are good. You don't know the names of the Co
Re: (Score:2)
Slam the HDDs with a big hammer until data confesses...
Re:No need for RAID, Distributed DBs or Backups (Score:5, Informative)
No need for that fancy stuff since it wasn't mission critical data
Must have been designed by Carnegie Mellon grads
RAID and distributed DB's are for HA, they are not a substitute for backups. Neither RAID nor a distributed DB will protect against corruption or accidental data loss - if someone deletes the wrong records, they'll be gone from both the primary and secondary database.
Any many people still think RAID-5 gives adequate protection against drive loss, which is no longer the case with modern large hard drives.
Re: (Score:2)
Better than the Compaq tech which removed the GOOD drive, degaussed it, then couldn't figure out why the RAID wouldn't rebuild.
Re: (Score:2)
You should have used triple drive RAID 1 then. The probability of deleting everything is less than 50%.
Re: (Score:2)
Honest question though: are distributed systems plus snapshots a "backup?" What really makes a backup-- beyond ensuring no common mode failure option.
Yes Minister said it best (Score:5, Funny)
Sir Humphrey Appleby: No, a marvellous winter. We lost no end of embarrassing files.
Re: (Score:1)
or this from the same show:
Bernard: “I’ll just say, ‘The Minister has asked me to thank you for your letter’ and something like ‘The matter is under consideration’, or even ‘under active consideration’.”
Hacker: “What’s the difference?”
Bernard: “Well, ‘under consideration’ means we’ve lost the file, ‘under active consideration’ means we’re trying to find it.”
Newspeak (Score:3)
Re: (Score:1)
Don't give Cheney any new ideas.
They have to be in violation of something (Score:2)
1 - Backup
2 - BACKUP
3 - See Rules 1 & 2
On top of that, when I was in the USAF working in the missile shop, we had FIVE copies of all the records, and they were stored in different places. Losing the records to a missile would mean your ASS! More than one would crucify the entire shop!
And now someone is trying to complain that the Inspector General has lost a huge amount of records because of a single database crash?
Is someone incompet
Re:They have to be in violation of something (Score:5, Insightful)
Let's mention the first 3 laws of computing:
1 - Backup
2 - BACKUP
3 - See Rules 1 & 2
]
1 - Backup
2 - BACKUP
3 - Test restoration of backup
There, fixed it for you.
THIS. Most untested backups don't work (Score:4, Insightful)
You hit the nail on the head. I've probably encountered more broken backups than ones that work. Web hosting providers frequently provide backups that stopped working 10 months ago, but nobody noticed. If you haven't recently tested restoring your backups, you probably have no backups.
I like to use remote backups that I can restore from conveniently, so that I restore a file from time to time just because I messed up a couple paragraphs of text or something. These real-life, low-impact restores serve to verify backup and restore is working properly.
Re: (Score:2)
Is someone incompetent running the Inspector Generals Office?
They contract out the IT work, so yeah.
Re: (Score:2)
Bobby Tables (Score:5, Funny)
Sound like the Air Force may have added Booby Tables to the Inspector Generals Records.
https://xkcd.com/327/ [xkcd.com]
Fire contractor, announce name (Score:5, Insightful)
From the article:
The Air Force said it was notified on June 6 by a contractor that administers the database of records that the data within was "corrupted," according to a statement.
How many contractors administered the database? I wonder if that was part of the problem: "Oh, I thought you guys were going to back up the database ... No you were supposed to back it up."
If just one contractor was clearly responsible for the backup, then I wish the government would:
1) Fire the contractor, and never use them again.
2) Publicly announce the name of the contractor, so that we know not to use them.
(Of course a lot more needs to be done, such as making sure this doesn't happen again in any govt. dept.)
Re: (Score:2)
The contractor was Oracle... Be sure to NEVER use their products. Good luck.
Lost or purposely deleted? (Score:1)
Just let it go (Score:2)
So you lost all your data and didn't have a backup? It's happened to all of us and somehow, life goes on.
At least you didn't spend the past 10 years implementing, maintaining, and testing a foolproof backup system, because that sounds like a real drag.
Cross-reference former assistant IG at Pentagon (Score:1)
Files (Score:1)
Re: Did Hillary Wipe It? (Score:1)
That database had it coming.