The Army Is Burning Through Its AI Tokens (wired.com) 91
An anonymous reader quotes a report from Wired: A little over a month after the Department of Defense (DOD) bragged that nearly half of its 3.5 million employees were using AI at work, members of the Army's Combat Capabilities Development Command (DEVCOM) received an email informing them that they were burning through tokens, and needed to limit use. "Although the Army CIO announced in May 2026 that they were offering unlimited tokens, by mid-June the Army CIO pool was exhausted of tokens and had to re-establish limits," the email reads. The email goes on to say that although the Army has chosen to renew token usage at "its current levels," it's unclear "if the Army CIO pool will be renewed after 1 Oct."
The Army uses Ask Sage, a multimodal generative AI platform where users can run different large language models (LLMs), including Alphabet's Gemini, Meta's Llama, and OpenAI's ChatGPT. "Apparently the whole Army burned through the whole year of tokens for just one service," says an Army employee who spoke to WIRED [...]. The Army employee says that the Army has been pushing its workers to lean into using generative AI. Employees were given an allotment of at least 200,000 tokens per month, according to emails viewed by WIRED, and were automatically allocated more if they burned through their initial allotment. Employees who had signed up for Ask Sage but were not regularly using it would receive emails encouraging them to use more of their allocated tokens.
In order to use Ask Sage, the Army had access to 100,000,000 tokens as part of an annual subscription to an "enterprise pack." Tokens represent a unit of output, either in text or image, from an LLM. For the Ask Sage tool, a single token equates to about 3.7 characters, according to documents viewed by WIRED. The Defense Department burned through some 20 billion tokens per day during the 38-day Operation Epic Fury in Iran, according to Breaking Defense. It's unclear if the tokens used by regular DOD employees are drawn from the same pool as those who might be using AI tools on classified or secret information.
The Army uses Ask Sage, a multimodal generative AI platform where users can run different large language models (LLMs), including Alphabet's Gemini, Meta's Llama, and OpenAI's ChatGPT. "Apparently the whole Army burned through the whole year of tokens for just one service," says an Army employee who spoke to WIRED [...]. The Army employee says that the Army has been pushing its workers to lean into using generative AI. Employees were given an allotment of at least 200,000 tokens per month, according to emails viewed by WIRED, and were automatically allocated more if they burned through their initial allotment. Employees who had signed up for Ask Sage but were not regularly using it would receive emails encouraging them to use more of their allocated tokens.
In order to use Ask Sage, the Army had access to 100,000,000 tokens as part of an annual subscription to an "enterprise pack." Tokens represent a unit of output, either in text or image, from an LLM. For the Ask Sage tool, a single token equates to about 3.7 characters, according to documents viewed by WIRED. The Defense Department burned through some 20 billion tokens per day during the 38-day Operation Epic Fury in Iran, according to Breaking Defense. It's unclear if the tokens used by regular DOD employees are drawn from the same pool as those who might be using AI tools on classified or secret information.
The Army is not capitalist (Score:2, Insightful)
The US military mostly does not use capitalism. It is the largest anti-capitalism organization in the USA. They care about lives, not bank accounts. It is run in a bureaucratic system that is far more similar to socialism than the Republican party wants to admit.
Therefore it has to deal with the various weaknesses of that system, one of which is over-use of resources for 'trendy' and 'popular' ideas at the expense of the less sexy but more efficient programs.
Right now that means drones and AI rule.
Re:The Army is not capitalist (Score:5, Insightful)
This isn't about that. This is corruption, pure and simple. The US taxpayer is hemorrhaging money directly into the wallets of the AI companies, who undoubtedly paid off the guy at the top.
Re: (Score:3, Insightful)
Re: (Score:2)
So give up and rejoice in the misery, instead?
As the saying goes: Misery is easy, it's happiness we have to work at.
Re: (Score:3)
While I would love to grouse about how this is the result of corruption or incompetence, I don't see this problem as surprising. It's like the army fielding a new close combat battle rifle and then complaining about all the ammunition the army is firing.
The modern battlefield is changing. We saw a similar shift in the 1980s when electronics went from tubes to discrete components to integrated circuits and then microprocessors. The war in Ukraine has shown how drones have become integral to the battlefiel
Re: (Score:2)
Re: (Score:2)
I do not get your point.
Is that rather cheap? Or rather expensive?
And the bugs? Is that rather slow or rather quick?
I mean, they could always say: works as designed, won't fix ... or something like that. For example: the problem is always between the chair and the joy stick ...
Or even better: can't reproduce. Drone exploded as specified.
Re: (Score:2, Funny)
They care about lives
I remember my first beer.
Re: (Score:2)
Re:The Army is not capitalist (Score:4, Informative)
Why can there only be capitalism and communism? You know there are varying degrees of each system. The Soviet Union had some brilliant minds. For example the math behind stealth aircraft https://en.wikipedia.org/wiki/... [wikipedia.org]
The problem was they didn't have quality manufacturing capabilities. Even when they cranking out semiconductors they were decades behind the west in terms of lithography and material purity.
Another personal favorite of mine is Leon Theremin (yes that musical instrument) and his listening device. https://en.wikipedia.org/wiki/... [wikipedia.org]
Re: (Score:2)
Soviet weapons best in world! Take Dshka and AK-47 Spetznas. Eat M16 for zavtrak! two times. and fill plate 3rd time!
At fraction of price!
The only thing more expensive than weapons procurement in this country is healthcare. We probably pay more money to healthcare executives than all of the defense contractors combined. I'm making that up, but it sounds plausible.
Re: (Score:1)
Soviet weapons best in world! Take Dshka and AK-47
The AK-47’s virtue is one of usability by poorly trained 3rd world conscripts. Professional soldiers with western rifles will pick off AK users from beyond the AK’s effective range. Much like Soviet tanks in the 1990s gulf war were picked off by western tanks.
Spetznas.
You don’t understand the word, it is a general label that can be applied to units far below elite special forces.
Re: (Score:3)
Explain why you think they should.
Re: (Score:2)
But think of the children. If you deprive the capital owners from making money off of basic human needs, they won't be able to hire servants, who won't be able to feed their kids. It's for the kids.
Re: (Score:2)
Which, as we see today, isnt a smart move by the people, but it is for those with those businesses, they get rich off of this, where as public works, no one gets rich, they just get paid and then pay taxes on that, literally a circular monetary system vs the Oligarch hording one.
Re: (Score:2)
Re: (Score:2)
Should the Army be capitalist? You say this like it's a bad thing.
Sure, what could possibly go wrong? Just have private equity, the epitome of unbridled capitalism, take over the army. Again, why could possibly go wrong?
Re: The Army is not capitalist (Score:2, Insightful)
Re: (Score:1)
they care about lives? tell us more about you never been in service nor know anything about the military. that was a good troll tho lol
Actually your just the mirror image of what you claim to hate. Just ignorance of the opposite polarity.
People who actually served know very well that it varies from officer to officer.
Re: (Score:3)
Right now that means drones and AI rule.
Yes, the corporals producing the power points, charts, and graphics for meetings will have to do things themselves once again. I’m not sure I want the E4 maifa to go AI either, that sounds more dangerous than skyet. :-)
The Army is fascist (Score:5, Insightful)
The US military mostly does not use capitalism. It is the largest anti-capitalism organization in the USA. They care about lives, not bank accounts. It is run in a bureaucratic system that is far more similar to socialism than the Republican party wants to admit.
Therefore it has to deal with the various weaknesses of that system, one of which is over-use of resources for 'trendy' and 'popular' ideas at the expense of the less sexy but more efficient programs.
Right now that means drones and AI rule.
In the hopes of clarifying some concepts and descriptive words:
The US army runs under fascism. Management is top-down, everyone has to do what their superior says to do, and if you don't do it there are grave consequences.
All militaries across the globe run under fascism. All militaries throughout history have run under fascism.
Almost all businesses are run under a similar system: there is one person at the top, usually with a vision of what he wants to happen, and everyone from there down what their immediate superior says to do. There is some leeway in the case of business: you can disagree with your superior and perhaps have a discussion, doing the right thing against orders is OK if it works out, and the penalties for disobeying aren't as severe (getting fired versus getting sent to Leavenworth, or being shot).
The fascist model of governance is one of a handful of governing types we know about, and is useful in situations where decisions need to be made quickly based on experience (military planning) or based on vision (business planning). Military actions fall squarely within those situations. It's not the best model for an economic system, where divergent opinions and "try it and see" is more efficient, or a political system where individual corruption can lead to violations in human rights or reasonable policy.
The US military is not capitalistic, but it is not "anti-capitalism" system in the sense that it works against capitalism in any way.
The US military isn't socialist, except that it tries to provide for it's members in compensation for the risks they take. It's similar to businesses providing health insurance or stock options or reimbursement for college courses - we don't normally think of employment perks as "socialism", and in the same manner we shouldn't think of military benefits as socialism either. Socialism is a foundational principle, not a system of perks.
I don't know that using AI is a weakness of the system. The military is famous for actually studying the effects that certain decisions have. You can look up the government's studies on whether and how much coffee improves performance, whether sleep learning is of any use, and the minimum IQ to allow before it takes more resources to manage an individual than the resources the individual brings by enlisting.
Looking into new technologies and their application to warfare is something the US military does very well.
And apropos of nothing, it's completely obvious that drones are a tectonic shift in military technology, this came as a complete surprise from the Ukraine war, and we totally should be pivoting away from expensive missiles and more towards swarms of cheap drones.
I don't know why you're characterizing drones as trendy and popular, either.
Re:The Army is fascist (Score:5, Informative)
It's more accurate to call it some form of socialism.
Re: (Score:3)
Businesses are not run like the US army. Your understanding of them is heavily flawed. They are NOT all alike.
Also, from what I understand, the various US branches are dramatically different. Being on a ship is very different than being a pilot, and both differ from infantry. In truth I hear it matters a lot about who your commander is.
But with regards to businesses, your opinion is far off the norm. Each person running a business runs it differently. Some run it the way you describe, but that is in n
Re: The Army is fascist (Score:2)
"The US military isn't socialist, except that it tries to provide for it's members in compensation for the risks they take."
It should try harder
Re: (Score:3)
A Godwin thread, how fun! I'll play.
I thought I'd take a look at wiki to refresh my terms, which sayeth, "Fascism is characterized by support for a dictatorial leader, centralized autocracy, militarism, forcible suppression of opposition, belief in a natural social hierarchy, subordination of individual interests for the perceived interest of the nation or race, and strong regimentation of society and the economy.[3][4]"
Good enough atm. So, on to the Gedankenspiel...
support for a dictatorial leader: I got g
Re: (Score:2)
The military runs as an authoritarian. You have your top guy, his team of generals, and down the line it goes.
Fascism: A system of government marked by centralization of authority under a dictator, a capitalist economy subject to stringent governmental controls, violent suppression of the opposition, and typically a policy of belligerent nationalism and racism.
Now we can pretend the USA is a fascist regime for sake of argument, but that does not mean that all armies of all history have been under fascist re
Re: (Score:2)
The word you are looking for, is dictatorship.
Fascism as expressed in Germany in the 1940s was a dictatorship, but not all dictatorships are fascist.
Fascism has racism as a key component.
Re: (Score:2)
Fascism has racism as a key component.
Nope.
For example ancient Rome was not racist.
Fascism mean, you treat humans as tools.
And every human has the option to kill his superiores and advance in rank. Unless he gets killed by his superiours.
Every rank / caste is a clique of more or less like minded people who like to kick down on the lower ones and progress into the higher ranks.
For that you do not need "racism" or any special enemy class.
Everyone is your enemy.
Re: (Score:2)
Ancient Rome was also not fascist.
Fascism came into being in the 20th Century https://en.wikipedia.org/wiki/... [wikipedia.org]
Fascism is, at its core, dictatorial, but not all dictatorships are fascist.
Re: (Score:2)
Ancient Rome was fascist.
That is were the name comes from!
Wearing an axe wrapped in reed bundles.
Re: (Score:2)
Yes, the word's origins came from ancient Rome, but that doesn't prove that Rome was fascist. https://www.juliatomiak.com/20... [juliatomiak.com].
The word as used in ancient times meant, simply, "group."
Re: (Score:2)
Nope, it does not mean group.
And from Cesar on, Rome was fascist.
It means "bundle".
Re: (Score:2)
Bundle, group, sounds like synonyms to me!
You'll have to provide a reference to support your assertion that Rome was fascist. You're out on your own there, historians do not agree with you.
The American army is not fascist (Score:4, Informative)
Also remember if you are given an unlawful order you have a duty to disobey that order. That is not fascism. Fascism is a duty to a single individual. The US military has no such duty. Your duty is to the US Constitution and the United States and its democracy.
Now one more election with the fascists winning and yeah the army will be fascist because the civilian infrastructure that controls and oversees it will be fascist. But that's because the entire country is fascist.
We have a shitload of systems designed to prevent fascism and they are gradually being broken down. They have not completely broken down but the fascists have been working on this since newt Gingrich came up with the contract with America. So we are pretty far along in the process. It's a classic chesterton's fence where we kept tearing down a fence without knowing why it was put there
Re: (Score:2)
All militaries across the globe run under fascism.
Just a nitpick, but you have it flipped. Militaries are not fascist. Their top down, hierarchical and disciplined organization has long existed before anyone came up with fascism. Fascism rather admires the kind of control militaries have of their ranks and tries to apply it to civil society and the economy. I agree with you that it's a lousy as an economic model for similar reasons that a socialist economy, where governments or large collective bodies directly controls the means of production, is slow or i
Re: (Score:2)
That is not what the word fascism means.
Perhaps you should look up the word.
Re: (Score:2)
> They care about lives,
As long as you're a white american.
Re: (Score:2)
I wonder if the Army is better off building their own data centers. For the cost of all those tokens, having their own, separate, sovereign AI space might just be the best thing for them, long term. Especially if they are able to create and fab their own silicon.
65 years later... (Score:5, Insightful)
In the councils of government, we must guard against the acquisition of unwarranted influence, whether sought or unsought, by the militaryindustrial complex. The potential for the disastrous rise of misplaced power exists and will persist.
We must never let the weight of this combination endanger our liberties or democratic processes. We should take nothing for granted. Only an alert and knowledgeable citizenry can compel the proper meshing of the huge industrial and military machinery of defense with our peaceful methods and goals, so that security and liberty may prosper together.
https://avalon.law.yale.edu/20... [yale.edu]
Re:65 years later... (Score:5, Insightful)
https://avalon.law.yale.edu/20... [yale.edu]
I have to say - it's VERY depressing reading that and comparing President Eisenhower's thoughtful words with the bile, bombast, and often even absolute hatred that's regularly spewed by the current occupant of that office.
Re: (Score:3)
And the barely-ever-quoted next paragraphs, perhaps even more salient?
"Akin to, and largely responsible for the sweeping changes in our industrial-military posture, has been the technological revolution during recent decades.
In this revolution, research has become central; it also becomes more formalized, complex, and costly. A steadily increasing share is conducted for, by, or at the direction of, the Federal government.
Today, the solitary inventor, tinkering in his shop, has been overshadowed by task forc
Re: (Score:2)
Sort of a modern re-phrasing of "He who fights with monsters should be careful lest he thereby become a monster. And if thou gaze long into an abyss, the abyss will also gaze into thee"
Wait, what? (Score:1)
The Army is using Google, Facebook and some random LLM, aka someone's else computer to do it's business? Wow, I now feel much more secure.
Re: (Score:2)
they're mainly using palantir and it is proving to be very effective for ... pounding sand and concrete, which turns out to not be effective at all.
btw, don't worry, the "army" has never been about securing you, it's only there to secure a few fat banker's business. (ok, some dedicated branches are there to make sure that you don't step out of line)
Re: (Score:2)
ofc, they're not really concerned about civilian casualties. western media doesn't even report about them except in high profile cases anyway, and then just for damage control. and israel bombing of entire city blocks for an individual assasination target have been standard modus operandi for years, as has been the deliberate targeting of civilian fabric: first responders, medical staff, journalists, hospitals, schools, homes, police ... to their "credit", they don't even hide this, they boast about it.
what
monetary altar craves more blood (Score:2)
that's quite sophisticated prose for nafo! congratulations. llm by chance? you might aswell cite the source: https://x.com/LetsArmUKR/statu... [x.com]
ofc still lies, cope and wishful thinking. the west has no doubt "won" the pr battle, since forever. needless to say that battle is for the west's internal consumption only, russia doesn't even bother fighting it. they do the paper work, file lawsuits, etc, for the record, but other than that they just grind on and concentrate on the actual battlefield. pr doesn't usu
Re: (Score:2)
llm? no simple copy'n'paste
i know. when doing that the polite thing to do is citing the source you copy from.
Today Ukraine forced Russian air defense to shoot down its own Su-57 in the Moscow region
i heard. it was a training flight and the pilot ejected. cause still unknown, probably an accident or error. the idea of a ukr/uk cyberatack pwning russian ad is very unplausible and there is zero evidence, but ofc not totally impossible, so if that cheers you up ...
LOLz
shit happens, war is tough. they hit another russian jet a few days ago over ukraine with a clever ruse. i never said ukranie (et al) didn't have good fighters, th
Chickens are home to roost. (Score:5, Insightful)
Re: (Score:2)
AI Overview:
To overcome the fear of breaking things, reframe mistakes as feedback rather than failures.
20 billion tokens per DAY?? (Score:3)
when all they had to do was use a map?
how did they manage to not get slaughtered in Afghanistan and Iraq, without AI?
Re: (Score:2)
by using a map.
Combat operations are far more than map reading. (Score:2)
That's why approved phones exist to support them.
https://www.samsung.com/us/bus... [samsung.com]
Traditional Land Nav is to teach O-1s humility when they get lost in the woods.
200k tokens is $10/month at most! (Score:5, Interesting)
It would be insanely easy to go over that limit in a month when doing any kind of serious work. Calling it "burning through" is misleading.
Re: (Score:2)
Overpriced AI (Score:1)
Ask Sarge would be better (Score:5, Funny)
Like ask Jeeves but with get 'er done attitude
Re: (Score:2)
+1
AI arguments aside... (Score:2)
Until someone can really, and I mean REALLY, explain to me what constitutes a token in a way that I can calculate and predict, these sorts of billing models are meaningless. Only then can we evaluate what the costs, risks and benefits of AI use really are in any sort of quantifiable way.
Re:AI arguments aside... (Score:5, Informative)
according to google ai
Helpful rules of thumb for English:
1 token 4 characters
1 token ¾ of a word
100 tokens 75 words
1–2 sentences 30 tokens
1 paragraph 100 tokens
~1,500 words 2,048 tokens
Re:AI arguments aside... (Score:4, Funny)
Re: (Score:2)
It's kind of like, you know, DTUs (data transfer units) or ACUs (Azure Compute Units).
The cloud has been using these BS units for a while already.
It's all that extra Testosterone! (Score:3)
Driving the generation of SUPER FREAKY AI PR0N!!!!
Re: (Score:1)
"Now that I have 2 wankers I need AI to tell me how to use them."
$23k toilet is outdated (Score:2)
Nobody remembers or cares that a B-2's toilet cost $23k, so the Pentagon is updating to a newer, better form of government waste that kids today will better understand.
Aircraft toilets = bad analogy (Score:2)
They're not the same as terrestrial toilets by a long shot, and production volume is tiny so no economies of scale.
If you can design and fab a suitable shitter (priced to recover R&D, tooling, materials and integration into the aircraft etc) then go forth and get rich. Good luck with that.
list games (Score:2)
list games
Normal (Score:2)
"The Defense Department burned through some 20 billion tokens per day during the 38-day Operation Epic Fury in Iran, "
How many thousands asking "When should I place my Polymarket bet, is it NOW?"
Wait a sec (Score:2)
So the $67 billion Hegseth asked for isn't for the Iran war, but for AI tokens?
Re: (Score:2)
Apart from building "Trump class" warships without a blueprint, there's no discussion on how the money will be spent.
Asking the same question, 38 times (Score:2)
- Political assumptions override the reality of a military campaign having large consequences.
- Generals demanding an easy answer.
Was the LLM hallucinating how to turn multiple failures to stop Iranian attacks, into a win?
200k per month? (Score:2)
Re: (Score:2)
I use on average 12 million a day. 200000 is about an hour at the desk.
Interesting, in the sense that, between you and a previous post(er), I now have an idea of scale* and costs:
12m tokens / day @ $50 / m = $600 / day
~ $150,000 / year
This equates to (roughly: varies by location, etc.) the salaries of 2 to 3 junior developers. And I have been led to believe that most AI companies are currently losing money on their offerings, with quoted ratios of 3:2.
There's going to be some 'testing' times ahead...
*I still have no real idea what you're using 12m tokens per day on - though I
Re: (Score:2)
I also assume it is coding assistance. But $150K in tokens / year is the cost (not salary) of another engineer making about $110K. Assuming that LMB is paid roughly that, I would say that if he is doing the work of 3 people, the company is coming out WAY ahead on that deal.
If he is doing the work of 2, it's break even, if more than 3, the company is making bank with this arrangement.
In addition, there are other benefits too - more intangible. Like better morale - seeing stuff come together faster is very
US Army produces most greenhouse gas emissions. (Score:2)
And that was before they started burning through AI Tokens.
Let it be known that our future is bleak - mitigation is not enough and world leaders are doing the opposite of what is needed.
That said we can always spaff a few million on a new report that tells us nothing we dont already know and results in no action being taken.
Another institutions that will want to be independ (Score:2)
That's another institutions that will want to be independent. I think all the companies "burning through tokens" are bad news for the expensive products and they will want to self-host. This will also be a reason why they want the government not to ban open models, because the offers of the large US companies are just too expensive in the long term.
What can possibly go wrong? (Score:2)
Radar operator 1: incoming drone swarm !
Radar operator 2: over 200 drones!
Radar operator 1: targets increasing!
Officer: start tracking, shoot them down!
Fire control computer: tokens exhausted!