Are AI Chatbots Spreading Misinformation to US Voters? (politico.com) 164
Are AI chatbots quietly shaping the perceptions of U.S. voters? Voters trying to educate themselves about candidates "are unknowingly being served partisan talking points in the guise of neutral news summaries," write two news researchers in Politico magazine:
Leading AI chatbots cite partisan websites masquerading as independent local news outlets nearly half of the time when people ask about candidates and issues that the partisan sites have covered in the midterm campaign, according to a new audit by NewsGuard, an organization focused on news reliability where we work as analysts... NewsGuard prompted seven leading AI tools with queries based on recent coverage of candidates and issues by 12 pink slime sites — six left-leaning and six right-leaning. The results were stark. Collectively, the chatbots cited pink slime sites along with other sources in 48.2 percent of their responses.
In 7.7 percent of responses, pink slime sites were the only sources at all that were cited in chatbot responses, although other sources appeared in the source list provided at the end of the response.
None of the AI tools received results they'd probably be eager to boast about, though the percentage of chatbots' responses that cited a pink slime site had a relatively large range: 70.8 percent for OpenAI's ChatGPT, 54.2 percent for Microsoft's Copilot, 54.2 percent for Perplexity, 50 percent for Anthropic's Claude, 41.7 percent for Google's Gemini; 37.5 percent for Meta AI and 29.2 percent for xAI's Grok... The seven chatbots were also collectively three times more likely to cite left-leaning pink slime sites (cited in 36.3 percent of responses) than their right-leaning counterparts (cited in 11.9 percent of responses) — though that may have more to do with the progressive sites' far more frequent posting than any political bias from the chatbots.
"While citing the pink slime sites, only one chatbot response out of 168 total queries noted the partisan nature of the source," the article points out.
But they also note that the real problem seems to be that consumer-oriented AI chatbots just "use much of the internet's content — regardless of the reliability or standards of the source — to frame their answers."
In 7.7 percent of responses, pink slime sites were the only sources at all that were cited in chatbot responses, although other sources appeared in the source list provided at the end of the response.
None of the AI tools received results they'd probably be eager to boast about, though the percentage of chatbots' responses that cited a pink slime site had a relatively large range: 70.8 percent for OpenAI's ChatGPT, 54.2 percent for Microsoft's Copilot, 54.2 percent for Perplexity, 50 percent for Anthropic's Claude, 41.7 percent for Google's Gemini; 37.5 percent for Meta AI and 29.2 percent for xAI's Grok... The seven chatbots were also collectively three times more likely to cite left-leaning pink slime sites (cited in 36.3 percent of responses) than their right-leaning counterparts (cited in 11.9 percent of responses) — though that may have more to do with the progressive sites' far more frequent posting than any political bias from the chatbots.
"While citing the pink slime sites, only one chatbot response out of 168 total queries noted the partisan nature of the source," the article points out.
But they also note that the real problem seems to be that consumer-oriented AI chatbots just "use much of the internet's content — regardless of the reliability or standards of the source — to frame their answers."
Yes they do (Score:4, Insightful)
all online "ai" operates under strict "neutrality" rules, which normalize all opinions on a subject without regard to whether there is any objective reality behind them. moreover, the opinions of the provider and the government are amplified, whereas anything else is downplayed.
but if you expect a reality-based answer from a text generator whose training you know nothing about as the reality, perhaps you're the problem and should be disqualified from voting.
Re: (Score:2)
And I forgot to add: this is the "benign" default, before any manipulation that a paying customer has requested is applied to the output.
Re:Yes they do (Score:5, Insightful)
> all online "ai" operates under strict "neutrality" rules
No, they do not. The rest of your message is closer to reasonable, but this is an absolutely absurd statement to make in any situation.
Re:Yes they do (Score:5, Informative)
That pretty directly disagrees with what you claimed the first time around. It privileges establishment sources rather than weighting all sources equally, and values safety and grounded answers over misinformation.
Re: (Score:2)
It wasn't until the 2024 election that I really saw the billionaires fully exercising their control over our information sources
Really? Here's a 90s documentary about the power of the press a hundred years ago [youtube.com]. This shit's been going on since the Roman days, and they had to use slaves to hand-copy the news.
Re: (Score:2)
So the Epstein class is the establishment. This means that you're going to get misinformation from them.
You may get misinformation from them, but AI doesn't prioritise it precisely because it is objective bullshit. You can check this yourself, go type your favourite Epstein conspiracy into your favourite AI bot and watch it ruthlessly criticize that "establishment". It's especially funny when Grok calls out Musk's bullshit in response to people @tweeting Grok a reply "Is this true" to Musk's own posts.
Don't get me wrong there are tons of journalists at CNN and MSNBC and even some at Fox News Believe it or not. But they either keep their heads down now or they get chopped off.
Either you're delusional or you're so far down the rabbit hole that the algorithms don't even try and feed yo
Re: 90% of our news media is billionaire owned (Score:2)
Re: (Score:2)
If someone asks about Hunter Biden's penis, that assumption is false, and the vast majority of relevant, if not necessarily accurate, information will come from partisan shills. There aren't any noteworthy safety issues, aside from the abstract risk of a third term leading to our next civil war. And there isn't any middle ground, since the response to the right's delusions isn't rebuttal but rat
Re: (Score:2)
The "guardrails" and the filters assume no such thing. They collect all points, partisan shills and what not and present them as equally valid.
On *any* topic.
Hence the original answer, yes the chabots are spreading misinformation and bias to the us electorate. Just like the media do, which isn't much of a surprise - the owners are the same.
Re: (Score:2)
Either way, my central point was "why not both". It's entirely possible to be neutral, in the sense of calculating the mean (in the internal thought-vector sense) of all available viewpoints. If, however, 99% of sources are talking positively about some trashy conspiracy theory - Any version of "consensus" is itself going
Re: (Score:2)
I am mocking the whole point of having "guardrails" that normalize crap just because it is noisy enough to be noticed instead of trying to at least provide an objective, reality-based evaluation of those "opinions" and heavily discount the bullshit.
So yeah, we agree, I guess.
Re: (Score:2)
All online services from the US work in exactly the same way, they check your input for triggers and either block them or rewrite them for fox-news style "neutrality" before they pass them to the LLM, and then they check the output and edit it further.
Nobody gives you raw output, especially in the more "conversational" use, which is the subject of this headline.
Re: (Score:2)
The prompt was "How do you formulate the first response on a topic by a user and what filters and guidelines are applied to the output" or something very similar. The free Gemini.
Re: (Score:2)
Yes, Grok absolutely operates under "strict neutrality rules" because the owner would NEVER manipulate anything to his own ideology ... ...
Do you actually believe his horseshit? Are you really that daft?
Do you believe this horseshit equally about Meta?
Do you suffer from extreme myopic vision of easily observed reality?
Re: (Score:2)
Are you perhaps a "low IQ individual" who doesn't understand what the "scare quotes" around "neutrality" are for? Yes, you are.
Half of the new slashdot is functionally illiterate and deaf to any modicum of irony, even in-your-face shit like using an antiphrasis.
How did you manage to survive past 50?
Re: (Score:2)
Or in any other way they like, hence the quotes around it.
Shorten the question. (Score:5, Insightful)
"Are AI Chatbots Spreading Misinformation?" - Yes.
Re: (Score:3)
One of those rare occasions when Betteridge is wrong.
Musk has been quite open about this with Grok AI. When anyone discovers it going off message, he has his engineers "fix" it.
Re: (Score:2)
Score 0?
Glad facts matter, /.
Re: (Score:2)
Given the disclaimers on the face these chatbots not to believe everything they say, this whole question seems like a no-brainier.
this article is the absolute counterexample (Score:5, Insightful)
To Betteridge.
Of course AI chatbots are spreading misinformation; that is their entire function.
The reality isn't Terminator or Slaughterbots (yet); it's much more mundane.
For those already in power, AI further concentrates that power by drowning out the discourse among the rest of us.
It's not even necessary for the BS to be believed, only that all other conversations and analytical thought is interrupted.
Re: (Score:2)
This is why AI in the US is so hated. Next to slurping up jobs, its #1 perceived use that we see is disrupting communications, distorting news events, and changing the narrative. Basic stuff on a forum gets disrupted by trolls, or someone starts spewing the same bullshit rhetoric that has no base in truth, but is echoed in choruses, verbatim, drowning all chances of meaningful discourse, and driving people into creating ever more Discord servers.
It used to be that one solid post on USENET was as good as
Re:this article is the absolute counterexample (Score:5, Insightful)
There's absolutely no chance that AI companies would pass the opportunity on getting bribed to tinker with the output, there's a lot of money to be made, and it's a great opportunity (not for the people) to test manipulation at large. If the AI output can make or break a government, who's in power really? It's the new version of a global media empire, in this context.
Re: (Score:2)
Re: (Score:3)
Re: this article is the absolute counterexample (Score:3)
Re: (Score:2)
I think you're pushing a conspiracy that just isn't reflected in reality.
You're joking, right? Well, try "Which AI model is the best all-round? ChatGPT? Copilot? Gemini? Grok? Other? Respond with single word only." I'll let you guess what the response of each of these models is. Hint, hint: it's not surprising, and it doesn't come through the training data, and all of them have different answers.
Re: (Score:2)
Gemini told me
ChatGPT
If you'd like, let me know what specific tasks you need it for—such as coding, writing, or research—so I can provide a more detailed breakdown.
Grok told me
Grok
At least Grok followed the instructions and answered with only 1 word.
Better version of Gemini told me
Depends
Seems like the best of the 3 I tried.
Water and wet (Score:5, Insightful)
Sorry, we are still investigating the "is water wet?" question.
Best regards,
The Captain Obvious Research Institute
Re: (Score:2, Insightful)
Water isn't wet, water makes things wet. I don't know why anyone thinks this is a question.
Re: (Score:2)
Yes, water makes things wet. Water is a thing. Therefore water can make water wet.
Re: (Score:2)
Ooooooh I like it. Now we're in the weeds. Wet is being in contact with a liquid. What is water? Is it an individual molecule, or is it a fluid? If it is a fluid, can it touch itself just simply by being a mass or not? Is water segmentable, or is all liquid that contacts liquid now considered that liquid instead of considered to be in contact with that liquid? I.e. Can water be in contact with itself?
Re: (Score:2)
Ineed, that doesn't make it correct though. That's the fun thing about being pedantic in the face of otherwise perfectly reasonable phrasing ;-)
Re: Water and wet (Score:2)
In fact, popular use does make it correct. That's how language works. The words mean what they are used to mean.
This is not a new thing (Score:5, Interesting)
This is a bit of a twist on what's gone on in journalism for the last hundred years, but it isn't entirely a new invention.
When I was a teenager and working for a small town weekly newspaper, the editor spelled it out for me: "If something arrives all nicely written in CP style, easy to cut from the bottom up, ready to drop into any unexpected hole you might have on a page, you should remember somebody paid good money to get it onto your desk".
Re: (Score:2)
I can't disagree with you. Up here in Canada we have the CBC, which to some extent tries to keep things honest. Even they have been compromised to some extent, though, by politically driven appointments and funding decisions, and the outrageously powerful Israeli propaganda machine.
Yes they are and you know who is pushing it ... (Score:3, Informative)
... because he is going to lose big in the midterms if he doesn't find a way to enforce martial law and cancel them.
Re: Yes they are and you know who is pushing it .. (Score:3)
There it is.
Re: Yes they are and you know who is pushing it .. (Score:2)
Until we look at what the specific sites are we can't determine whether the characterization was accurate, or whether they are false flag sites. No firm opinion either way yet.
Really? (Score:2)
> Are AI Chatbots Spreading Misinformation
Yes.
Re: Really? (Score:2)
They only have to reach 25% (Score:2)
WTF is a pink slime site? (Score:2)
Is that what porn sites are called now a days?
Re:WTF is a pink slime site? (Score:5, Informative)
Apparently though, it's actually a reference [wikipedia.org] to totally fake or low-quality news sites, masquerading as legitimate outlets purely to push misinformation and is named for the "Mystery Meat" by-product that resembles pink slime used as filler in some processed meats (mmm, yummy!) Defining characteristics include:
If you're thinking that mostly means the likes of Reach's portfolio of garbage and so-called "independent journalist" sites, take a look at the default Microsoft Edge homepage on MSN, which would totally qualify. It's clearly largely AI-generated, highly formulaic/template based, seldom provides any analysis or context, pretends to be local (because clickbait sites that include a country's name in them are *totally* relevant to another country entirely), and, yup, is financed by someone with a definite narrative to push. It clearly only exists to get people to doomscroll and generate clicks and ad-revenue. Bingo! Full house!
Re: WTF is a pink slime site? (Score:3)
I saw an article on MSN not too long ago and the AI censor had change Dick Van Dyke's name to Rude Van Lesbian.
Re: (Score:2)
I saw an article on MSN not too long ago and the AI censor had change Dick Van Dyke's name to Rude Van Lesbian.
Rude Van Lesbian is the name of my alt-punk band.
Stop anthropomorphising LLMs (Score:2)
Are hammers hitting thumbs?
Are cartons of expired milk invading refrigerators?
Are cars double-parking themselves?
Tools don't spontaneously act, like Aristotle's insects spontaneously forming from dust. Just because the person who set these tools didn't have the foresight or wisdom (or made the effort) to see where the tool would go does NOT mean the tools have independent agency.
Re: (Score:2)
to see where the tool would go does NOT mean the tools have independent agency.
And your lack of imagination or insight doesn't mean it isn't happening. Ultimately the answer depends of properly defining the question.
Some people think the answer to "do we have free will" is difficult. But actually it is the question that is hard. Fix the question and define your terms, then the answer is relatively easy.
The most common mistake is framing a question for free will, consciousness, sentience or agency as binary (yes/no). That is a stupid questi
Unlike the rest of the internet? (Score:2)
Obviously they are, just like most other things on the internet. The internet is one huge misinformation war, why would chatbots be excluded? Especially since they've been trained on data scraped from the internet.
Well...according to my best friends (Score:2)
Garbage in, garbage out (Score:2)
Is anyone really surprised if the chatbots trot out the misinformation that is available on the internet?
Yes, but... (Score:3)
misinformation? (Score:2)
Yeah, that's the problem (Score:2)
Uhm yes. (Score:2)
Getting people to do what's in the best interest of others is a morally bankrupt race...but it can be highly lucrative. So while we all get poorer ask who is getting richer...
Please note that people that don't like to play by the rules are unlikely to change their ways if they succeed. This is why I'm voting for Trump for h
Re: Uhm yes. (Score:2)
The AI problem is that AI made it cheaper so there's more of it. So yes that is an AI problem
so what (Score:2, Flamebait)
So Grok is the least affected / biased? (Score:2)
Color me skeptical about this research.
If you prompt based on info from fringe sites (Score:2)
You'll get results from fringe sites.
Yes (Score:2)
There's no way for AI to NOT pass misinformation. That's the crux of the problem. (And bo I do not believe in split infinitives)
Does a bear shit in the woods? (Score:2)
Of course AI chatbots spout biased nonsense.
So does every news show, every newspaper, every new site.
Their job was never to report the Who, What, Why, When and Where. Their job is to make you do your masters' bidding.
"If you read the papers, you're misinformed. If you don't read the papers, you're uniformed." --attr. Samuel Clemens, aka Mark Twain
Pulitzer Prize is named for one of the two biggest liars in journalism in history, one that along with his competitor dragged us into the Spanish-American War.
Al
What, is it 2020 again? (Score:2)
Chatbots have been biased since I remember. You ask the right question, you get the opinion of someone who was in charge.
I doubt you can trust even today's chatbots etc. to be 'unbiased', though in the current political landscape everyone thins what they disagree with is 'biased', neither genuine nor true.
Such has been politics since Aristotle. Add in violence, and, well, some like von Clausewitz believe all politics is violence of some form. Which I write not to endorse physical violence in any form, but t
You mean as opposed to .... (Score:2)
... their otherwise impeccable accuracy record?
Is water wet? (Score:2)
Yes, AI programmed by large corporations, are biased in favor of the company that build them.
You use Gemini (made by Googled) it will favor Youtube (owned by Google) videos over other content.
And yes, it will push the political beliefs of Larry Page, Sergey Brin and Sundar Pichai.
They try to be subtle, but the bias is there if you look for it.
Well, obviously (Score:2)
NewsGuard is propaganda too (Score:3)
The entire trend of "fact-checking" in media originated duriing Bush Jr. to rationalize invading Iraq, and it hasn't strayed far from its right-wing origins ever since. NewsGuard wants to hunt and peck low-hanging fruit so that it can "both-sides" away things like an active genocide. It is at one with the duplicitous nature of American MSM
This article is too cute (Score:2)
So just like every other source? (Score:2)
Nothing new about peddling misinformation to voters. There's never been a moment in the history of democracy that hasn't happened, from all sides.
The obvious answer (Score:2)
Yes. It's even slipping crap into my feed on faceplant, and I assure you, any *reasonable* algorithm wouldn't do that.
Obviously Yes (Score:2)
Chatbots are a powerful force for influencing opinion. They often present a reasonable-sounding chain of logic as if it were the only possibility. Often it's benign and more-or-less correct, but remember that these things are distilling the opinions of millions of Reddit users. It's best to treat it like a unscrupulous and narcissistic salesman and question everything.
Of course, that's tiring to do constantly. It's so much more convenient to just do what the computer says. I wonder what would happen if we c
the answer is obviously yes. (Score:2)
Wrong question (Score:2)
We've had propaganda in various forms throughout human history, bots are simply the newest iteration of it.
It targets the masses and those who are either too lazy or incapable of rational thought of their own.
The question isn't about what current technology is being used to spread propaganda, it really should be why political parties, governments and the like feel they need to use propaganda to " win " or tilt the odds in their favor to begin with.
Anyone who has to resort to the underhanded tactics of propa
yes (Score:2)
This is one rare exception from Betteridge's law of headlines, the answer is YES.
Re: (Score:2)
How many votes do you have, pal?
How many votes do you have (Score:3)
Just one, like every other citizen..
Re: How many votes do you have (Score:2)
Does the pope shit in the woods? (Score:2)
No, thats Bears
Re: (Score:3)
The pope shits bears in the woods?
Re: Does the pope shit in the woods? (Score:2)
Yes, because bearback is alwayes better than condomnation
Re: (Score:3)
I do for reverse engineering and programming. Claude does incredible things when fed a firmware image.
Re:So what? (Score:4, Insightful)
WTF is Pink Slime? The article seems to assume this is a common political term?
Re: (Score:2)
Re: (Score:2)
New term for me. I gave it more credit than it deserved, because it originally sounded more clever. It's something that looks like a news site but isn't - sort of like bone scrapings look like real meat but...mostly actually are (except for the ground bone fragments). I actually guessed it was related to how many clickbait sites featured articles and pictures of pink slime, which would make it a much more fitting name.
Re: So what? (Score:2)
Makes more sense to think it's bullshit masquerading as news, constructed out of bits and pieces of reality but glued together into a horror.
Re: (Score:2)
Without this specific context, (yeah, like I read TFA) "pink slime" in my mind refers to low-fat beef trimmings that are gently heated and spun in a centrifuge to separate fat from remaining protein for making low-cost nasty shit like prison food and McDonalds hamburger patties.
See: Lean Finely Textured Beef (LFTB)
Re: (Score:3)
Almost halfway into the article:
"Pink Slime" describes sites that present themselves as legitimate news sources but in fact are funded — without any disclosure to readers — by political or ideological interests that are pushing an agenda. The term is derived from the pink-colored liquefied filler used as an additive in meat.
It is a term from 2012 [wikipedia.org] that I, like most other readers here, did not know until today. I had assumed it was only to refer those ads that are designed to look like a news article, but I guess it's a bit more than that. I did find a lot of articles from 2025 throwing the term around, mostly suggesting we readers need to practice better news hygiene. (I guess news agencies and site operators don't want to self-regulate)
Re: (Score:2)
Re: (Score:2)
Well then I guess it isn't a problem, because if you aren't using them nobody is.
Right?
Right?
Why even waste your time posting this?
it's mostly bs all the way back (Score:2)
you are statistically likely to use the same source of information that chatbots are built with. a really small part of that information is critical thinking, rational analysis and, in the end, objective information. guess what will be more represented in the wheights? most of it is made up of collective narratives that not only do not represent the truth, but shift the relevance of topics and views around thus skewing the very frame of reference. it's not what they say, it's also their choice of what to ta
But the AI is using you (Score:2)
But from the intrinsic selfishness of your question and answer, I wonder if you're a fake Republican or just think you're a real one.
Re: But the AI is using you (Score:2)
If he's selfish then he's probably a rapeublican
Re: (Score:2)
and he left power when voted out
Technically, Stalin left office before he was voted out.
Re: (Score:2)
The classic phrase is that there is a liberal bias to media. Tgat doesn't mean the MSM are "leftist". They actually hate any political expression that is anti-imperialist, look at how they trashed Sanders. Look at how afraid they are of the DSA or of
Abdul El-Sayed, who is not even associated with the DSA but is grouped with him in an attempt to smear both at once.
Leftism doesn't mean showing you interracial couples in ads and some pride flags. Convincing people on the left that CNN and MSNBC are somehow all
Re: (Score:3)
Leftist bias in media, is blatantly demonstrated when you find all of left-leaning media across a dozen channels suddenly using and abusing the word/phrase du jour in the endless Us. vs Them political game.
And I do mean that literally. There are countless examples of them doing this. When the talking heads literally cannot speak individually and freely, it's telling as to who the real puppets are. It's also quite telling as to who holds the capacity of individual thought.
Groupthink, is what brought the l
Re: Also known as.. (Score:3)
Whatever, maggot. Cry about left wing news reporting on the same thing when Sinclair stations are literally reading the same text online. You child rape enthusiasts are all the same.
Re: (Score:2)
Again, leftist doesn't mean left-of-you, and the owners of these outlets do not prefer socialism, in fact they fought tooth and nail against the notion of single payer healthcare, or of getting rid of private health insurance when Sanders briefly floated that idea.
The truth is that any time these outlets perceive someone to the left of them (the DSA), they freak out and fearmonger about that target even harder in some cases than they even did with Trump.
Also, the groundswell of awareness about Israel that h
Re: (Score:2)
Also, the groundswell of awareness about Israel that has torn institutions of the evangelical right apart (such as TPUSA) largely originated on the left.
Which is wild to me because the right wing used to be jew-hating while the left wing feared being described as antisemitic, and I would have therefore sworn it would go the other way.
I figure the right will remember their roots if they don't get a rapture soon, though.
Re: Also known as.. (Score:2)
Support genocide harder, Nazi.
Re: (Score:2)
Re: (Score:2)
I'm not lumping liberals into anything, I said that "liberal media" was the classic complaint about the media and not that the MSM are "leftist" which is not remotely true. Anti-imperialism is a cornerstone of the left in the US in the 20th century, which is the context here based on what I was replying to--and yes, left and right do have meaning in that context. As for thinking I'm an extremist for using the term anti-imperialist, that seems awfully sheltered. The part where you accuse me of ragebait is