Microsoft Copilot Can Now Read Your Screen, Think Deeply, and Speak Aloud To You (techcrunch.com) 99
Microsoft has unveiled new features for its Copilot AI assistant, including screen analysis and voice interaction capabilities. Copilot Vision, available to Copilot Pro subscribers, can analyze web content in Microsoft Edge and answer queries about on-screen information. The company said processed data is immediately deleted and not used for model training.
A new Think Deeper function aims to tackle complex problems using advanced reasoning models. Copilot Voice introduces synthetic speech output and voice input in select English-speaking countries. Microsoft also announced personalization features, leveraging user history to tailor Copilot recommendations. This functionality will be limited initially, with the company evaluating options for European Economic Area users due to regulatory considerations.
A new Think Deeper function aims to tackle complex problems using advanced reasoning models. Copilot Voice introduces synthetic speech output and voice input in select English-speaking countries. Microsoft also announced personalization features, leveraging user history to tailor Copilot recommendations. This functionality will be limited initially, with the company evaluating options for European Economic Area users due to regulatory considerations.
And as always (Score:5, Insightful)
How do we properly remove this shit (short of switching to *nix, which isn't always possible in a non-home environment)
By switching to "off"??? (Score:1)
1. Become Amish or something similar
2. Unplug from tech
3. ???
4. PROFIT!!!, er, stop the [privacy] losses!!!
Step 1 is optional.
Re: (Score:2)
I've beeon on rumbspringa for close to 50 years now!
Re:And as always (Score:5, Informative)
Download the LTSC build of windows from your favorite torrent site. Use the activator script from massgrave.dev and you won’t have cortana, the MS store, or any AI bullshit. It’s also supported past 2025.
Re: (Score:2)
Re:And as always (Score:5, Insightful)
Re:And as always (Score:5, Insightful)
I don't talk to my computers, I don't care to speak to "digital assistants" like Siri, etc....and I loathe the new phone answering systems use that try to force you to speak to the prompts rather than push a button on the phone...
First, I can't stand it when in the office or in public...I don't want them listening into what I'm doing.
But just on a more visceral level...I don't wanna talk to a machine. When alone, on the phone with one...I start yelling for it to get me "a fucking human" to talk to...as that I understand many of them listed for frustrated people and will expedite you to a real person.
I know I'm getting older and closer to the "get off my lawn" level...but am I the only one that can't stand talking to a fucking machine?
I learned to type for a reason...fast, accurate input...
Re:And as always (Score:4)
I wonder...am I the only person that does NOT like to talk to a computer???
No, you're definitely not alone. I hate doing it, and AFAIC people who are OK with it can just get the fuck off my lawn.
Re: (Score:2)
and AFAIC people who are OK with it can just get the fuck off my lawn.
Imagine being so angry at someone because they do something differently to you...
Re: (Score:2)
Nope. As good as you are at calling out thought-projection you play a bit at it yourself, thegarbz. Takes one to know one. Oh that means me too! I can handle it. Imagine wishing people were so angry in order for you to stand as a point of righteousness--and then point it out. Ah, there's the rub.
Re: (Score:2)
"No man ever went broke overestimating the ignorance of the American public." -- P. T. Microsoft
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
No - you are not alone.
Your question sounds like it should be a Slashdot poll.
Then, we need to find a way to rub their noses in the results - the tech moguls who create this shit.
Re: (Score:2)
oh, you can just speak to me! (Score:2)
A few places I've had to call in recently seem to use the same "helper" to ask questions, complete with a flurry of keystrokes after my responses like they are typing in my info. The same exact flurry of keystrokes every time. I guess that is supposed to make it feel natural.
And it *really* wanted me to speak instead of using my keypad. I keyed in my birthday and it gave me a "oh, you can just speak to me!" And made me do it again. It accepted the keypad the second time.
Naturally after they collect all the
Re: (Score:2)
Re: (Score:2)
I feel ya. I also HATE speech interfaces. Ridiculously slow.
Speech - 39 baud (regardless of language! How about that?)
Typing at 60 words per minute (which is not very fast) - 45 baud
Reading averages 240 words per minute - and I read faster than average. The average comes out to 180 baud.
Speech interfaces are NOT the pinnacle of achievement. They are the lowest common denominator. Lowest by a huge amount (4.5x slower than reading). The most inefficient way to convey information.
That's not even counting
Re: (Score:2)
Re: (Score:1)
Re:And as always (Score:5, Interesting)
But seriously, crap like this can and should be brought up with legal. Specifically the "we take undesired photos of your screen every X seconds without your permission and have our AI go though it" bit and how it risks giving Microsoft all of your corporate IP, trade secrets, and insider info to sell to your competitors / various governments.
Re: (Score:3)
it risks giving Microsoft all of your corporate IP, trade secrets, and insider info to sell to your competitors / various governments
That was always the plan.
Re: (Score:3)
This garbage was immediately shut down by legal, audit, and infosec...after the IT teams already flagged and disabled it.
Copilot has some guardrails in enterprise which made it allowable for a test population. But the screen scrape/keyboard logging stuff? No freaking way. Not for business, not for personal. Not for any reason whatsoever unless I can be 1000% certain the data never leaves my device and is fully encrypted with a key ONLY I can access...and since that prevents any kind of data mining by 3r
Re: (Score:2)
Re: (Score:2)
Between hosting email at Microsoft, Teams, and OneDrive, I think Microsoft already has all my $EMPLOYER's corporate IP, trade secrets and insider information.
Well, almost all of it -- I am lucky enough to have a Linux desktop at work. So RedHat / IBM has all the information I store :)
Re: (Score:2)
short of switching to *nix, which isn't always possible in a non-home environment
What does this mean ? You mean at work you are forced to use Widows at work ? To me, what happens at work stays at work. Who cares if the company wants to be spied on. If WFH, isolate your Windows PC from your own home network, many routers now allow for a "guest network".
At home, no reason to have windows except for GPU intensive gaming. But in a year or 2, Linux may very well one that space.
People want an OS (Score:5, Insightful)
People want an operating system, not a garbage can in disguise. Make all of this extra shit optional installs. Windows is nothing but a huge stinking landfill that Microsoft keeps dumping into hoping that at least something doesn't stink to high hell.
Re:People want an OS (Score:5, Insightful)
Re: (Score:3)
No no no...they're adding "features". Features they KNOW people want. All 3 of them in fact.
The rest of us...TBH Win7 would be fine for me if they updated the back end graphics/audio/x64 to support modern equipment and software. I can't think of much else in the latest windows build that I'd actually miss otherwise. They just keep moving stuff around and adding garbage.
Ok, tabbed cmd/PS is handy but I lived without it for 30+ years just fine.
Re:People want an OS (Score:5, Insightful)
Techie users, a microscopic minority, want an OS. They have many choices and many ways to contain Windows if they've a financial incentive to run it.
"People" (conventionally meaning the average drone) do not even install OS let alone have the slighest interest in how they work.
Re: (Score:1)
Re: (Score:2)
I'm OK with tech ignorance in the right circumstance:
If said tech works effectively seamlessly, has a stable feature set, is reasonable intuitive for common tasks, and meets the general requirements of the public.
But instead MS (and others) keep changing, adding, removing, and just relocating features for no actual reason...it's just a nightmare for user training. heck, look at the "new outlook" that's missing basic features like sort/search by column. I can't be the only one who sorts by name, and starts
Re: (Score:2)
Techie users, a microscopic minority, want an OS. They have many choices and many ways to contain Windows if they've a financial incentive to run it.
"People" (conventionally meaning the average drone) do not even install OS let alone have the slighest interest in how they work.
End users are the ones who complain the loudest (and longest) about their "computer" not doing what they want it to... They have no interest in how they work but they still want a machine that does what it's bloody told and doesn't talk back.
Re: (Score:2)
Re: (Score:3)
Re: (Score:2)
People want an operating system
No they don't. People don't give a shit about an operating system. People want their devices to run their apps. That's it. That is the minimum and maximum requirement. All extra functionality is reserved for a few people who need or want it, but largely people by n large don't give a flying fuck.
That's what Slashdotters can't comprehend. You say Windows is a stinking landfill and are confused why people use it, but the fact is for 99% of computer users it meets all requirements.
Re: (Score:1)
Make all of this extra shit optional installs.
Done! (Copilot Vision is part of the Copilot subscription, which is an option you pay extra for. So if you love Copilot, you're already paying $20/mo and want more value. And if you think it's a heaping landfill, great, just don't pay for it and you won't have it!
And Co-Pilot Says... (Score:1)
Re: (Score:2)
More likely "It looks like you are writing a letter. Would you like help?"
And the hype train keeps rollin' down the track (Score:5, Insightful)
Investors demand that companies justify their gigantic investment in AI
Unfortunately, it's a long term research project, and useful results won't be available for years
But investors demand profit NOW
Expect a tsunami of half-baked, useless, annoying AI crap to be forced down our throats and the most common tech support question to be "how can I turn this crap off?"
The only valid use for the current generation of AI is for comedians to make jokes about
Re: (Score:2)
"Hey Copilot, write a stand up show with AI as the theme."
Re: (Score:2)
MS: "When can I sell it?"
Copilot: "It's their data, use it when you need it!"
Re: (Score:3)
Copilot: "So, boss I just got this juicy tech from some startup's programmer workstation."
MS: "When can I sell it?"
Copilot: "It's their data, use it when you need it!"
Hey AI, write me a commercial about opera singers on a downtown bus ride. The singers are incompetent programmers who "Have a software deliverable" and they "Need code now!" Include this refrain: "Call Microsoft Copilot, 877 Code Now!"
Re: (Score:2)
So how does it get monetized? If AI was actually useful, people would pay to use it without it being forced on everyone. So presumably there's a concept of a plan to make money off of it, no?
Re: (Score:2)
So how does it get monetized?
Do you really need to ask?
Re: (Score:2)
The only valid use for the current generation of AI is for comedians to make jokes about
They're really good for making huge-boobed soft-core-porn parodies of historic popular shows (especially in the SF/Fantasy genres that nerds like).
Ummm, what else?
People will use this (Score:5, Insightful)
for satisfying their curiosity and entertainment.
Then they will stop.
Does it wear a cape? (Score:3)
Sure sounds like Super Clippy.
Re: (Score:2)
Time to whip out the Cliptonite.
Re: Does it wear a cape? (Score:3)
Sounds like a Scoobie Doo episode, where Clippy is masquerading as Cortona?
Though my concern, is if Cortona is reading my screen, then at what point does this potentially open a door to a vulnerability? Hopefully this can be deactivated in a corporate environment, otherwise data leakage is a high risk.
Re: (Score:2)
Re: (Score:2)
Leaps over Privacy in a single bound.
Another worry for domestic violence victims (Score:3)
Thanks, Microsoft. You just keep finding new ways to get women murdered.
Re: (Score:2)
Thanks, Microsoft. You just keep finding new ways to get women murdered.
How so?
Seriously asking what you are seeing that I don't...
Re:Another worry for domestic violence victims (Score:5, Interesting)
Have you ever accidentally turned on any of the accessibility features of windows, or accidentally switched keyboard maps even though no other keyboard maps have been enabled? Imagine that, but it accidentally reads off the list of divorce attorneys and battered women shelters on your screen and your abusive partner bursts into a rage and murders you on the spot for daring to leave them.
Re: (Score:2)
That's not at all far-fetched. It's like forgetting to delete your browser history after searching for "domestic abuse", except it happens pretty much instantly.
Re: (Score:2)
Honestly if you are married to a rage murdering abuser, you are not going to be googling divorce lawyers while your literal enemy is in the house. Victims of abuse being at risk of violence or death is certainly a thing, but your assertion that Copilot will be getting women killed due to a key press gone wrong is the subject of consuming way too many poorly written B-grade movies.
Microsoft Jobs (Score:2)
They're just doing the work that malware won't.
Re: (Score:2)
That was done with windows 10, when they put OS level keylogger that reports everything to the mothership.
Re: (Score:2)
Yes, the term is "general" but yes, they must have done it before the projected "within the next 5-10 years".
I take offense with the term "think", deeply or not.
In actuality it's at best: Remember, recall and spout back most likely extrapolation.
When they get to the think part I will convert to the digital overlord religion, not a second before.
let's see... (Score:2)
Microsoft Copilot Can Now Read Your Screen
No thanks.
Think Deeply
Definitely no thanks.
Speak Aloud To You
What exactly do you think I use my computer for?
Re: (Score:2)
What exactly do you think I use my computer for?
Is it for ... um ... you know...
Licking ... things?
Things that you might like to lick.
You mean play Space Quest 4? How'd you know?
Creepy (Score:4, Insightful)
For those that want it, I'm sure this sounds like it adds some great features.
For the rest of us, it sounds really creepy, and is a great motivator to spend as much time as possible with a less-intrusive OS.
Re: (Score:3)
Yes, speaking aloud in a computerized voice, being creepy, trying to get monetized:
"Welcome to User Experience. Please tell me what you are wearing. Oh yes, that is hot. Please query me more. Yes, just like that."
Yes, but (Score:4, Funny)
Can it uninstall itself?
Rotate the pod HAL... (Score:2)
Hi (Score:2)
It seems like you're trying to write a new word document, do you need assistance in coming up with ideas?
Re: (Score:2)
It might actually be able to do that. Even ideas that are the kind you might come up with (if it's trained itself on you). What it would have trouble with is avoiding the silly/lousy/wildly inappropriate ideas. This is because it doesn't understand the context in which you are trying to come up with ideas.
OTOH, ask any writer. Ideas are everywhere. What's difficult is deciding which ideas are good.
Re: (Score:2)
It seems like you are adding a feature to Windows. Do you need assistance?
No, it can't. (Score:3)
"Microsoft Copilot Can Now Read Your Screen, Think Deeply, and Speak Aloud To You..."
Typical marketing techniques. The headline says that "Microsoft Copilot Can... Think Deeply", but it can't think at all. I suppose it can "speak aloud" (what would speaking otherwise than aloud mean?), and it can "read" in the sense of inputting data - but not as a human being reads, with comprehension.
Re: (Score:3)
Well, since Microsoft executives can't actually think, they feel that any substandard AI response is Deep Thinking.
Re: (Score:2)
"To the contrary of what our competitor does, our product whispers in a sultry voice what you want to hear..."
Do not want! (Score:3)
I very much do not want this!
Re: Do not want! (Score:3)
Re: (Score:3)
All the more reason to not GAF about Microsoft products!
Re: Do not want! (Score:2)
Re: (Score:2)
Don't use this. Problem solved. Anything else I can help you with today?
Thanks Microsoft!!!! (Score:3)
Oh that's news! (Score:3)
Uninstall it (Score:3)
Dave, I cant let you do that (Score:2)
Next thing you know! (Score:3)
Re: (Score:2)
Locking the PC is too obvious. It'll get recorded silently on your social credit score.
Another way to extract subscription fees (Score:3)
They give us a "free" version that can do some interesting stuff, and then roll out a bunch of extra-price "upgrades" that can do fancier stuff.
It's kind of like cars these days with subscriptions for heated seats or longer battery range or "0 to 60 in 3.9 seconds," all of which come at an extra subscription cost.
Well thanks, but no thanks. I'll make it just fine without the heated seats or the screen-reading AI.
No it can't. (Score:2)
No it can't.
Fcuk off Clippy .. (Score:1)
there has to be a way to kill it (Score:2)
There has to be a relatively easy way to kill it, and versions of the OS without it (i.e Enterprise, LTSC)
Doubt this will even be legal in certain jurisdictions/environments- (health office, legal, defense, LEO's, financial institutions)
Case in point- This would very likely be illegal in Canada on computers that are run in doctor's office- it would violate the privacy act.
Most corporate environments won't let this fly on corporate devices or BYOD. So might be default on consumer versions (home, edu, pro),