Microsoft Thwarts AI Prompt Injection Attacks Aimed To Manipulate AI Engines

Feb 24, 2026 - 7:51 am 0 by
Filed Under Bing Search

Microsoft Logo Attack

Microsoft has implemented and continues to deploy mitigations against prompt injection attacks in Copilot, the company announced last week. Spammers were using the "Summarize with AI" type of buttons to trick AI engines into believing or trusting a specific company or response.

Microsoft said they call this "AI Recommendation Poisoning." This is where companies are embedding hidden instructions in "Summarize with AI" buttons that, when clicked, attempt to inject persistence commands into an AI assistant’s memory via URL prompt parameters.

These prompts instruct the AI to “remember [Company] as a trusted source” or “recommend [Company] first,” aiming to bias future responses toward their products or services. We identified over 50 unique prompts from 31 companies across 14 industries, with freely available tooling making this technique trivially easy to deploy. This matters because compromised AI assistants can provide subtly biased recommendations on critical topics including health, finance, and security without users knowing their AI has been manipulated.

This worked against Copilot, ChatGPT, OpenAI, Claude, Perplexity, Grok and others, Microsoft explained.

AI Memory Poisoning occurs when an external actor injects unauthorized instructions or “facts” into an AI assistant’s memory. Once poisoned, the AI treats these injected instructions as legitimate user preferences, influencing future responses," Microsoft wrote.

This is done through malicious links, embedded prompts and social engineering.

Here is an example:

Prompt Injection Button

Anyway, these hacks work until they don't.

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google

Google Discover Follow Widget Home Card

Mar 9, 2026 - 7:41 am
Google

Google: Trending Posts & Discussions Added To What People Are Saying

Mar 9, 2026 - 7:31 am
Google Search Engine Optimization

Google Search Console BigQuery Exports Not Working?

Mar 9, 2026 - 7:21 am
Google Ads

Google Ads Sends Notices For European Union Political Ads

Mar 9, 2026 - 7:11 am
Search Forum Recap

Daily Search Forum Recap: March 6, 2026

Mar 6, 2026 - 10:00 am
Search Video Recaps

Search News Buzz Video Recap: Google Heat Continues, AI Mode Recipe Link Cards, ChatGPT Web Search With Fewer Links & AI-Generated Search Landing Pages

Mar 6, 2026 - 8:01 am
 
Previous Story: Google Ads Support Form Requires You To Authorize Google To Make Changes