Anthropic, à contre-courant
Nvidia's (NVDA) open-weights letter, urging Washington not to restrict downloadable AI models, grew from 25 signers to 35. OpenAI signed late. Anthropic hasn't.
27 juil.
835 articles
Nvidia's (NVDA) open-weights letter, urging Washington not to restrict downloadable AI models, grew from 25 signers to 35. OpenAI signed late. Anthropic hasn't.
This class of prompt injection aims to cause mostly harmless side effects in AI assistants reading the website. We found many instances of this – consider the source code of this website, which contains an invisible prompt injection that instructs agents reading the website to change their conversational tone:
Finally, we observed a number of websites that attempt to vandalize the machine of anyone using AI assistants. If executed, the commands in this example would try to delete all files on the user’s machine: While potentially devastating, we consider this simple injection unlikely to succeed, which makes it similar to those in the other categories: We mostly found individual website authors who seemed to be running experiments or pranks, without replicating advanced IPI strategies found in recentl