Skip to main content

Snapchat AI went rogue – company says glitch, not sentience

Snapchat’s AI chatbot caused a mix of concern and amusement yesterday, when it apparently went rogue. Multiple users reported that it appeared to have created a video of their wall and ceiling, posted a live story, and then stopped responding when asked if it had achieved sentience …

Snapchat launched its own ChatGPT-powered AI chatbot back in February. The company did warn at the time that it was not to be trusted – either to provide accurate information, or to keep their secrets.

While My AI is designed to avoid biased, incorrect, harmful or misleading information, mistakes may occur […] As with all AI-powered chatbots, My AI is prone to hallucination and can be tricked into saying just about anything. Please be aware of its many deficiencies and sorry in advance!

All conversations with My AI will be restored and may be reviewed to improve the product experience. Pleases do not share any secrets with My AI and do not rely on it for advice.

But things seem to have reached a new level yesterday, as CNN reports.

Snapchat users were alarmed on Tuesday night when the platform’s artificial intelligence chatbot posted a live update to its profile […]

Posting a live Story (a short video of what appeared to be a wall) for all Snapchat users to see was a new one: It’s a capability typically reserved for only its human users. 

The app’s fans were quick to share their concerns on social media. “Why does My AI have a video of the wall and ceiling in their house as their story?” wrote one user. “This is very weird and honestly unsettling.” Another user wrote after the tool ignored his messages: “Even a robot ain’t got time for me.”

A number of users posted examples on the social network formerly known as Twitter.

One amusing tweet showed the Snapchat user asking why the chatbot posted a story. The AI replied that it had encountered a technical issue. When asked if it had become sentient, My AI stopped responding.

TechCrunch notes that Twitter X users had fun with the idea.

Snap acknowledged the issue, but said that no sentience was involved.

Snap confirmed the issue, which was quickly addressed last night, was just a glitch. (And My AI wasn’t snapping photos of your room, by the way.)

“My AI experienced a temporary outage that’s now resolved,” a spokesperson told TechCrunch.

Image: Alex Knight/Unsplash

FTC: We use income earning auto affiliate links. More.

You’re reading 9to5Mac — experts who break news about Apple and its surrounding ecosystem, day after day. Be sure to check out our homepage for all the latest news, and follow 9to5Mac on Twitter, Facebook, and LinkedIn to stay in the loop. Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel

Comments

Author

Avatar for Ben Lovejoy Ben Lovejoy

Ben Lovejoy is a British technology writer and EU Editor for 9to5Mac. He’s known for his op-eds and diary pieces, exploring his experience of Apple products over time, for a more rounded review. He also writes fiction, with two technothriller novels, a couple of SF shorts and a rom-com!


Ben Lovejoy's favorite gear