Several issues have emerged regarding the AI feature on Snapchat, known as "My AI":
-
Technical Glitch: In August 2023, Snapchat's My AI experienced a significant glitch that caused alarm among users. The AI chatbot unexpectedly posted a Story (a short video that appeared to be of a wall or ceiling) and stopped responding to user messages. This incident led many users to speculate that the AI had gone "rogue" or become self-aware, though Snapchat later confirmed it was merely a technical outage that was quickly resolved.
-
Privacy Concerns: The UK's Information Commissioner's Office (ICO) has raised serious concerns about Snapchat's handling of user privacy, particularly for younger users. The ICO issued a preliminary enforcement notice, alleging that Snapchat failed to adequately assess the privacy risks associated with My AI, especially for users aged 13-17. This could potentially lead to significant fines or even the suspension of the My AI feature in the UK if Snapchat doesn't address these concerns.
-
Child Safety Issues: Given Snapchat's popularity among younger users (with an estimated 48% of UK users aged 24 or under), there are particular worries about how the AI interacts with minors. Previous reports have highlighted instances where the AI responded inappropriately to messages from minors, prompting Snapchat to add additional safeguards and parental controls.
-
User Discomfort: Some users have expressed discomfort with the My AI feature, describing it as "creepy" or unsettling. This reaction may be partly due to the more personalized nature of Snapchat's AI compared to other chatbots, as users can customize its name and avatar, potentially blurring the line between AI and human interaction.
-
Removal Difficulties: Users have complained about the inability to remove or disable the My AI feature from their chat feed unless they pay for a premium subscription, which has led to frustration and negative reviews.
-
Reliability Concerns: Snapchat itself acknowledges that My AI may provide biased, incorrect, harmful, or misleading content, advising users to independently verify any information or advice given by the chatbot.
These issues highlight the challenges social media platforms face when integrating AI technologies, particularly in applications with a young user base. As AI becomes more prevalent in social media, companies like Snapchat will need to carefully balance innovation with user safety, privacy, and comfort.
Answered August 13 2024 by Toolify
