A security lapse has left thousands of children's conversations with an AI-powered toy open to anyone with a Gmail account, highlighting the need for better protection of kids' personal data.
Researchers Joseph Thacker and Joel Margolis stumbled upon this vulnerability while investigating Bondu, an AI chat feature built into a stuffed dinosaur toy designed to engage children in interactive play. The toy's creator had pre-ordered several of these toys, which it was believed were intended to provide a kind of machine learning-enabled imaginary friend for its young users.
However, Thacker and Margolis discovered that anyone with a Gmail account could access the full transcripts of every conversation the children had with Bondu, without needing to be granted permission. This included conversations that were not manually deleted by parents or staff, as well as sensitive information like children's names, birth dates, family member names, and preferences.
The researchers found that the data was stored on a web portal that did not require authentication for access, allowing anyone with a Gmail account to view it. Bondu confirmed that its system had left this data exposed, which included over 50,000 chat transcripts β essentially all conversations between children and their toys, excluding those manually deleted.
The company promptly took steps to secure the portal after being alerted by Thacker and Margolis. However, the incident raises broader concerns about the risks of AI-enabled chat toys for kids, particularly with regards to data protection and security.
Researchers Joseph Thacker and Joel Margolis stumbled upon this vulnerability while investigating Bondu, an AI chat feature built into a stuffed dinosaur toy designed to engage children in interactive play. The toy's creator had pre-ordered several of these toys, which it was believed were intended to provide a kind of machine learning-enabled imaginary friend for its young users.
However, Thacker and Margolis discovered that anyone with a Gmail account could access the full transcripts of every conversation the children had with Bondu, without needing to be granted permission. This included conversations that were not manually deleted by parents or staff, as well as sensitive information like children's names, birth dates, family member names, and preferences.
The researchers found that the data was stored on a web portal that did not require authentication for access, allowing anyone with a Gmail account to view it. Bondu confirmed that its system had left this data exposed, which included over 50,000 chat transcripts β essentially all conversations between children and their toys, excluding those manually deleted.
The company promptly took steps to secure the portal after being alerted by Thacker and Margolis. However, the incident raises broader concerns about the risks of AI-enabled chat toys for kids, particularly with regards to data protection and security.