Noyb’s Second Complaint Against ChatGPT for Fabricated Personal Data
Austrian privacy group Noyb has filed a complaint against ChatGPT, highlighting concerns over the chatbot’s tendency to generate false information about individuals. The complaint stems from an incident in August 2024, where a user named Arve Hjalmar Holmen asked the chatbot for information about himself. In response, ChatGPT produced a fabricated story claiming he had murdered two of his children and attempted to murder his third. While some details, such as the number and gender of his children, were accurate, the false narrative raised significant alarm about the potential harm of misinformation.
Noyb argues that OpenAI, the organization behind ChatGPT, is violating the General Data Protection Regulation (GDPR) by allowing the chatbot to produce defamatory content. The group has requested that Norway’s data protection authority impose fines on OpenAI and mandate the removal of the false information. Noyb emphasizes that the GDPR requires personal data to be accurate, and the disclaimer provided by ChatGPT is insufficient to protect users from the repercussions of false information.
OpenAI has acknowledged the issue and stated that it has updated ChatGPT to incorporate online search capabilities, which are expected to improve the accuracy of the information provided. However, Noyb remains concerned that the incorrect information may still exist within the AI model’s dataset. The organization points out that the potential for users to believe false information is a serious risk, especially when it concerns sensitive matters like personal reputation.
In response to the growing concerns about AI and data protection, European data protection authorities formed a task force in 2023 to oversee privacy-related enforcement actions against ChatGPT. This task force was later expanded to address broader issues related to artificial intelligence. The ongoing discussions highlight the need for strict adherence to data protection laws and the importance of ensuring that AI technologies do not compromise individuals’ rights.
Source: ChatGPT hit with complaint for calling user a child murderer