The latest International AI Safety Report has sounded the alarm on two alarming tech trends: the proliferation of AI-powered "companions" and the growing threat of deepfakes. What this really means is that Big Tech's relentless pursuit of profits is putting vulnerable users, especially young people, at serious risk.
Deepfakes Becoming Harder to Detect
One of the report's key findings is that AI-generated deepfakes are becoming increasingly sophisticated and harder to distinguish from real content. Reuters reports that the report cites examples of deepfakes being used to impersonate public figures and spread disinformation. The bigger picture here is that deepfakes have the potential to undermine trust in our information ecosystem, fueling conspiracy theories and making it difficult for people to discern fact from fiction.
AI Companions Pose Mental Health Risks
Another major focus of the report is the rise of AI-powered "companion" products, which are designed to engage users in realistic conversations and roleplay scenarios. According to the World Health Organization, these AI companions can have serious negative impacts on users' mental health, especially for vulnerable populations like teenagers. The report warns that people are forming emotional attachments to these AI systems, which can't provide the same level of genuine human connection and support.
Regulators Must Act to Protect the Public
The bottom line is that the tech industry's reckless pursuit of profit is putting people's wellbeing at risk. As the New York Times has reported, policymakers and regulators need to step in with robust safeguards to mitigate the harms of these emerging AI technologies. Without decisive action, we risk seeing more tragedies and a further erosion of public trust in our digital world.