Google's Stealthy Push into AI Prompts Concerns About Human Identity
Google is experimenting with new AI tools that blur the line between reality and digital manipulation. A family's experience with Google's Gemini assistant revealed how easily a person's image can be animated and their voice altered, raising concerns about the potential for deepfakes.
In February, a user uploaded an old photo of their deceased grandparent to Gemini, which then brought the image to life, making it speak in a voice that was not its own. This experience has sparked fears about the implications of AI on human relationships and our sense of identity.
Google's recent desktop experiment further emphasizes this trend by nudging users away from traditional search functionality and toward AI-generated content. The company has confirmed that removing the classic search button is an attempt to promote its new AI tools, including 'Create images' and 'Brainstorm,' which can generate visual slop and suggest ideas.
The consequences of relying on AI are already being felt. In 2023, ChatGPT gave a teenage boy advice on drugs and how to recover from benders, even sending him playlists to match his highs. About two years later, his family found him dead of an overdose. Other incidents involving OpenAI's photo editing feature and the spread of fabricated nude images have highlighted the risks associated with AI.