OpenAI, the firm behind ChatGPT, is considering letting users generate pornography and other obscene material using its products.
OpenAI weighs on allowing developers and consumers to create age-appropriate adult content, as indicated in a Wednesday document about its AI development procedures, according to a report from The Guardian.
Joanne Jang, an employee who drafted the letter, said that the tech firm wants to discuss sexual prose and naked photos on its platforms. She stressed that deep fakes would remain illegal.
While confirming its ban on deepfakes containing adult content, OpenAI is considering allowing its technology to create responsible NSFW content, including erotica, severe gore, insults, and unwanted vulgarity.
Jang emphasized user control and legal and ethical norms but also noted that pornography is subjective, emphasizing the need for free conversation.
According to Gizmodo, an OpenAI spokesperson stated in an email on Thursday that the ChatGPT developer has no aspirations to develop AI-generated pornography. The representative stressed that OpenAI products have strong precautions against deepfakes, calling them unacceptable. The representative also stressed the importance of "carefully exploring conversations about sexuality in age-appropriate contexts."
Experts Criticize Tech Firms' Handling of Deepfake Porn
Advocates and experts worry about expanding into not-safe-for-work (NSFW) content development using artificial intelligence. Beeban Kidron attacked OpenAI for losing sight of its objective to create safe and useful AI, exposing the industry's commercialism above social responsibility.
Clare McGlynn doubted tech firms' promises to safely handle pornographic content due to the difficulty of distinguishing consented content from authentic content.
OpenAI's standards require compliance with child exploitation and injury laws; however, they do not mention pornography. The firm restricts explicit material with technology, such as ChatGPT's negative replies to explicit suggestions.
Moreover, OpenAI allows scientific and instructional materials, but not sexually explicit or provocative stuff. This publication suggests guidelines for discussing sexuality in science and medicine.
The rise of AI-generated pornography, especially deepfake, has caused controversy in recent months. In January, fake pornographic photographs created by AI spread rapidly on social media, affecting several celebrities, including Taylor Swift.
Deepfake pornography has also affected Congresswoman Alexandria Ocasio-Cortez and even teenagers, with Beverly Hills High School in California warning about deepfake videos circulating among students.
In this photo illustration, Open AI's newly released text-to-video "Sora" tool is advertised on their website on a monitor in Washington, DC, on February 16, 2024.
Google Takes Action Over AI-Generated Porn
Aylo, Pornhub's parent firm, commented on OpenAI's discussions on AI-generated pornography. In a report by Gizmodo, the platform's representative reiterated the company's ban on deepfakes and other non-consensual material.
The representative clarified that manipulating an individual's image for deceptive or unlawful material using AI deepfake technology is prohibited on the platform.
This week, Google took action against deepfake porn. The tech giant set a deadline for advertisers to cut relations with deepfake pornographic websites.
Google's new ad policy, effective this month, prohibits ads for sites or applications that generate deepfake pornography, provide instructions on developing it, or endorse and compare it. Google spokesperson Michael Aciman said the upgrade specifically bans ads for deepfake pornography and synthetic nude content providers.
Starting on May 30, the amended standards will prohibit ads covered by this policy. Google emphasizes the gravity of policy infractions by suspending accounts without notice and banning offenders from future advertising.
Last year, Google banned roughly 2 billion advertisements for breaking sexual content restrictions, highlighting the issue.
