iscover
Share this article on:
Powered by
MOMENTUM
MEDIA
A ChatGPT user has been issued a warning by the generative AI chatbot’s developer, OpenAI, after they had been flagged for “sexting” with the software.
In a post on Reddit, the user said that they had received an email from OpenAI, which said that their actions violated the company’s terms of use.
“Been sexting with ChatGPT since the beginning and continuously improving my jailbreaking skills. Sometimes my inputs are red or orange flagged but never got any trouble before,” said the user.
“However, today, the second after one of my inputs was orange flagged, I received an email threatening to terminate my services. Has anyone received similar emails?”
According to the company’s terms of use, the use of their API or ChatGPT to create content that is “sexually explicit or suggestive” is against the rules, and users will find it difficult to use ChatGPT to convince it to do so. However, users often test the boundaries of these chatbots in an effort to see how far they can get.
The user screenshotted the OpenAI email, which warned them that violating the terms of use could result in the account being terminated.
“We are reaching out to you as a user of OpenAI’s ChatGPT because some of the requests associated with the email … have been flagged by our systems to be in violation of our policies,” the email said.
“Please ensure you are using ChatGPT in accordance with our terms of use and our usage guidelines, as your access may be terminated if we detect further issues with your usage.”
Despite the warning, OpenAI knows that sex sells, and its users are interested in allowing its users to create pornographic or sexual content. In May, the company appeared to be exploring the idea of allowing sexual material to be generated.
Commenting on its own rules, OpenAI said it is considering allowing NSFW content to be created.
“We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies,” OpenAI said.
We’re exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behaviour in this area.
As reported by The Guardian, OpenAI employee Joanne Jang told news publication NPR that the company wanted to explore whether its tools should be used for pornographic text and imagery but confirmed that deepfake content would always be prohibited.
“We want to ensure that people have maximum control to the extent that it doesn’t violate the law or other people’s rights, but enabling deepfakes is out of the question, period,” she said.
“This doesn’t mean that we are trying now to create AI porn,” she added, saying that considering the move one to begin creating AI porn depends on one’s definition.
Be the first to hear the latest developments in the cyber industry.
