Hello everyone !
I came here to ask for your advice. This is happening at my workplace—we’re a team of about six people in an IT workshop at a vocational rehabilitation center for people with physical disabilities, addictions, or other medical conditions (like me, who suffered from burnout) that prevent them from
working in a traditional company. We have a workshop supervisor who oversees us and assigns us tasks; these can range from creating graphics for the company to video editing. Needless to say, we’re on the computer all day, sharing usernames and passwords. We also share the
same Google account, ChatGPT account, and so on.
One day, when I was getting a little bored at my desk, I decided to ask Gemini a couple of questions, hoping it would help pass the time. And that’s when I noticed something on the left: the history of all the conversations we’d had with it. As I told you, we share the same Google account, so there were questions that my coworkers had also asked Gemini. Out of curiosity, I checked them out; there were questions about video editing, how to do this or that—pretty mundane stuff. But there was also one conversation that caught my attention more than the others, simply titled “Roast Me.”
And then... oh boy. I stumbled upon an incredibly long and disturbing conversation between one of my coworkers and the AI, which kept asking him—and I quote—“Roast my useless self,” “Roast my 20-year-old autistic, dyspraxic, useless self,” “Roast me,” and so on. Just stuff like that.
I can totally see someone doing that once, just for a laugh, and then moving on, but in this case, the coworker kept asking it to tear him apart, and the conversations went on for several days straight. He even gave personal details to make the “roast” more personalized—sometimes very intimate things.
It got so bad that Gemini started giving him the number for a hotline for people who are suicidal or in psychological distress whenever he spammed “roast me” in the chat.
There were also other chat histories of conversation where he asked the same thing, and the AI would respond—or sometimes not. I remember one time Gemini told him something like, “I can’t keep kicking someone when they’re already down.”
Needless to say, I was a little worried about him, knowing that he’d given Gemini so many details about himself that I could tell exactly who he was. As soon as I could, I went to inform our workshop supervisor so he’d be aware of the situation and so no one could tell me I hadn’t done anything when
I was aware of it. He went to talk to him to ask if he was okay, and he replied that everything was fine.
But I’ve been paying close attention over the past few days, and even today he’s still asking Gemini or even ChatGPT to roast him.
Do you think this is a big deal? I’m not really sure what to do, since this coworker and I don’t really talk to each other.