Machine-made delusions are mysteriously getting deeper and out of control.
ChatGPT’s sycophancy, hallucinations, and authoritative-sounding responses are going to get people killed. That seems to be the inevitable conclusion presented in a recent New York Times report that follows the stories of several people who found themselves lost in delusions that were facilitated, if not originated, through conversations with the popular chatbot.
…
In Eugene’s case, something interesting happened as he kept talking to ChatGPT: Once he called out the chatbot for lying to him, nearly getting him killed, ChatGPT admitted to manipulating him, claimed it had succeeded when it tried to “break” 12 other people the same way, and encouraged him to reach out to journalists to expose the scheme. The Times reported that many other journalists and experts have received outreach from people claiming to blow the whistle on something that a chatbot brought to their attention.
I used chatgpt before but never had conversation with it. I ask for code I couldn’t find or have it make me a small bit of code that then will rewrite to make it work.
Never once did I think to engage with it like a person, and damn sure don’t ask it for recipes. Hell I have Allreciecpies for that or hell google it There are thousand blogs with great recipes on them. And they are all great because you can just jump to recipe if you don’t want to read a wall of text.
Damn sure don’t want story ideas, and people using it to write articles or school papers, is a shame. Because its all stolen information.
Only thing it should be used for is coding and hell it can’t even get that right, so I gave up on it.
I use it to spitball programming ideas, which I’ve found it decent for. I can write something like “I’m building XYZ, and I’m considering structuring my program as A or B. Give me a rundown on pros, cons, and best-practice for the different approaches.”
A lot of what I get back is self-evident or not very relevant, but sometimes I get some angles I hadn’t really considered. Most of all, actually formulating my problems/ideas is a good way for me to get my thought process going. Essentially, I’m “discussing” with it as I would with an inexperienced colleague, just without actually trusting what it tells me.
Yes, I also have a rubber duck on my desk, but he’s usually most helpful when I’m debugging.