7

See Ban ChatGPT network-wide for reference.

Briefly, ChatGPT is a language model that uses the statistics of words in a training dataset to generate grammatically correct responses to plain language prompts.

That means you could take a Stack Exchange question, put it into ChatGPT, and with no effort have a lengthy text answer generated.

The main problems with ChatGPT for a site like this are:

  1. Attribution to ChatGPT is required, but most people using the content ignore this.

  2. Nothing ensures the output is accurate, it's just based on a statistical model that can go horribly wrong at times. Worse, even wrong output is written in a way that can seem accurate/knowledgeable. ChatGPT is very good at "faking" answers, which means it takes far more human effort to identify bad ChatGPT answers, while it takes almost no effort to post one.

  3. Nothing prevents ChatGPT from plagiarizing. It does not reference the material it is trained on, and very easily could lift entire passages from specific items in sufficiently niche areas.

  4. Even if the sentences it produces are not lifted, ChatGPT doesn't reference the sources used, which is a requirement for most answers here.

  5. No value is added. If someone wants to get an AI answer to their question, they can just go to ChatGPT and ask it themselves. Posting a ChatGPT answer is not really any different than pasting a question into Google and copying a list of the first several entries. If someone wants the first 5 results to a particular Google search they can just use Google.

For simplicity, I recommend we simply ban this content here. Moderators here can already remove ChatGPT-sourced content that infringes on existing site rules, and I doubt there will be many ChatGPT posts that meet our other standards, so this policy change won't really affect much except to make it clear and avoid any argument about what is and isn't acceptable.

7
  • Sounds good to me.
    – Arnon Weinberg Mod
    Dec 12, 2022 at 18:55
  • 1
    "For simplicity, I recommend we simply ban this content here." While I agree that ChatGPT generated content does not belong here, and I'll go and read the post you linked too in a moment, surely, to effectively ban this content we need to determine its existence. Apart from lack of citations, what definitive clues are there to determine that an answer was generated with ChatGPT compared to a basic uncited answer? Dec 13, 2022 at 4:43
  • @ChrisRogers Eh, don't want to give away too many tricks, but there are some tells. You'll see a bit of discussion of it on the linked post from the main meta.
    – Bryan Krause Mod
    Dec 13, 2022 at 5:22
  • 1
    I too agree fully with this and I have asked a question on meta on how to identify chatGTP-based answers. It received some interesting answers.
    – AliceD Mod
    Dec 13, 2022 at 17:13
  • 5
    "I doubt there will be many ChatGPT posts that meet our other standards" Since one thing it omits is citations, they would at the very least attract "citation needed" notices. Maybe this would be a good time to make that policy more stringent and remove answers without citations after a certain timeout period?
    – Steven Jeuris Mod
    Dec 15, 2022 at 10:45
  • I agree, @StevenJeuris. With answers, I have often thought we need to strive for quality over quantity. Dec 16, 2022 at 5:20
  • @StevenJeuris - that sounds like like a very good idea to me
    – AliceD Mod
    Dec 19, 2022 at 9:13

0

You must log in to answer this question.

Browse other questions tagged .