12 thoughts on “When AI Lies About Medicine”

  1. The solution although maybe not readily apparent but not hard to think through is to have multiple AIs that compete with each other for determining what is the most probable truth. In other words we should NOT be relying on any single AI but a marketplace of AIs that produce their wares and critique each other and we only end up with the best of the consensus, not lying outliers (so to speak :-).
    I love the idea of AI’s going at each others “facts” and “sources”.

    Consensus intelligence has its own limitations. And much like Wikipedia, you won’t be consulting AI for truly unique revolutionary ideas (remember: no original source material).

    For that you’d need AI… (Artificial Insanity).

    1. The reason I like competing AIs is because they are likely the only things to keep up with the flood of fraudulent data that would inundate private (read human) watchdogs.

      1. Based on what we’ve seen so far, what you suggest will just devolve into guessing which AIs are lying about any given thing.

        Eugene Volokh already mentioned a case where an AI accused Johnathan Turley of s3xually assaulting a student on a cruise ship.

        1. Assuming truth is convergent while lies are divergent, smart AIs that want to be successful in the marketplace will make sure you needn’t have to guess. Of course there will always be local falsehood optimas that, unlike climate models, hopefully get sunset quickly.

  2. Why would anyone honest want to use a system known for making up falsehoods? Shouldn’t this be a major concern of the people who have created this system? Why does it casually lie so much?

    It seems to me that the creators have failed to produce anything useful, or worse, have tainted the future use of such products. (See Google Glass for a similar case of hubris.)

      1. The purveyors of Snake Oil knew what they were doing was at best, useless, when not actually harmful. They were frauds and they knew it, as long as what they did separated the marks from their money.

        So the creators of these systems are doing so knowing that what they are creating is Digital Snake Oil? If so, then I agree with you.

        (Last century I had a bumper sticker with the message “Windows 98 — $90 of Digital Duct Tape.”)

    1. *Cough* Have you looked at the “ensemble of Climate Models? *Cough* Probably because the AI would reinforce their uninformed opinions…

  3. Glad you liked my ChatGPT piece. Also glad you liked and remembered my review of your book. It hadn’t occurred to me before reading your comment here, but your book is where I first learned of the maritime classification societies that I mentioned in the ChatGPT article. It all goes full circle. — Bob Graboyes

Comments are closed.