OpenAI’s Whisper tool may add fake text to medical transcripts, investigation finds.

  • @SpikesOtherDog@ani.social
    link
    fedilink
    131 day ago

    I work in judicial tech and have heard questions of using AI transcription tools. I didn’t believe AI should be used in this kind of high risk area. The ones asking if AI is a good fit for court transcripts can be forgiven because all they see is the hype, but if the ones responding greenlight a project like that there will be some incredibly embarrassing moments.

    My other concern is that the court would have to run the service locally. There are situations where a victim’s name or other information is redacted. That information should not be on an Open AI server and should not be regurgitated back out when the AI misbehaves.

    • @FatCrab
      link
      218 hours ago

      Don’t court stenographers basically use tailored voice models and voice to text transcription already?

      • @SpikesOtherDog@ani.social
        link
        fedilink
        216 hours ago

        I don’t get too technical with the court reporter software. They have their own license and receive direct support from their vendor. What I have seen is that there is an interpreting layer between the stenographer machine and the software, literally called magic by the vendor, that is a bit like predictive text. In this situation, the stenographer is actively recording and interpreting the results.