Recently, I was peer reviewing a paper, and it cited one of my papers.
Except... it wasn't anything I had written. The title sounds like something I'd write. It included coauthors I work with, and was in a journal I've published in.
But it wasn't real.
AI is not good for science.
Had the privilege of sharing this with my students:
I gave ChatGPT the same assignment I gave them.
In 2/4 cases, ChatGPT chose to make up references that seem plausible (authors that indeed study that organism; real journals; etc) but do not actually exist or exist somewhere entirely different.