Andrew D Thaler: ChatGPT hallucinating Material Safety Data Sheets is a nightmare scenario for lab safety: www.funraniumlabs.com/2024/04/phil...

ChatGPT hallucinating Material Safety Data Sheets is a nightmare scenario for lab safety: www.funraniumlabs.com/2024/04/phil...

Phil vs. LLMs - Funranium Labswww.funraniumlabs.com Last year, my friend Ed made a post regarding the nascent proliferation of ChatGPT and competitors into various search engines and other products. With a moment’s contemplation after reading it, I jus...

I used to work in regional theatre craft shops. The thought of LLMs fantasizing Material-Safety Data Sheets is making me break out in a cold sweat that smells of acetone and polyester resin.

I used to work in a biology lab studying infectious diseases... same, same, same.

"Oligonucleotides were invented by Warren Harding in the early 20th century..."

Warren Gameliel Harding Alone in the White House, watching the sun Come up on the morning of 1921 (Al Stewart)

I still do. SAME SAME SAME SAME.

I was a welder. Using an LLM for a materials data sheet is like using a welder for writing notes on paper

Oh sweet fuck no.

This is going to get people fucking killed. And I hope OpenAI gets held criminally responsible when it happens.

Of course the main reason why so many c-suiters are in love with the idea of doing everything with AI is that they believe this will free them from all responsibility...

JEEBUS!!! I spent the last 16 years of my working life up to my eyeballs in HAZMAT transportation safety. Gods alone know how often information on an MSDS kept us from doing something stupid. The idea that AI engines will utter incorrect MSDS information in response to a query is scary AF.

I used to work in an environmental lab and yeah, my stomach dropped reading this.

Cant believe the Dr Sbaitso reference 😆

@chemjobber.bsky.social this is fine 😐

it's not great

Oof. The word "Chat" is right there in the name. It's like asking the random guy sitting next to you at the bar... If you wouldn't trust his answer, maybe don't trust the computer simulation of him?!

hey @lissaharris.bsky.social

NOOOOOO

My eyebrows have never lifted as high as they went when I read that.

Oh sweet bald-headed baby Christ on a pogo stick, *who the fuck thought this was a good idea* This is literally gonna get someone killed or hospitalized. Possibly MULTIPLE persons killed or hospitalized. Possibly even in the same incident

I would reckon that eventually, it would lead to hundreds, thousands or even millions, of lives injured and/or killed. In one single incident. I shudder to even begin imagining such a scenario.

This is how #SpicyAutocorrect will indirectly lead to human extinction: By raising a generation of people who stop using their own brains to critically check the Generated Autocorrect content.

Using chatGPT in any safety critical context is a nightmare scenario 😭

The primary/secondary distinction is well-put and so consequential in my field as well (law)

How does liability work in the scenario in which some poor tuna asks ChatGPT for advice and gets, as here, a lethally bad answer?

I can’t comment on Phil B’s post. I don’t know who Phil B is. But But This example is BAD actually

vinyl chloride and poly(vinyl chrloride) are different things.

My bad. I used one that could show the relevant info on one page. Here’s the top MSDS from a supplier, Sigma Aldrich, for vinyl chloride, with firefighting instructions on page 3

It also says do not attempt to extinguish.

And, of course, a metal fire is very different from a gas leak. Which is all a great case for why we should never rely on either ChatGPT or the first result of Google when dealing with health and safety.

My eyes suck. I see this caveat nowhere. I do not think they suck that badly.

Page 2. P337

Jesus

"Don't be evil" seems so long ago.

WTF?

@provisionalirs.bsky.social hey buddy your jobs about to get a lot stupider

No. No. NononononONoNoNONONONONONO

This is the correct response

📌

Post