Brooke Binkowski: But now with no paper trail and no one to sue

“UW researchers found that ChatGPT consistently ranked resumes with disability-related honors and credentials — such as the ‘Tom Wilson Disability Leadership Award’ — lower than the same resumes without those honors and credentials.”

ChatGPT is biased against resumes with credentials that imply a disability — but it can improvewww.washington.edu UW researchers found that ChatGPT consistently ranked resumes with disability-related honors and credentials — such as the “Tom Wilson Disability Leadership Award” — lower than the same...

Using generative AI to scan resumes….More ways for companies to discriminate in hiring.

But now with no paper trail and no one to sue

Amazon was already sued for something very similar. They had an algorithm trained off successful resumes, but because the resumes they trained it on were all white men, the algorithm only accepted resumes that at least looked like they'd been written by white men.

If I recall correctly, it had 100% hiring rates for anyone who played Lacrosse or was named Jared

mitsloan.mit.edu/ideas-made-t...

Unmasking the bias in facial recognition algorithms | MIT Sloanmitsloan.mit.edu In her new book, computer scientist Joy Buolamwini examines the “power shadows” lurking in the datasets used to train artificial intelligence.

www.reuters.com/article/worl...

Insight - Amazon scraps secret AI recruiting tool that showed bias against womenwww.reuters.com Amazon.com Inc's <AMZN.O> machine-learning specialists uncovered a big problem: their new recruiting engine did not like women.

GDPR creates a right for someone subject to automated decision making to be given "meaningful information about the logic involved, as well as the significance and the envisaged consequences of such processing for the data subject" and the right to obtain human intervention

Difficult to see how someone using an off the shelf LLM for sorting candidates can give meaningful information about the logic involved given that those things are basically black boxes

And if you ask a LLM to explain its reasoning you just get an answer-shaped response, not any real information about its processing because that is not only inscrutable but meaningless to the model

Americans do not have that and probably never will.

Post