John Chivall: Difficult to see how someone using an off the shelf LLM for sorting candidates can give meaningful information about the logic involved given that those things are basically black boxes

“UW researchers found that ChatGPT consistently ranked resumes with disability-related honors and credentials — such as the ‘Tom Wilson Disability Leadership Award’ — lower than the same resumes without those honors and credentials.”

ChatGPT is biased against resumes with credentials that imply a disability — but it can improvewww.washington.edu UW researchers found that ChatGPT consistently ranked resumes with disability-related honors and credentials — such as the “Tom Wilson Disability Leadership Award” — lower than the same...

Using generative AI to scan resumes….More ways for companies to discriminate in hiring.

But now with no paper trail and no one to sue

GDPR creates a right for someone subject to automated decision making to be given "meaningful information about the logic involved, as well as the significance and the envisaged consequences of such processing for the data subject" and the right to obtain human intervention

Difficult to see how someone using an off the shelf LLM for sorting candidates can give meaningful information about the logic involved given that those things are basically black boxes

And if you ask a LLM to explain its reasoning you just get an answer-shaped response, not any real information about its processing because that is not only inscrutable but meaningless to the model

Post