One of the things that sort of keeps us up at night is if you think about the way that we check that our current systems are fair in, say, criminal justice is that we have a system of appeals. We have a system of rulings. You actually have a thing called due process, which means you can check the evidence that’s being brought against you. You can say, “Hey, this is incorrect.” You can change the data. You can say, “Hey, you’ve got the wrong information about me.”
This is actually not how AI works right now. In many cases, decisions are gonna be made about you. You’re not even aware that an AI system is working in the background. Let’s take HR for a classic case in point right now. Now, many of you have probably tried sending CVs and résumés in to get a job. What you may not know is that in many cases, companies are using AI systems to scan those résumés, to decide whether or not you’re worthy of an interview, and that’s fine until you start hearing about Amazon’s system, where they took two years to design, essentially, an AI automatic résumé scanner. – How will AI change your life? AI Now Institute founders Kate Crawford and Meredith Whittaker explain.
Everyone who works on AI products needs to understand the ethical implications of their work. AI engineers and product managers need to understand their product’s impact on users. Business leaders and engineers need to bring in diverse voices and specialties to help ensure their product doesn’t have negative implications. Human resources leads need to hire interdisciplinary workers, who connect the dots between design, engineering, and business performance.
All of this is of course easier said than done. Judging by the many, many, many fails in AI product development, we aren’t even close to that point inside of AI organizations. These “fails” have a tremendous impact on people’s lives.
Ethics is a loaded term and businesses aren’t quite sure what ethics and AI even looks like. Just look at the recent dissolving of Google’s AI ethics board. While many questioned who got to be on that board, many others questioned exactly how an ethics board translates into ethical business practices and products.
Thankfully there are several individuals and organizations working at the intersection of AI and ethics. My personal favorite is the AI Now Institute. I could have pulled so many other impactful quotes from their recent interview on the Recode Decode podcast. Have a listen to that episode to get your head around the many challenges of AI and ethics. And if you’re really into AI and ethics, check out this list of people to follow on Twitter.
Now that my first book on the future of work is moving forward, I’m turning my research towards AI and ethics, specifically how organizations train talent to reduce bias in AI products. So expect more of this type of content in the coming months.
I’m also speaking at Portland’s Machine Learning for All conference on how to have curious conversations. I’ll be teaching software and machine learning engineers how to hone their soft skills to build connections and work interdisciplinary to ensure they’re bringing the right voices into their work.