Volunteering helped Kush Varshney expand his vision of technology helping society, and focus his work on helping AI systems become safe, trustworthy and transparent.
“When I was in college, machine learning was still an abstract mathematical problem that struggled to make meaningful predictions in messy, real-world contexts,” he says. “I joined IBM Research in part because it was working on people-related problems, which hadn’t even crossed my mind as a use for machine learning. Then in 2013, I volunteered with an organization that connects data scientists with social change organizations. We helped one nonprofit identify villages in Kenya and Uganda most likely to benefit from support. We helped another that installs solar panels on homes in parts of India where the power grid isn’t reliable. This experience started bringing everything together for me: fairness, transparency, trust and social good.”
Kush shared his volunteer impact with IBM colleagues, which led to his co-founding IBM’s Science for Social Good initiative in 2016. It applies data science to address hunger, poverty, health and inequality through partnerships with social enterprises. Kush also became a pioneer in safe, trustworthy and socially responsible machine learning and artificial intelligence, publishing seminal papers and the first book on the topic.
“My early IBM projects were related to human capital management and healthcare, and they were revealing because it became clear that accurate predictions aren’t enough," Kush says. "These systems have consequences on people’s lives, so there must be consideration for fairness, and our models need to be understandable. This is true not just for social enterprises, but for all of IBM’s clients as we develop models that everyone can have confidence in.”
Pursuing that goal, Kush led development of the open-source toolkits AI Fairness 360, AI Explainability 360, and Uncertainty Quantification 360. He also invented algorithms for mitigating unwanted bias, and created factsheets for AI development lifecycle transparency. These are helping IBM clients across sectors to make systems more trustworthy using watsonx.governance.
“I believe we still need to incorporate a greater understanding of moral psychology and ethics," Kush says. "What are the human values we want these systems to express, how do we empower communities to do so, and where does that knowledge reside? It’s in laws, but also in folklore and fables, and all sorts of places. That’s not easy to encode in a computer model. There’s a lot of work needed, but there’s also a great team of smart and caring people I’m privileged to share that effort with at IBM."
As IBM Fellow for AI Governance, Kush will focus on new approaches to mitigating harms and to safely governing large language models, as well as their incorporation into the watsonx platform and other AI-infused products.