Explainable AI for Transparent Decision-Making

Ged Roberts

Artificial intelligence (AI) and machine learning (ML) have increasingly embedded automated decision-making in our everyday lives, be it in devices or institutional services. The use of our data to determine outcomes is now a given. How data is used to arrive at a decision is at best guesswork, if not completely unknown.

Yet, the impact of algorithmic decision-making is significant. From the trivial result of recommending what next to see at the movies, to loan approvals, interview selections, or even determining criminal sentencing guidelines, the uses of black box algorithms are life changing.

If we are ready to embrace AI-based decisions, then we need to trust the companies that build them. This puts the onus of AI-based outcomes with organizations and how they deploy them. Therefore, it is essential that companies establish transparent guidelines on how their solutions work, substantiated by auditable development and deployment mechanisms.

We do not claim to have a solution for all ills, but in this blog, we explore strategies companies can employ to enable traceability, predictability, and accountability of decisions.

A General Approach - Start with the End in Mind

The first step in approaching the challenge of explainable AI is for enterprises to tackle potential risk areas by identifying the positive and negative consequences of outcomes, and how negative outcomes will be redressed. For example, negative outcomes could be gender or ethnic bias. Further, when looking at outcomes and consequences, firms will face the next level of challenges—How can each outcome be tested? Is each potential outcome a fair result? How can firms collect data (with due consent) to generate these outcomes?

Simply highlighting the negative consequences of an outcome creates a different thought process on managing results.

Consider the example of recruitment prediction—a model can be developed to receive a resume and predict whether a candidate is suitable or not. The outcome could be a simple binary choice of yes or no.

Establishing clear criteria at the conceptualization stage drives two behaviors. First, the scope of a project now encompasses not just building the AI models and producing them, but also includes validation and verification criteria for both development and production. Second, it establishes traceability of goals and decisions, thereby providing the first level of accountability.

Testing and Monitoring Outcomes for Enhanced Transparency

When the scope of a project is defined not just as AI/ML model development, but as one where outcomes are operationally validated and verified, enterprises can develop the project along three highly interrelated streams:

Stream 1: Proceed with model development through the usual activities of clustering, classification, training, and testing. There is specific focus on removing features and their proxies that lead to biased outcomes.

Stream 2: Develop mechanisms to demonstrate the explainability of the model. The many methods for this activity range from decision trees to using model-agnostic techniques such as LIME and Shapely values. Based on the problem and the advantages and disadvantages of each model, a single or a combination of models can be used.

Stream 3: Establish and test the outcomes and methods which will monitor AI models. As mentioned above, when defining the problem, the result of fair outcomes needs to be constantly monitored. If required, an organizational process to redress a raised query on a deployed model can be designed, developed, and institutionalized. If the number of results from the model is so large that enterprise teams are unable to manage them manually, they will need to develop effective sampling methods.

The results of all three streams are baselined and deployed into production. Once in production, clear governance and reporting ensures auditability and visibility for outcomes. The reporting covers all aspects of the model, operational performance, explainability values, external queries, and their results. Models that do not yield results with planned outcomes will be reconfigured or even withdrawn.

Deploying Explainable AI Organization-Wide

Organizations implicitly believe that explainable AI is only applicable for human-related outcomes. However, if they establish a policy of making all model-based decisions explainable, then they can deploy those models with rigor and discipline.

For example, an organization’s vendor management team may cancel contracts with a supplier based on predicted component failures. That supplier would need to understand how that decision was reached, which an explainable AI model can determine.

When explainable AI/ML becomes a way of life for model development, enterprises can understand its necessity, and consequently, they can optimize and automate development processes.

Maximizing Explainable AI with Governance

Transparency is necessary irrespective of whether decisions are people-based or machine components-based. As organizations roll out automated solutions at scale, they can ensure AI transparency by explaining what an AI model does, identifying how it achieves these outcomes, and redressing any unjustifiable results. Clear governance ensures accountability and transparency, which is key to developing trust for an organization’s end-customers.

About the author

Ged Roberts

Ged Roberts is the Global Head of Operations and Delivery Excellence for HiTech at TCS. With over 30 years of experience, he is responsible for maintaining a single global service standard across the business unit, and for ensuring that TCS' customers experience certainty and assured service delivery.

I consent to processing of my personal data entered above for the purpose of receiving newsletter from TCS

For further details on how your personal data will be processed and how your consent can be managed, refer to the TCS Privacy Notice.

Contact

TCS is here to make a difference through technology.

We’re in it for good, driving positive change for the benefit of all.

Extraordinary expertise leads to remarkable results.

Want to be a global change-maker? Join our team.

Find the latest news about TCS in our Newsroom

Recent Press releases

Recent News

Recent recognitions

TCS works hand in hand with world-leading investors.

TCS is here to make a difference through technology.

We’re in it for good, driving positive change for the benefit of all.

Extraordinary expertise leads to remarkable results.

Want to be a global change-maker? Join our team.

Find the latest news about TCS in our Newsroom

Recent Press releases

Recent News

Recent recognitions

TCS works hand in hand with world-leading investors.

Why Enterprises Need Explainable AI for Transparent Decision-Making

About the author

Ged Roberts

TCS is here to make a difference through technology.

We’re in it for good, driving positive change for the benefit of all.

Extraordinary expertise leads to remarkable results.

Want to be a global change-maker? Join our team.

Find the latest news about TCS in our Newsroom

Recent Press releases

Recent News

Recent recognitions

TCS works hand in hand with world-leading investors.

About the author

Ged Roberts

Related reading

Stay in the know

Oops! Something went wrong!