Overview
AI models reflect existing biases if these biases are not explicitly eliminated by the data scientists developing the systems. Constant monitoring of the entire operation is required to detect these shifts. The remedy for such lack of focus is training.
Mercator Advisory Group’s latest research Report, Tracking Mistakes in AI: Use Vigilance to Avoid Errors, discusses modes in which data models can deliver biased results, and the ways and means by which financial institutions (FIs) can correct for these biases.
“AI solutions can unwittingly go astray,” comments Tim Sloane, the Report’s author and director of Mercator Advisory Group’s Emerging Technology Advisory Service and its VP Payments Innovation. “Applying AI to issues that can have large negative social consequences should be avoided. One example of this is using AI to implement the business plan of social networks Facebook, You Tube, and others, as presented in the documentary “The Social Dilemma.” The documentary contends that social networks have optimized AI to drive advertising revenue at the expense of the individual and society. To drive revenue, social networks build psychographic models for each user to predict exactly which content will best engage that user.”
This document contains 15 pages and 3 exhibits.
Companies mentioned in this research note include: The Federal Reserve, ProPublica, The Verge.
One of the exhibits included in this report:
Highlights of the research note include:
- A glossary of terms
- The various modes in which data can evidence biases
- Solutions
- Prophylactic methods
- The appeal—and danger—of shortcuts
Learn More About This Report & Javelin
Related content
Credit Scoring: A Cornerstone to Credit Extension and Management
The traditional methods of credit scoring—time-tested and statistically sound—remain excellent ways of assessing the creditworthiness of consumers. FICO Score 8, the dominant credi...
High-Yield Savings Accounts: An Efficient Way to Fund Credit Card Loans
Credit card lending requires funding, and banks with credit card programs find themselves at an interesting point: The prime rate is at its highest level in decades, and in anticip...
Credit Card Lending Needs a Slowdown; Work with Cardholders to Shield Upcoming Risk
Consumer debt is climbing, and for the wrong reason. Consumptive spending is evident on credit cards, and household budgets are under stress, diminishing the ability of consumers t...
Make informed decisions in a digital financial world