4 questions to ask when evaluating AI prototypes for bias

Share Story on

It’s true there has been progress around data protection in the U.S. thanks to the passing of several laws, such as the California Consumer Privacy Act (CCPA), and nonbinding documents, such as the Blueprint for an AI Bill of Rights. Yet, there currently aren’t any standard regulations that dictate how technology companies should mitigate AI bias and discrimination.

As a result, many companies are falling behind in building ethical, privacy-first tools. Nearly 80% of data scientists in the U.S. are male and 66% are white, which shows an inherent lack of diversity and demographic representation in the development of automated decision-making tools, often leading to skewed data results.

Significant improvements in design review processes are needed to ensure technology companies take all people into account when creating and modifying their products. Otherwise, organizations can risk losing customers to competition, tarnishing their reputation and risking serious lawsuits. According to IBM, about 85% of IT professionals believe consumers select companies that are transparent about how their AI algorithms are created, managed and used. We can expect this number to increase as more users continue taking a stand against harmful and biased technology.

So, what do companies need to keep in mind when analyzing their prototypes? Here are four questions development teams should ask themselves:

Have we ruled out all types of bias in our prototype?

Technology has the ability to revolutionize society as we know it, but it will ultimately fail if it doesn’t benefit everyone in the same way.

To build effective, bias-free technology, AI teams should develop a list of questions to ask during the review process that can help them identify potential issues in their models.

There are many methodologies AI teams can use to assess their models, but before they do that, it’s critical to evaluate the end goal and whether there are any groups who may be disproportionately affected by the outcomes of the use of AI.

For example, AI teams should take into consideration that the use of facial recognition technologies may inadvertently discriminate against people of color — something that occurs far too often in AI algorithms. Research conducted by the American Civil Liberties Union in 2018 showed that Amazon’s face recognition inaccurately matched 28 members of the U.S. Congress with mugshots. A staggering 40% of incorrect matches were people of color, despite them making up only 20% of Congress.

By asking challenging questions, AI teams can find new ways to improve their models and strive to prevent these scenarios from occurring. For instance, a close examination can help them determine whether they need to look at more data or if they will need a third party, such as a privacy expert, to review their product.

Plot4AI is a great resource for those looking to start.

4 questions to ask when evaluating AI prototypes for bias by Ram Iyer originally published on TechCrunch



Search By Category

Recent News

You May Also Like

Ahmedabad Celebrates New Retail Destination and Marks Anniversary in Style

Ahmedabad Celebrates New Retail Destination and Marks Anniversary in Style

Ahmedabad (Gujarat) [India], February 24:  Ahmedabad was in for a delicious surprise as Palladium Ahmedabad celebrated a dual milestone: the grand opening of their much-anticipated

Better health of healthcare workers in India: A Closer Look Insights by Dr. Gopal Sharan MD & CEO of TRLS Healthcare Consultancy

Better health of healthcare workers in India: A Closer Look Insights by Dr. Gopal Sharan MD & CEO of TRLS Healthcare Consultancy

New Delhi (India), February 24: In the noble profession of healthcare, where the real human touch is felt, dedicated healthcare workers render invaluable services to

Gripping poster of Gujarati movie “31st” unveiled

Gripping poster of Gujarati movie “31st” unveiled

Ahmedabad (Gujarat) [India], February 24: Excitement is mounting as the much-anticipated poster of the Gujarati film “31st” was unveiled in Ahmedabad on Wednesday, offering a tantalising

Akshaya Patra and The Breakfast Revolution Collaborate With USA Based ‘Share Our Strength’ To Impact 10,000 Children For Nutritious Meals

Akshaya Patra and The Breakfast Revolution Collaborate With USA Based ‘Share Our Strength’ To Impact 10,000 Children For Nutritious Meals

Culinary maestro Sanjeev Kapoor, and Chefs Asma Khan, Manish Mehrotra, Prateek Sadhu and Anil Rohira come together to provide a special dining experience to guests

Varmora Granito Unveils Flagship Showroom in Dewas, Madhya Pradesh

Varmora Granito Unveils Flagship Showroom in Dewas, Madhya Pradesh

Dewas (Madhya Pradesh) [India], February 24: Varmora Granito, a leading manufacturer of Tiles, Sanitaryware, and Bathware, is excited to announce the grand opening of its

Vivanza Biosciences Ltd reports Net Profit Jump of 37 per cent in 9MFY24; Total Income more than doubles to Rs. 23.50 crore

Vivanza Biosciences Ltd reports Net Profit Jump of 37 per cent in 9MFY24; Total Income more than doubles to Rs. 23.50 crore

Ahmedabad (Gujarat) [India], February 24: Gujarat based Vivanza Biosciences Ltd (BSE – 530057) – engaged in the business of pharmaceuticals and agro trading has reported