Technology

Scientists warn that AI encodes negative biases against black people

Published

3 months ago

September 4, 2024

A brand new study shows that sophisticated language models like ChatGPT are fraught with biases, including stereotypes about African Americans speaking English.

As more AI research delves into the inner workings of how the technology uses human language, as has develop into commonplace with innovations by OpenAI and other tech players, the anti-Black biases of those tools have gotten apparent.

Large language models (LLMs), corresponding to those utilized in Open AI’s ChatGPT, are subject to biases, in accordance with a paper published within the journal Laboratorium embedded of their programmingIn the article, the authors show that LLM used AND Alekt prejudice and perpetuate racial-linguistic stereotypes toward African-American English speakers, it was reported.

*In case you missed it*: This study shows that large-scale language (AI) models generate racist stereotypes about AAVE (African-American Vernacular English) speakers that are coupled with overtly negative stereotypes about black people, even once they are trained to not accomplish that. https://t.co/ZVTqsWOBoL

— uche blackstock, MD (@uche_blackstock) August 31, 2024

Models overwhelmingly associated AAVE with negative adjectives corresponding to dirty, silly, rude, ignorant, and lazy.

Remember, AI isn’t a panacea. It can reinforce systemic racism and other inequalities, resulting in further harm.

— uche blackstock, MD (@uche_blackstock) August 31, 2024

According to the article, “dialect bias can have harmful consequences: language models are more likely to suggest that AAE speakers will be assigned to less prestigious positions, punished for crimes, and sentenced to death.”

Nicole Holliday, a linguist on the University of California, Berkeley, said that the conclusions of the article should be heard and thoroughly understood.

“Anyone working on generative AI needs to understand this document,” Holliday also warned that while the businesses behind the LLM have tried to handle racial bias, “when bias is implicit… that’s something they haven’t been able to check.”

Despite efforts to correct racial biases in these language models, the biases remain. The authors of the paper argue that using human preference matching to handle racial biases only serves to cover the racism that these models maintain of their protocols.

As the article notes, “As the stakes of decisions entrusted to language models grow, so do concerns that they reflect or even reinforce human biases embedded in the data on which they were trained, thereby perpetuating discrimination against racial, gender, and other minority groups.”

The paper connects the potential biases of those LLMs against AAE speakers to real-world examples of discrimination. “For example, researchers have previously found that landlords engage in housing discrimination based solely on the auditory profiles of speakers, and that voices that sounded black or Chicano were less likely to secure employment in housing in predominantly white neighborhoods than in predominantly black or Mexican-American neighborhoods,” the report reads.

As the paper states, “Our experiments show that these stereotypes are similar to archaic human stereotypes about African Americans that predate the civil rights movement, are even more negative than the most negative human stereotypes about African Americans recorded experimentally, and differ both qualitatively and quantitatively from previously reported explicit racial stereotypes in linguistic models, indicating that they are a fundamentally different type of prejudice.”

The article also warned that, just as American society is becoming less overtly racist, attitudes ingrained within the subprocesses of AI programs will allow anti-black racism to persist inside more acceptable parameters for AI.

The authors of the paper proceed: “Disconcertingly, we also observe that larger language models and language models trained with HF exhibit stronger implicit but weaker explicit biases…There is therefore a real possibility that the allocational harm caused by dialectical biases in language models will become even more severe in the future, perpetuating racial discrimination experienced by generations of African Americans.”

This article was originally published on : www.blackenterprise.com

Technology

Revolut will introduce mortgage loans, smart ATMs and business lending products

Published

7 mins ago

November 22, 2024

IAM

Revolutthe London-based fintech unicorn shared several elements of the corporate’s 2025 roadmap at a company event in London on Friday. One of the corporate’s important goals for next yr will be to introduce an AI-enabled assistant that will help its 50 million customers navigate financial apps, manage money and customize software.

Considering that artificial intelligence is at the middle of everyone’s attention, this move shouldn’t be surprising. But an AI assistant could actually help differentiate Revolut from traditional banking services, which have been slower to adapt to latest technologies.

When Revolut launched its app almost 10 years ago, many individuals discovered the concept of debit cards with real-time payment notifications. Users may lock the cardboard from the app.

Many banks now can help you control your card using your phone. However, they’re unlikely to supply AI features that might be useful yet.

In addition to the AI assistant, Revolut announced that it will introduce branded ATMs to the market. These will end in money being spent (obviously), but in addition cards – which could encourage latest sign-ups.

Revolut said it plans so as to add facial recognition features to its ATMs in the longer term, which could help with authentication without using the same old card and PIN protocol. It will be interesting to see the way it implements this technology in a way that complies with European Union data protection regulations, which require explicit consent to make use of biometric data for identification purposes.

According to the corporate, Revolut ATMs will start appearing in Spain in early 2025.

Revolut has had a banking license in Europe for a while, which implies it may offer lending products to its retail customers. It already offers bank cards and personal loans in some countries.

Now the corporate plans to expand into mortgage loans – some of the popular lending products in Europe – with an emphasis on speed. If it’s an easy request, customers should generally expect immediate approval and a final offer inside one business day. However, mortgages are rarely easy, so it will be interesting to see if Revolut overpromises.

It appears that the mortgage market rollout will be slow. Revolut said it was starting in Lithuania, with Ireland and France expected to follow suit. Although all these premieres are scheduled for 2025.

Finally, Revolut intends to expand its business offering in Europe with its first loan products and savings accounts. In the payments space, it will enable business customers to supply “buy now, pay later” payment options.

Revolut will introduce Revolut kiosks with biometric payments especially for restaurants and stores.

If all these features seem overwhelming, it’s because Revolut is consistently committed to product development, rolling out latest features quickly. And 2025 looks no different.

This article was originally published on : techcrunch.com

Technology

Flipkart co-founder Binny Bansal is leaving PhonePe’s board

Published

7 hours ago

November 22, 2024

IAM

Flipkart co-founder Binny Bansal has stepped down three-quarters from PhonePe’s board after making an identical move on the e-commerce giant.

Bengaluru-based PhonePe said it has appointed Manish Sabharwal, executive director at recruitment and human resources firm Teamlease, as an independent director and chairman of the audit committee.

Bansal played a key role in Flipkart’s acquisition of PhonePe in 2016 and has since served on the fintech’s board. The Walmart-backed startup, which operates India’s hottest mobile payment app, spun off from Flipkart in 2022 and was valued at $12 billion in funding rounds that raised about $850 million last 12 months.

Bansal still holds about 1% of PhonePe. Neither party explained why they were leaving the board.

“I would like to express my heartfelt gratitude to Binny Bansal for being one of the first and staunchest supporters of PhonePe,” Sameer Nigam, co-founder and CEO of PhonePe, said in a press release. His lively involvement, strategic advice and private mentoring have profoundly enriched our discussions. We will miss Binny!”

This article was originally published on : techcrunch.com

Technology

The company is currently developing washing machines for humans

Published

14 hours ago

November 22, 2024

IAM

Forget about cold baths. Washing machines for people may soon be a brand new solution.

According to at least one Japanese the oldest newspapersOsaka-based shower head maker Science has developed a cockpit-shaped device that fills with water when a bather sits on a seat in the center and measures an individual’s heart rate and other biological data using sensors to make sure the temperature is good. “It also projects images onto the inside of the transparent cover to make the person feel refreshed,” the power says.

The device, dubbed “Mirai Ningen Sentakuki” (the human washing machine of the longer term), may never go on sale. Indeed, for now the company’s plans are limited to the Osaka trade fair in April, where as much as eight people will have the option to experience a 15-minute “wash and dry” every day after first booking.

Apparently a version for home use is within the works.

This article was originally published on : techcrunch.com