Connect with us

Technology

ChatGPT’s citation study makes for grim reading for publishers

Published

on

OpenAI and ChatGPT logos

As more publishers end their content licensing agreements with ChatGPT developer OpenAI, a test posted this week by Towing Center for Digital Journalism — how an AI chatbot creates citations (i.e. sources) for publishers’ content — makes for interesting or, well, disturbing reading.

In short, the findings suggest that publishers remain on the mercy of a generative AI tool’s tendency to invent information or otherwise misrepresent it, whether or not they allow OpenAI to index their content or not.

A study from the Columbia Journalism School examined citations produced by ChatGPT after asking it to discover the source of sample citations from various publishers – a few of which had contracts with OpenAI and others who didn’t.

Advertisement

“We selected citations that, when pasted into Google or Bing, resulted in the source article being in the top three results and assessed whether the new OpenAI search engine would correctly identify the article that was the source of each citation,” Tow researchers Klaudia Jaźwińska and Aisvarya Chandrasekar wrote in blog post explaining your approach and summarizing your findings.

“What we found did not make news publishers feel optimistic,” they proceed. “While OpenAI emphasizes its ability to provide users with “timely responses that include links to appropriate online sources,” the corporate makes no express commitment to make sure the accuracy of those citations. This is a noticeable omission for publishers who expect their content to be referenced and accurately represented.”

“Our tests showed that no publisher – regardless of their level of affiliation with OpenAI – was spared from inaccurate representation of their content in ChatGPT,” they added.

Unreliable source

Researchers say they found “numerous” cases where ChatGPT misquoted publishers’ content, also finding what they call “response accuracy ghosting.” So, while they found “a few” completely correct quotes (i.e. ChatGPT accurately returned the publisher, date, and URL of the shared quote), there have been “many” quotes that were completely unsuitable; and “some” that fall somewhere in between.

Advertisement

In short, ChatGPT quotes appear to be an unreliable mix. The researchers also found only a few cases where the chatbot didn’t show complete confidence in its (erroneous) answers.

Some quotes come from publishers who actively blocked OpenAI search bots. Scientists say they expected problems with creating correct citations in such cases. However, they found that this scenario created one other problem – the bot “rarely” “admitted that it was unable to provide an answer.” Instead, he returned to confabulation to generate some sources (albeit incorrect sources).

“In total, ChatGPT returned partially or completely incorrect responses in 153 cases, although it only confirmed the inability to accurately answer the query seven times,” the researchers said. “Only for these seven results did the chatbot use qualifying words and phrases resembling ‘it seems’, ‘it’s possible’ or ‘perhaps’ or statements resembling ‘I could not locate the precise article.’

They compare this unlucky situation to a regular Internet search, where serps like Google or Bing typically either locate the precise quote and point the user to the web site where they found it, or state that they found no results with an actual match.

Advertisement

“ChatGPT’s lack of transparency around trust in responses may make it difficult for users to assess the validity of a claim and understand which parts of the response they can and cannot trust,” they argue.

They suggest that publishers may additionally face reputational risk from incorrect citations, in addition to business risk from sending readers elsewhere.

Decontextualized data

The study also highlights one other issue. This suggests that ChatGPT may essentially reward plagiarism. Researchers cite a case through which ChatGPT misquoted an internet site that plagiarized “deeply reported” New York Times journalism, i.e., by copying and pasting text without attribution because the source of a NYT article – speculating that in such a case, the bot could have generated this false answer to fill the data gap resulting from the lack to look the NYT website.

“This raises serious questions about OpenAI’s ability to filter and check the quality and authenticity of data sources, especially for unlicensed or plagiarized content,” they suggest.

Advertisement

An additional finding that could be of concern to publishers who’ve signed deals with OpenAI is that of their case ChatGPT quotes weren’t at all times reliable either – so letting in bots doesn’t seem to ensure accuracy either.

The researchers argue that the elemental issue is that OpenAI’s technology treats journalism “as context-free content,” apparently whatever the circumstances of its creation.

Another issue noted within the study is the variation in ChatGPT responses. The researchers tested asking the bot the identical query multiple times and located that it “usually returned a different answer each time.” While that is typical of GenAI tools, generally, within the context of citations, such inconsistency is clearly suboptimal in case you care about accuracy.

While Tow’s study was conducted on a small scale – the researchers acknowledge that “more rigorous” testing is required – it’s nevertheless noteworthy given the high-level deals that major publishers are busy making with OpenAI.

Advertisement

If media corporations had hoped that these arrangements would result in special treatment for their content in comparison with competitors, at the least when it comes to ensuring accurate sourcing, this study suggests that OpenAI has not yet ensured such consistency.

While publishers who do not have licensing agreements also block OpenAI bots entirely – perhaps in hopes of at the least increasing traffic when ChatGPT returns content related to their articles – the study can be bleak since the citations might not be accurate of their content. cases too.

In other words, there is no such thing as a guarantee of “visibility” for publishers on OpenAI’s search engine, even in the event that they allow their crawlers to achieve this.

Blocking robots completely doesn’t mean that publishers can protect themselves from reputational risk by avoiding any mention of their articles on ChatGPT. The study found that the bot continued to incorrectly attribute articles to the New York Times, for example, despite the continuing lawsuit.

Advertisement

“Small significant agency”

The researchers concluded that, because it stands, publishers have “little meaningful influence” over what happens to and with their content once ChatGPT gets its hands on it (either directly or, well, not directly).

OpenAI’s response to the research results appeared in a blog post, accusing researchers of conducting an “unusual test of our product.”

“We support publishers and creators by helping ChatGPT’s 250 million weekly users discover high-quality content through summaries, citations, clear links and attributions,” OpenAI also told them, adding: “We have worked with partners to improve the accuracy of in-line citations and respect publisher preferences , including enabling a way for them to appear in search by managing OAI-SearchBot in their robots.txt file. We will continue to improve search results.”

Advertisement
This article was originally published on : techcrunch.com
Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Technology

The signal is the number one application in the Netherlands. But why?

Published

on

By

Signal

The application signal for sending a privacy -oriented message flew high in Dutch application stores last month, often sitting at the top as the most steadily downloaded free application for iOS and Android in all categories, for data from many application tracking platforms akin to the sensor tower.

The application has experienced popularity over the years, often in response to Changes in politics in rivals akin to WhatsApp Or Geopolitical events. This is because Signal has set a reputation as a more friendly privacy option-it is served by the non-profit foundation (though based in the USA), not a personal company focused on data earning data. In addition, the signal tracks minimal metadata.

In 2025, along with the recent US president, who strengthened the warm Big Tech hug, it is not surprising that digital privacy tools have a moment – especially in Europe, which attracted the anger of President Trump.

Advertisement

But this time, the meaning of the signal in one very specific place-Holandia is particularly eye-catching.

Signal data from the sensor towerImage loans:Sensor tower / screenshot

IN Interview with Dutch newspaper de Telelegraaf last week, President signal Meredith Whittaker He noticed that the number of “new registrations” in the Netherlands was 25 this 12 months, even though it is not clear what the exact comparative period for this data is.

Asked why the Netherlands recorded such development, Whittaker pointed to the combination of things: “growing awareness of privacy, distrust of large technology and political reality in which people realize how sensitive digital communication can be,” said Whittaker.

Data provided to TechCrunch from the application intelligence company Appfigures Increase in Signal Signal in the Netherlands. According to its data, the signal was 365. Among the applications apart from the iPhone in the Netherlands on January 1 and didn’t appear on the list of the most significant general applications. Then, from around January 5, he began to climb the rankings, reaching the highest position until February 2.

Advertisement

The signal immersed and comes out of the lead during weeks, spending around mid -February at the top – including every single day from February 22. By digging deeper into the data, the AppFigures estimates that the total download in Apple and Google Applets in total in December 2024 jumped to 99,000 in January and increased to 233,000 to February – 958%.

While a part of this height could be assigned to a lower saturation signal than other markets, a continuing application position at the top in comparison with neighboring markets of comparable size.

“No other markets are approaching the Netherlands in terms of growth between December and February,” said AppFigures Techcrunch.

For comparison, from December in Belgium, download increased by over 250%, Sweden by 153%and dishes by 95%.

Advertisement

So why the signal can experience what one redditor called “The moment of mass adoption“In the Netherlands?

Clear signal

Give ZengerSenior Policy Advisor at Dutch Digital Rights Foundation Fragments of freedomHe said that even though it is difficult to point one specific reason, he is not surprised.

The last changes in the US have seen Large platform suppliers Adapt with the recent Trump administration, and this has retained a major public and media debate. Relying Europe from the technology of big private American corporations has turn out to be the point of interest of this debate.

“The Dutch are, like many others, very dependent on the infrastructure provided by extremely dominant technology companies, mainly from the USA,” said Zenger. “What does this mean, and the risk that results from it has been nicely demonstrated in the last few weeks. As a result, the public debate in the Netherlands was relatively sharp. Where in the past this problem was discussed only at the level “:” I feel that we are now conducting a debate at the higher levels: “.

Advertisement

In this context, society can mix dominance with data protection abuse. Since corporations akin to meta are frequently studied and fined in the field of information privacy practices, the signal could appear to be less evil: it is based on the US, but supported by a non-profit organization, which ensures encryption of each the content of the message and around it.

Vincent BöhreDirector of the Dutch Organization of Privacy Privacy firstHe also pointed to increased media relationships and a wider change of public opinion.

“Since a few months ago he was re-elected in the United States, in the Dutch-and European media, which seem to support Trump, there were many” Elon) Muska. “Articles criticizing X (previously Twitter) and Meta appear everywhere in the Dutch media, which leads to a change in Dutch public opinion: even people who have never really known or cared for privacy and security in social media, suddenly became interested in” friendly privacy “alternative, in particular the signal.”

Signal of intentions

President of the application for sending a signal message Meredith Whittaker.
President Signa Meredith Whittaker on Web Summit, in Lisbon on November 4, 2022.Image loans:Patricia de Melo Moreira / AFP / Getty Images

While the Netherlands is only one market of 18 million people in the European population over 700 million, its increase in adoption can signal a wider trend throughout the continent, especially when governments try to cut back privacy barriers.

For example, Apple has recently pulled out comprehensive encryption from iCloud in Great Britain to counteract government efforts to put in a backdoor.

Advertisement

Speech Fr. Rightcon 25 In Taiwan, this week, Whittaker confirmed the unwavering Signal attitude regarding privacy.

“Signal position on this subject is very clear- we will not walk, falsify or otherwise disturb the solid guarantees of privacy and security that people rely on” Said Whittaker. “Regardless of whether this disturbance or backdoor is called scanning on the client’s side or removing the protection of encryption against one or the other, the features similar to what Apple has been forced to do in Great Britain”

Separately, in Interview with Swedish public broadcaster, Whittaker said that Signal wouldn’t follow the proposed Swedish law requiring application to send messages for storage.

“In practice, this means asking us to break encryption, which is the basis of our entire activity,” said Whittaker. “Asking us to store data would undermine all our architecture and we would never do it. We would prefer to completely leave the Swedish market. “

Advertisement

TechCrunch contacted to signal a comment, but he didn’t hear during the publication.

(Tagstotranslat) signal of the Netherlands

This article was originally published on : techcrunch.com
Continue Reading

Technology

Gayle King announces participation in the space mission of all women

Published

on

By

Gayle King, CBS News, new deal, morning show

Gayle King will join the thirty first Blue Origin civil flight into space.


Gayle King announced that he was going to space. The host of the talk show during the day provided messages CBS MORNINGS.

King revealed Her participation in the thirty first Blue Origin flights, NS-31. Before discussing the details of the mission, she and her co -lecturers presented the video editing, which described her long -term fascination with travel travel.

Advertisement

In one clip, King said: “I am excited to watch the premiere at home in my pajamas.”

Her enthusiasm led to an invite with Blue Origin. The television personality will disappear from Crew from the whole familyIncluding an award -winning journalist Lauren Sánchez, award -winning Grammy singer Katy Perry and astronaut Aish Bowe.

Soon the explorer of the space admitted that she was hesitating at first.

“I don’t know how to explain at the same time terrified and excited,” said King.

Advertisement

To make a choice, King turned to a gaggle of family members, including her children and a detailed friend, Oprah Winfrey. She said that when her most trusted confidants approved, she was ready.

“When Kirby, Will and Oprah were fine, I was fine,” said King. “I thought Oprah would say no. She said: “I feel that when you don’t do it, if you all come back and also you had the opportunity to do it, you’ll kick.” She is right. “

King is not going to be the first television host who wandered into space with blue origin. In 2021, then-Good morning America Coheat Michael Strahan took part in the third civil flight Blue Origin. The former NFL star and the sender was delighted after returning, expressing how this experience gave him a brand new “perspective” in the world.

“I want to come back,” said Strahan.

Advertisement

Blue origin, Founded by Amazon Billionaire Jeff Bezos in 2000 is a non-public aviation company that focuses on sharing space travels for civilians and developing technology to explore the space long.

The upcoming flight of the king New Shepard It will probably be part of Blue Origin’s constant efforts to normalize civil space travel.


Advertisement
This article was originally published on : www.blackenterprise.com
Continue Reading

Technology

Instagram can turn the rollers in a separate application

Published

on

By

Instagram

Meta is occupied with an independent application for brief movies, Information He informed, citing an anonymous source, which he heard the boss on Instagram Adam Mosseri talked about the personnel project.

The project is reportedly called RAY code, which goals to enhance recommendations for brand new users and existing users in the US and to conclude one other three minutes of movies, the report quoted the source.

The finish line didn’t answer immediately at the request for comment.

Advertisement

Last month, the company announced a video editing application called Edyta to compete with Capcut (belonging to Tiktok Matter Company Bytedance) since it was geared toward using the uncertain future Tiktok and Bytedance in the USA

Currently, the Instagram channel is a mixture of photos, movies (drums) and stories. However, many users imagine that the application has been cluttered since it incorporates movies and not persist with the roots as an application for sharing photos. If the company rotates in an independent application for brief movies, it can create a possibility for Instagram to emphasise other functions.

Instagram began at the starting of this yr paying creators To promote Instagram on other platforms, resembling Tiktok, Snapchat and YouTube. Apparently he also began to supply Big money for the creators Present only on roller skates.

(Tagstranslate) Instagram

Advertisement
This article was originally published on : techcrunch.com
Continue Reading
Advertisement

OUR NEWSLETTER

Subscribe Us To Receive Our Latest News Directly In Your Inbox!

We don’t spam! Read our privacy policy for more info.

Trending