Connect with us

Technology

Benchmarks meta for new AI models are somewhat misleading

Published

on

Meta sign

One of the new flagship AI Meta models released on Saturday, Maverick, Second rating at LM ArenaA test during which human rankings compare the outcomes of models and select which they like. But it appears that evidently the Maverick version, that the finish implemented on LM Arena differs from the version that’s widely available to programmers.

How several And researchers He pointed to X, Meta noticed within the announcement that Maverick on LM Arena is a “experimental version of the chat.” Chart on The official website of LlamaMeanwhile, it reveals that the testing of the LM META Arena was carried out using “Llama 4 Maverick optimized for conversation.”

As we wrote earlier, for various reasons LM Arena has never been essentially the most reliable measure of the performance of the AI ​​model. But AI firms generally didn’t adapt or otherwise adapted their models to higher rating at LM Arena-Lub a minimum of didn’t admit it.

Advertisement

The problem related to adapting the model to the reference point, suspension of it, after which releasing the “vanilla” variant of the identical model, is that programmers are difficult to predict how good it can work in specific contexts. It can be misleading. It is best if the tests tests – miserably inadequate – provide a shutter of strong and weaknesses of 1 model in various tasks.

Indeed, scientists on X have Stark was observed Differences in behavior From publicly to download maverick in comparison with the hosted model on LM Arena. The LM Arena version seems to make use of many emoji and provides extremely long answers.

We arrived at Meta and Chatbot Arena, a company that maintains LM Arena to comment.

(Tagstotransate) benchmark

This article was originally published on : techcrunch.com
Advertisement

Technology

Ilya Sutskever uses Google Cloud to supply AI Startup tests

Published

on

By

Co -founder and former scientist of Opeli and former primary scientist ILYA SUTSKEVER, SAFE SUPERINTELELENCE (SSI), uses the Google Cloud TPU systems to supply their AI research, partly latest partnership that corporations announced on Wednesday press release.

Google Cloud claims that the SSI uses TPU to “accelerate its research and development to build safe, overintelical artificial intelligence.”

Cloud suppliers chase a handful of AI Unicorn startups, which spend tons of of hundreds of thousands of dollars annually on computing power supply for training AI Foundation models. The SSI agreement with Google Cloud suggests that the primary will spend a big a part of its computing budget with Google Cloud; The well -known source says TechCrunch that Google Cloud is the primary supplier of SSI calculations.

Advertisement

Google Cloud has the history of striking computing agreements with former AI researchers, a lot of which now lead billions of dollars of AI start-ups. (Sutskever once worked on Google.) In October Google Cloud said that he can be the primary supplier of computers for World Labs, founded by the previous scientist Ai Ex-Google Cloud Ai Fei-Feii Li.

It is just not clear whether the SSI has hit the partnership with other cloud or computers suppliers. Google Cloud spokesman refused to comment. A spokesman for a secure superintelligence didn’t immediately answer to the request for comment.

SSI got here out of Stealth in June 2024, months after Sutskever left his role because the primary scientist Opeli. The company has $ 1 billion in support from Andreessen Horowitz, Sequoia Capital, DST Global, SV Angel and others.

Since the premiere of the SSI, we’ve got heard relatively little about startup activities. On his websiteSSI says that the event of secure, super -intellectual AI systems is “our mission, our name and our entire product map, because this is our only goal.” SUTSKEVER He said earlier that he identified the “new mountain to climb” and is investigating latest ways to improve the performance of AI Frontier models.

Advertisement

Before the co -founder of Opeli, Sutskever spent several years on Google Brain examining neural networks. After years of conducting work of security, AI Openai Sutskever played a key role within the overthrow of the overall director of OPENNAI Altman in November 2023. Sutskever later joined the worker’s movement to restore Altman as CEO.

After the Sutskever trial, he was supposedly not seen in Openai offices for months and eventually left the startup to start SSI.

(Tagstransate) ilya SUTSKEVER (T) SSI

This article was originally published on : techcrunch.com
Advertisement
Continue Reading

Technology

Meta introduces limited teen accounts on Facebook and Messenger

Published

on

By

The apps Instagram, Facebook and WhatsApp can be seen on the display of a smartphone in front of the logo of the Meta internet company.

Meta introduces teen accounts on Facebook and Messenger. A function that routinely saves young users for the impression of applications with built -in security, shall be available on these platforms within the USA, Great Britain, Australia and Canada, before it expands to additional regions in the long run.

Teen accounts first appeared on Instagram in September last yr after Instagram, and other popular social networks were grilled by American legislators for not doing enough to guard teenagers. As a part of Tuesday’s announcement, Meta said that he brings a brand new built -in account protection for teenagers on Instagram.

With the extension of Facebook and messengers, teenagers shall be routinely placed in an experience that goals to cut back inappropriate content and unwanted contact. Teens under 16 years of age need parents’ consent to vary any of the settings.

Advertisement
Image loans:Finish

While Post on the META blog about launching doesn’t provide exact restrictions under which teenagers shall be placed, the corporate told TechCrunch We -Mail that teenagers will only receive messages from individuals who follow or had news earlier.

In addition, only teen friends can see and reply to their stories. Tags, references and comments will even be limited to people they follow or who’re their friends.

Teens will even receive reminders of leaving social networks after using them for an hour a day. In addition, they shall be enrolled within the “quiet mode” overnight.

As for brand spanking new instagram restrictions, teens under 16 years of age is not going to give you the chance to modify to the platform, unless their parents give them permission. In addition, teenagers under the age of 16 can have to get the parents’ consent to show off the applying function, which blur images containing suspicion of nudity in DMS.

Advertisement
Image loans:Finish

The changes announced on Tuesday show the newest Meta step towards solving problems related to the mental health of teenagers related to social media. These fears were Raised by an American general surgeon and several states, a few of which have even began to limit teenagers from using social media Without the consent of the parent.

The Meta shared insight into how teen accounts on Instagram are doing, because the corporate claims that it has moved 54 million teenagers to teen accounts. The meta claims that there remains to be lots more, because this function remains to be developing all around the world. The company also shared that 97% of teenagers aged 13-15 maintain built-in protection, says finish.

The finish line also commissioned an IPSOS study, which showed that just about all surveyed parents (94%) claim that teen accounts are helpful for fogeys, and 85% consider that they make helping teenagers easier to have positive experiences on Instagram.

(Tagstranslate) Facebook

This article was originally published on : techcrunch.com
Advertisement
Continue Reading

Technology

Trump delays the ban

Published

on

By

TikTok ban, rednote

Donald Trump has signed a brand new executive order “Save Tiktok”.


Tiktok will live to see the next day – at the least for now. On April 4, President Donald Trump signed a brand new executive order delaying the ban on a preferred social application by one other 75 days. The application was to darken in the USA on April 5.

The application, belonging to the Chinese company Bytedance, is now on the second extension in the first quarter of the 12 months. In 2024, President Biden signed bilateral laws of Ban Tiktok, citing fears about national security. Congress voted in a predominant means. Although Trump has signed the executive order to “save” the application, many questioned the legality of the movement. Like many president’s actions at the starting of his term, they complain that evidently he exceeds the authority of the executive office.

Advertisement

Trump announced his move to Stop the ban on social truthSaying that his administration remains to be working on the contract.

“My administration worked very hard on the Tiktok saving contract, and we have made great progress,” Trump wrote on April 4. “The contract requires more work to ensure the signing of all necessary approvals, which is why I sign an executive order to continue tiktok for an additional 75 days.”

Trump quoted his newly imposed tariffs to China as a key reason for detained negotiations for the buyer.

“We hope to continue working in good faith with China, which, as I understand, are not very satisfied with our mutual tariffs – necessary for honest and balanced trade between China and the USA,” wrote Trump. “It proves that tariffs are the most powerful economic tool and very important for our national security. We do not want Tiktok to go dark. We are looking forward to cooperation with Tiktok and China to complete the contract.”

Advertisement

This means a second time Trump entered to delay the ban. On January 2, just a couple of days after returning to the office, he signed the first extension to stop Tiktok, utilized by over 170 million Americans available to users.

The potential sales of Tiktok draws the major attention of the principal players in the business world. According to HillMany private equity firms, the Venture Capital groups and the best technological investors have introduced offers for a preferred application.

Among the firms, apparently in the mix are Blackstone, Oracle, Amazon – led by Jeff Bezos – and the founding father of Onlyfans Tim Stokely. Interest in purchasing Tiktok has increased, how uncertainty about its future in the US is always growing.

The application, utilized by 170 million Americans, is situated at the center of ongoing political and economic negotiations between the United States and China. Along with the upcoming pressure and deadlines, the possibility of selling opened the door to the largest technological and financial names.

Advertisement


This article was originally published on : www.blackenterprise.com
Continue Reading
Advertisement

OUR NEWSLETTER

Subscribe Us To Receive Our Latest News Directly In Your Inbox!

We don’t spam! Read our privacy policy for more info.

Trending