Connect with us

Technology

The creators of a short video using Sora technology explain the strengths and limitations of AI-generated videos

Published

on

OpenAI’s video generation tool Sora surprised the AI ​​community in February with smooth, realistic video that appears to be well ahead of the competition. However, there are a lot of details unnoticed of the rigorously choreographed debut – details that were filled in by a filmmaker who was given advance access to create a short film starring Sora.

Shy Kids is a Toronto-based digital production team that has been chosen as one of only a few by OpenAI for the production of short movies essentially for OpenAI promotional purposes, although they got considerable creative freedom in creating an “air head”. In fxguide visual effects news interviewpost-production artist Patrick Cederberg described “actually using Sora” as part of his work.

Perhaps the most significant takeaway for many is that this: while OpenAI’s post highlighting the short movies allows the reader to assume that they were created roughly fully shaped by Sora, the reality is that they were skilled productions, equipped with solid storyboarding, editing, color correction, and publish work equivalent to rotoscoping and visual effects. Just like Apple says “recorded on iPhone” but doesn’t show the studio setup, skilled lighting, and color work after the fact, Sora’s post only talks about what it allows people to do, not how they really did it.

The interview with Cederberg is interesting and quite non-technical, so in the event you are in any respect interested, go to fxguide and read. But listed below are some interesting facts about using Sora that tell us that, while impressive, this model is maybe less of a step forward than we thought.

Control is the most desired and most elusive thing at this moment. … The only thing we could achieve was simply hyper-descriptive tooltips. Clarifying the character’s attire, in addition to the type of balloon, was our way of ensuring consistency, since from shot to shot/generation to generation there just isn’t yet a feature arrange to offer full control over consistency.

In other words, things which are easy in traditional filmmaking, equivalent to selecting the color of a character’s clothing, require complex workarounds and controls in the generative system because each shot is created independently of the others. This could change, of course, but it surely’s definitely rather more labor intensive lately.

Sora’s prints also needed to be watched for unwanted elements: Cederberg described how the model routinely generated a face on a balloon that the foremost character has for a head, or a string hanging from the front. They needed to be removed by mail, one other time-consuming process in the event you couldn’t get a prompt to exclude them.

Precise timing and character or camera movements aren’t actually possible: “There is a little bit of temporal control over where these different actions are happening in a given generation, but it’s not precise… it’s kind of a shot in the dark,” Cederberga said.

For example, synchronizing a gesture equivalent to a wave is a very approximate and suggestion-based process, unlike manual animations. And a shot that appears like a panorama pointing upwards at a character’s body may or may not reflect what the filmmaker wanted – so on this case, the team rendered the shot in a vertical orientation and cropped it in post. The generated clips also often played in slow motion for no particular reason.

An example of Sora’s shot and its ending at a glance. Image credits: Shy children

In fact, the use of on a regular basis film language equivalent to “swipe right” and “tracking shot” was generally inconsistent, Cederberg found, which the team found quite surprising.

“Scientists weren’t really thinking like filmmakers before they turned to artists to play with this tool,” he said.

As a result, the team performed a whole lot of generations, each lasting 10–20 seconds, and ended up using only a handful. Cederberg estimated the ratio at 300:1, but of course we might all be surprised at the ratio for a regular photo.

A band, actually he made a little behind-the-scenes video explaining some of the issues they bumped into in the event you’re curious. Like much AI-related content, the comments are quite critical of the whole project — though not as insulting as the AI-powered promoting we have seen pilloried recently.

One last interesting caveat concerns copyright: If you ask Sora to share a Star Wars clip, he’ll refuse. And in the event you attempt to get around this “man in robes with a laser sword on a retrofuturistic spaceship” problem, he may also refuse because by some mechanism he recognizes what you are attempting to do. She also refused to take an “Aronofsky-style shot” or a “Hitchcock zoom.”

On the one hand, it makes total sense. However, this begs the query: If Sora knows what it’s, does that mean the model has been trained on that content to raised recognize that it’s infringing? OpenAI, which holds its training data cards near the vest – to the point of absurdity, as in CTO Mira Murati’s interview with Joanna Stern – he’ll almost definitely never tell us.

When it involves Sora and its use in filmmaking, it’s definitely a powerful and useful gizmo as an alternative, but its purpose just isn’t to “create films from whole footage.” Already. As one other villain famously said, “that will come later.”


This article was originally published on : techcrunch.com
Continue Reading
Advertisement
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Technology

US medical device giant Artivion says hackers stole files during a cybersecurity incident

Published

on

By

Artivion, a medical device company that produces implantable tissue for heart and vascular transplants, says its services have been “disrupted” resulting from a cybersecurity incident.

In 8-K filing In an interview with the SEC on Monday, Georgia-based Artivion, formerly CryoLife, said it became aware of a “cybersecurity incident” that involved the “compromise and encryption” of information on November 21. This suggests that the corporate was attacked by ransomware, but Artivion has not yet confirmed the character of the incident and didn’t immediately reply to TechCrunch’s questions. No major ransomware group has yet claimed responsibility for the attack.

Artivion said it took some systems offline in response to the cyberattack, which the corporate said caused “disruptions to certain ordering and shipping processes.”

Artivion, which reported third-quarter revenue of $95.8 million, said it didn’t expect the incident to have a material impact on the corporate’s funds.

This article was originally published on : techcrunch.com
Continue Reading

Technology

It’s a Raspberry Pi 5 in a keyboard and it’s called Raspberry Pi 500

Published

on

By

Manufacturer of single-board computers Raspberry Pi is updating its cute little computer keyboard device with higher specs. Named Raspberry Pi500This successor to the Raspberry Pi 400 is just as powerful as the present Raspberry Pi flagship, the Raspberry Pi 5. It is on the market for purchase now from Raspberry Pi resellers.

The Raspberry Pi 500 is the simplest method to start with the Raspberry Pi because it’s not as intimidating because the Raspberry Pi 5. When you take a look at the Raspberry Pi 500, you do not see any chipsets or PCBs (printed circuit boards). The Raspberry Pi is totally hidden in the familiar housing, the keyboard.

The idea with the Raspberry Pi 500 is you could connect a mouse and a display and you are able to go. If, for instance, you’ve got a relative who uses a very outdated computer with an outdated version of Windows, the Raspberry Pi 500 can easily replace the old PC tower for many computing tasks.

More importantly, this device brings us back to the roots of the Raspberry Pi. Raspberry Pi computers were originally intended for educational applications. Over time, technology enthusiasts and industrial customers began using single-board computers all over the place. (For example, when you’ve ever been to London Heathrow Airport, all of the departures and arrivals boards are there powered by Raspberry Pi.)

Raspberry Pi 500 draws inspiration from the roots of the Raspberry Pi Foundation, a non-profit organization. It’s the right first computer for college. In some ways, it’s a lot better than a Chromebook or iPad because it’s low cost and highly customizable, which inspires creative pondering.

The Raspberry Pi 500 comes with a 32GB SD card that comes pre-installed with Raspberry Pi OS, a Debian-based Linux distribution. It costs $90, which is a slight ($20) price increase over the Raspberry Pi 400.

Only UK and US keyboard variants will probably be available at launch. But versions with French, German, Italian, Japanese, Nordic and Spanish keyboard layouts will probably be available soon. And when you’re in search of a bundle that features all the things you would like, Raspberry Pi also offers a $120 desktop kit that features the Raspberry Pi 500, a mouse, a 27W USB-C power adapter, and a micro-HDMI to HDMI cable.

In other news, Raspberry Pi has announced one other recent thing: the Raspberry Pi monitor. It is a 15.6-inch 1080p monitor that’s priced at $100. Since there are quite a few 1080p portable monitors available on the market, this launch is not as noteworthy because the Pi 500. However, for die-hard Pi fans, there’s now also a Raspberry Pi-branded monitor option available.

Image credits:Raspberry Pi

This article was originally published on : techcrunch.com
Continue Reading

Technology

Apple Vision Pro may add support for PlayStation VR controllers

Published

on

By

Vision Pro headset

According to Apple, Apple desires to make its Vision Pro mixed reality device more attractive for gamers and game developers latest report from Bloomberg’s Mark Gurman.

The Vision Pro was presented more as a productivity and media consumption device than a tool geared toward gamers, due partly to its reliance on visual and hand controls moderately than a separate controller.

However, Apple may need gamers if it desires to expand the Vision Pro’s audience, especially since Gurman reports that lower than half one million units have been sold to this point. As such, the corporate has reportedly been in talks with Sony about adding support for PlayStation VR2 handheld controllers, and has also talked to developers about whether they may support the controllers of their games.

Offering more precise control, Apple may also make other forms of software available in Vision Pro, reminiscent of Final Cut Pro or Adobe Photoshop.

This article was originally published on : techcrunch.com
Continue Reading
Advertisement

OUR NEWSLETTER

Subscribe Us To Receive Our Latest News Directly In Your Inbox!

We don’t spam! Read our privacy policy for more info.

Trending