Nvidia’s new AI model makes complex 3D geometry from 2D video clips


Forward-looking: As the ongoing AI boom propels Nvidia into the trillion-dollar club alongside the biggest tech companies on Earth, it continues to unveil new hardware and software tools to leverage AI. One of them could become a new method to facilitate 3D art development for entertainment and enterprise purposes.

Nvidia has unveiled an AI model that can examine 2D video clips of objects and scenes to reproduce them in digital 3D. The technology, called Neuralangelo, could become helpful in game development, industrial digital twins, and robotics.

Suppose a designer uses a smartphone to record a brief video of a truck from multiple angles. In that case, Neuralangelo can select the best frames to build a 3D outline of the vehicle before optimizing a more detailed model. The user can then import the model into a CAD program. The tool can do something similar to an entire structure or interior using video from a drone.

Unlike prior models, Nvidia claims Neuralangelo can capture minute details like glass panels, smooth marble, or roof shingles more accurately. The company’s whitepaper on the method shows Neuralangelo’s higher level of granularity compared to competing models like NeuS and NeuralWarp when reproducing small objects or large buildings.

Click to enlarge

The company will showcase Neuralangelo and almost 30 other research projects on related subjects at the Vancouver Conference on Computer Vision and Pattern Recognition (CVPR) in late June. Neuralangelo is one of the multiple technologies leveraging AI Nvidia has recently presented.

At Computex in Taipei, the company demonstrated a service utilizing generative AI to give video game NPCs a more comprehensive array of dialogue. It can also react dynamically to what players say. Nvidia also unveiled the DGX GH200 supercomputing platform, which will provide powerful chips to help clients like Microsoft, Google, Meta, and SoftBank with AI-based applications.

Despite disappointment from Nvidia’s recent consumer GPUs, the company is seeing explosive growth from enterprise hardware. Generative AI models like ChatGPT, which OpenAI built upon thousands of Nvidia graphics cards, have helped propel a boom in the sector, lifting Nvidia’s valuation to over $1 trillion, making it the first chip company to join the ranks of Apple, Amazon, and Microsoft.


Source link

Photoshop’s Generative Fill tool has users flooding Twitter with cool expansions of iconic album art

Why do some people live to be 100? Intestinal bacteria may hold the answer — ScienceDaily