Tesla has been able to generate realistic video with real world physics using AI for over a year. Dr Know It All, John Gibb, had theorized this a year ago. Elon Musk confirmed this to be the case.
OpenAI Sora is much more visually impressive but FSD 12 is in many ways more amazing especially given that it had to inference at 36fps.
Tesla has been short on compute for FSD training so they have not been using this capability that much. In a training compute abundant situation, then self driving improvement will increase by using generating new training.
What does @OpenAI's Sora have to do with @Tesla's FSD v12? Turns out a lot!
OpenAI BOMBSHELL Confirms TESLA'S Thesis! pic.twitter.com/OXgQwB2s6u— DrKnowItAll (@DrKnowItAll16) February 17, 2024
Exactly. Sora is much more visually impressive but FSD 12 is in many ways more amazing especially given that it had to inference at 36fps.
— DrKnowItAll (@DrKnowItAll16) February 17, 2024
That will be fun to see. What does FSD dream of when it’s not driving? 🧐
I know it’d be a totally different training run on different days but still fun to imagine. Plus this could give grok a fantastic leg up in the competition if Tesla would license the NN stack to them.
So…— DrKnowItAll (@DrKnowItAll16) February 17, 2024
Brian Wang is a Futurist Thought Leader and a popular Science blogger with 1 million readers per month. His blog Nextbigfuture.com is ranked #1 Science News Blog. It covers many disruptive technology and trends including Space, Robotics, Artificial Intelligence, Medicine, Anti-aging Biotechnology, and Nanotechnology.
Known for identifying cutting edge technologies, he is currently a Co-Founder of a startup and fundraiser for high potential early-stage companies. He is the Head of Research for Allocations for deep technology investments and an Angel Investor at Space Angels.
A frequent speaker at corporations, he has been a TEDx speaker, a Singularity University speaker and guest at numerous interviews for radio and podcasts. He is open to public speaking and advising engagements.
But we have already seen this kind of simulation from Tesla, and it was just classical simulation of roads. That’s why Elon is stating that it has accurate physics… Of course it has.. it is based on a physics engine and straight forward simulation just like a computer game.
This is very different from Dora that can produce short clips using a text prompt only
These simulations are high quality synthetic data for training all sorts of advanced NN robots. This will enable significant acceleration of training – which is a bottleneck. That means the new bottleneck is compute for creating this synthetic data and training NN – which is the big hardware shortage that Altman wants to throw Trillions of dollars in investment at