Source (Techcrunch): Covariant is building ChatGPT for robots | TechCrunch

Techmeme is highlighting this article from TechCrunch. Covariant seems an interesting company.

It just shared details about RFM-1, a Large Language Model (LLM) which allows Robots to ask for instructions for tasks they cannot complete on their own.

1. RFM-1 features 8 billion parameters
2. Their LLM can generate videos of robots performing tasks. These videos can somehow enable robots to do the actions/plan the actions?
   • Not very clear how everything works
3. Covariant says their Model is built using Robots in actual production environments and is therefore better than Robot LLMs built using in-lab robots
   • Sounds like a valid point

More details on Covariant ->

1. Covariant is a UC Berkley spinoff -> https://covariant.ai/
2. Founded in 2017
3. Building Robots with the Ability to see, think and act
4. Building an AI Platform that will allow Robots to think like humans (there goes your workplace productivity)
5. Already chosen as AI Robotics Platform of choice by ABB, KNAPP, Bastian (3 large warehouse integrators)
6. Backed by Temasek (Singapore Sovereign Wealth Fund), Index Ventures, Amplify, Northgate, AIX Ventures, Radical Ventures, and CPP Investments
7. Locations include Emeryville, California, USA and Shenzhen, China
8. Lots of Open Positions including Head of Robotics Software (a bit of a worrying sign if you’re building an AI Platform for Robots but don’t have a Head of Robotics Software)

Covariant Ratings

My quick ratings

1. Product Market Fit – 9/10. Seems immense
2. Funding – 10/10. Lots of Funding and strong backers
3. Interestingness – 10/10. Might be biased as Robots are cool and there doesn’t seem to be as much work in the area of AI for Robots as there should be
4. Team – Incomplete. They certainly don’t make it easy to find out more about their team. Will update if I can get more details
5. Competition & Competitive Advantages – Incomplete. Sorry, don’t know enough about their competitors yet, to rate them on this

Robotics Tomorrow has a pretty good article explaining lots of aspects -> Covariant Introduces RFM-1 to Give Robots the Human-like Ability to Reason | RoboticsTomorrow

Read More

1. Silicon Angle -> Covariant develops video-generating AI model for powering warehouse robots – SiliconANGLE
2. New York Times -> How the A.I. That Drives ChatGPT Will Move Into the Physical World – The New York Times (nytimes.com)