arxiv preprint – Octo: An Open-Source Generalist Robot Policy

In this episode, we discuss Octo: An Open-Source Generalist Robot Policy by Octo Model Team, Dibya Ghosh, Homer Walke, Karl Pertsch, Kevin Black, Oier Mees, Sudeep Dasari, Joey Hejna, Tobias Kreiman, Charles Xu, Jianlan Luo, You Liang Tan, Pannag Sanketi, Quan Vuong, Ted Xiao, Dorsa Sadigh, Chelsea Finn, Sergey Levine. The paper introduces Octo, a large transformer-based policy pretrained on 800k trajectories from the Open X-Embodiment dataset, designed to be a generalist policy for robotic manipulation. Octo can be instructed via language commands or goal images and can be efficiently finetuned to new sensory inputs and action spaces on various robotic platforms. Experimental results demonstrate Octo’s versatility across 9 different robotic platforms and provide detailed analyses to guide future development of generalist robot models.