Difference between revisions of "Robotics"

From David Vernon's Wiki
Jump to: navigation, search
(→‎Vision-Language-Action Models (VLA))
(→‎Predictive WAM)
 
(2 intermediate revisions by the same user not shown)
Line 120: Line 120:
  
 
== Vision-Language-Action Models (VLA) ==
 
== Vision-Language-Action Models (VLA) ==
−
(Also see [[Machine_Learning#Foundation_Models:_Large_Language_Models_.26_Multimodal_Models|Foundation Models: Large Language Models & Multimodal_Models]], [Robotics#World_Action_Models_.28WAM.29|World_Action_Models], and [[Artificial_Intelligence#Limitations_of_Generative_AI|Limitations of Generative AI]])
+
(Also see [[Machine_Learning#Foundation_Models:_Large_Language_Models_.26_Multimodal_Models|Foundation Models: Large Language Models & Multimodal_Models]], [[Robotics#World_Action_Models_.28WAM.29|World_Action_Models]], and [[Artificial_Intelligence#Limitations_and_Dangers_of_Generative_AI|Limitations of and Dangers of Generative AI]])
  
 
[File:new.jpg]] [https://mbreuss.github.io/blog_post_iclr_26_vla.html State of VLA Research at ICLR 2026] by M. Reuss<BR>
 
[File:new.jpg]] [https://mbreuss.github.io/blog_post_iclr_26_vla.html State of VLA Research at ICLR 2026] by M. Reuss<BR>
Line 160: Line 160:
 
[[File:new.jpg]] [https://arxiv.org/abs/2506.09985 JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning] by M. Assran et al., arXiv:2506.09985v1, 2025. <BR>
 
[[File:new.jpg]] [https://arxiv.org/abs/2506.09985 JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning] by M. Assran et al., arXiv:2506.09985v1, 2025. <BR>
 
[[File:new.jpg]] [https://people.idsia.ch/~juergen/who-invented-jepa.html Who invented "JEPA?”] by Jürgen Schmidhuber. <BR>
 
[[File:new.jpg]] [https://people.idsia.ch/~juergen/who-invented-jepa.html Who invented "JEPA?”] by Jürgen Schmidhuber. <BR>
 +
[[File:new.jpg]] [https://arxiv.org/pdf/1803.10122 World Models] by David Ha and Jürgen Schmidhuber, arXiv:1803.10122, 2018. <BR>

Latest revision as of 07:26, 30 September 2026

(Also see Artificial Intelligence and Machine Learning

New.jpg signifies a recently added item

Cognitive Robotics

IEEE Robotics and Automation Society Technical Committee for Cognitive Robotics
Cognitive Robotics Resources (a separate list of links)

Competitions

PARC - Pan-African Robotics Competition

Conferences

IROS 2024 Opening Ceremony Video

Diversity, Equity, and Inclusion

Best Practices in Robotics Education IEEE RAS Women in Robotics Panel Discussion
IEEE Robotics and Automation Society Diversity, Equity, and Inclusion Committee and Committee Members
IDEA: Inclusion, Diversity, Equity & Accessibility Travel Support RAS Conferences
IDEA: A New Initiative to Foster Diversity and Inclusion in the Robotics and Automation Society - Women in Engineering
Black in Robotics Building Community, Advocating for Diversity, Encouraging Accountability
Black in Robotics Special Series at IROS 2020
Science Robotics Special Issue: Highlighting diversity, equity, and inclusion in the field of robotics
The No Excuses List Women Faculty in Robotics
Women in Robotics

Featured Robots

Beatbots, including Keepon Pro
Elegoo robot car
Elegoo Tumbller
Eva: facially expressive humanoid robotic head and demonstration video
Franka Emika Robot
Haru: An Experimental Social Robot From Honda Research
iRobot Create 2
iRobot Create 3
Lynxmotion AL5D 4DOF Robot Arm
Makeblock robot kits
Meca500 robot arm
Quanser QArm 4 dof
ROSA ONE Brain: a robotic platform to assist surgeons in planning and performing complex neurosurgical procedures in a minimally invasive manner

Humanoid Robots

Invasion of the Home Humanoid Robots New York Times (read carefully; it's not what it appears to be)
"It’s the robot we were all expecting – like C3PO": why aren’t humanoids in our homes yet?
The Importance of Being Humanoid

Industry

Anki, Jibo, and Kuri: what we can learn from social robots that didn't make it
Awarri "Our mission is to enable the development and adoption of advanced AI & Robotics technology on the African continent"
Inside China’s robotics revolution
Intrinsic a new Alphabet company dedicated to facilitating widespread deployment of robotics
The real cost of robotics

Manipulation

Matches experiment with anesthesia by Dr Roland Johansson A demonstration of the importance of tactile sensing for manipulation

Navigation

A* Algorithm: a great place to begin
A* Pages: super place to learn more
A* algorithm graphic interactive demo
Pathfinding in maps: graphic interactive demo of
Path planning with A* and RRT & RRT*

Origins

Theseus Claude E. Shannon's 1950 maze-learning mouse robot

Research

EASE - Everyday Activity Science & Engineering: how human-scale manipulation tasks can be mastered by robotic agents
Maria Petrou's Ironing Robot Challenge

Resources

Awesome Robotics: a list of various books, courses and other resources for robotics
Cognitive Robotics Resources separate list of links
Human-Robot Interaction - An Introduction An online textbook by C. Bartneck, T. Belpaeme, F. Eyssel, T. Kanda, M. Keijsers, and S. Šabanović
IEEE guide to the world of robots (this is a new and improved version of what was already a great website)
IEEE Robotics and Automation University (RAS-U)
IEEE Spectrum robotics features
RoboHub All the latest news about robotics
The Construct A Platform to Learn/Teach Robotics from Zero. Everything from robotics theory to ROS based robot programming
The Robotics Primer Workbook

Robot Learning

Robot Learning a talk by Jan Peters
Human-Interactive Robot Learning a course developed in Micro Project TMP-038 as part of the HumanE-AI-Net Network of Excellence (click the Home text at the top-right of the page to access the slides)

ROS

A Gentle Introduction to ROS

Shops

Active Robots online shop

Simulators

Bullet Real-Time Physics Simulation

Societal Impact and Ethics

Here’s why robots are actually going to increase human employment
International Conference Series on Robot Ethics and Standards
Principles of Robotics

STEM Education

Edison
Promoting Innovation in Rwanda through Robotics Education
STEM Robotics
Robotics in STEM Education: Redesigning the Learning Experience
Nine dimensions of STEM learning that can be supported by digital technologies PDF Report (2019)
Using Robotics and Game Design to Enhance Children’s Self-Efficacy, STEM Attitudes, and Computational Thinking Skills (2016)
Experiential learning of electronics subject matter in middle school robotics courses (2015)
Shape Robotics Fable robot
Robotics in Australian Schools with extensive list of robot resources, including Sphero, Edison, Ozobot, Makeblock, Bee-bot, Tetrix, Botley, Blue-bot, Cozmo, Strawbees
Tech-Labs STEM Robotics Education
The Steam Connection building the future, one robot at a time
Coderina Engaging Youth in STEM Exploration with FIRST® LEGO® League
Keza Education Future Lab for kids aged 3 to 14
Creativity Lab STEM education using robots
Design Challenge: Call for proposals to design a robotics program and toolkit to be implemented in Rwandan school curricula and the resultant pilot program with a post on X
Ghana Robotics Academy Foundation

Sustainable Development Goals (SDG)

Sustainable Robotics

Vision-Language-Action Models (VLA)

(Also see Foundation Models: Large Language Models & Multimodal_Models, World_Action_Models, and Limitations of and Dangers of Generative AI)

[File:new.jpg]] State of VLA Research at ICLR 2026 by M. Reuss
ChatGPT for Robotics: Design Principles and Model Abilities Microsoft article
PaLM-E: An embodied multimodal language model; also see palm-e.github.io
RT-1: Robotics Transformer for Real-World Control at Scale arXiv article on RT-1
Supplementary video for RT-1: Robotics Transformer for Real-World Control at Scale Video
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control arXiv article on RT-2
RT-2: Vision-Language-Action Models RT-2 website
RT-2: New model translates vision and language into action Google DeepMind Blog
RT-X: Scaling up learning across many different robot types
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances arXiv article on SayCan
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances SayCan website
Open X-Embodiment: Robotic Learning Datasets and RT-X Models arXiv article on Open X-Embodiment
Open X-Embodiment: Robotic Learning Datasets and RT-X Models Open X-Embodiment Website
Using an LLM to direct our robot Digit Agility Robotics video
Foundation Models in Robotics: Applications, Challenges, and the Future by Firoozi et al. on ArXiV and now in the International Journal of Robotics Research 2024
LEAP: LLM-Generation of Egocentric Action Programs
Robot Learning in the Era of Foundation Models: A Survey arXiv article
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis arXiv article
Will generative AI transform robotics? Nature Machine Intelligence
Good old-fashioned engineering can close the 100,000-year “data gap” in robotics Ken Goldberg, Science Robotics
“Data will solve robotics and automation: True or false?”: A debate Nancy Amato et al., Science Robotics

World Action Models (WAM)

Generative WAM

New.jpg Robotics' End Game, a talk by Jim Fan, Leader of the embodied autonomous research group at Nvidia, at AI Ascent 2026
New.jpg VLAs are dead, long live World Action Models - a summary of Jim Fan's Robotics End Game talk, AI Ascent 2026 by Y. K. Sugi
New.jpg Beyond VLAs: How World Action Models Reshape Robot Manipulation by S. Babamohamadi
New.jpg What Is a World Action Model? by Nvidia
New.jpg Cosmos 3 Omnimodal World Models for Physical AI by Nvidia
New.jpg World Action Models are Zero-shot Policies by S. Ye et al., arXiv:2602.15922, 2026.
New.jpg The Neural World Model Boom by Jürgen Schmidhuber.

Predictive WAM

New.jpg A Path Towards Autonomous Machine Intelligence by Y. LeCun, OpenReview, 2022, introducing Joint Embedding Predictive Architecture (JEPA) and Hierarchical JEPA (H-JEPA)
New.jpg Overview of Yann LeCun's A Path Towards Autonomous Machine Intelligence by S. Ságová
New.jpg Introduction to latent variable energy-based models: a path toward autonomous machine intelligence by A. Dawid and Y. LeCun, Journal of Statistical Mechanics, 2024.
New.jpg JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning by M. Assran et al., arXiv:2506.09985v1, 2025.
New.jpg Who invented "JEPA?” by Jürgen Schmidhuber.
New.jpg World Models by David Ha and Jürgen Schmidhuber, arXiv:1803.10122, 2018.