Difference between revisions of "Cognitive Robotics"

From David Vernon's Wiki
Jump to: navigation, search
(Content details:)
(Software)
 
(127 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
The following pages provide support material for the course on [http://vernon.eu/cognitive_robotics/index.htm Cognitive Robotics].
  
__NOTOC__
+
== General Resources ==
<span style="color:#AB0000">XX-YYY</span>
+
[[Cognitive Robotics Resources]]
  
<span style="color:#AB0000">Course discipline: TBD</span>
+
== Software ==
 +
<!-- [[CORO Software Development Environment]] <BR> -->
 +
[[Cognitive Robotics - Software Installation Guide | Software Installation Guide]] <BR>
 +
[https://github.com/cognitive-robotics-course GitHub Repository]
  
<span style="color:#AB0000">Elective</span>
+
== Resources for Modules 9 - 12 on Implementing Robot Control with CRAM ==  
 
+
Module 11: [[Zero Prerequisites Demo Tutorial: Simple Fetch and Place]] CRAM demo tutorial, including code to be copied to <code>pick-and-place.lisp</code><BR>
<span style="color:#AB0000">Units: 12 (could also be run as two seven-week independent 6 unit minis, running consecutively)</span>
+
Module 12: [[Lynxmotion AL5D Pick and Place with CRAM]] using the Gazebo Lynxmotion AL5D simulator<BR>
 
+
Legacy version of Module 11: [[Creating a CRAM Package for the Simple Mobile Manipulation Plan]] CRAM intermediate tutorial, including code to be copied to <code>simple-mobile-manipulation-plan.lisp</code>
<span style="color:#AB0000">Lecture/Lab/Rep hours/week: 3 hours lecture/week, 3 hours lab/week</span>
+
 
+
<span style="color:#AB0000">Semester: Spring</span>
+
 
+
<span style="color:#AB0000">Pre-requisites: Programming skills</span>
+
 
+
==<span style="color:#AB0000">Course description:</span> ==
+
Cognitive robotics is an emerging discipline that draws on robotics, artificial intelligence, and cognitive science. It often exploits models based on biological cognition.
+
 
+
There are at least two reasons why having a cognitive ability is useful in robotics:
+
 
+
# It allows the robot to work autonomously in challenging environments, adapting to changes and unforeseen situations, and anticipating outcomes when selecting the actions it will perform.
+
# It facilitates interaction with people. Humans have a strong preference for interaction with other cognitive agents so being able to exhibit a capacity for cognition encourages human robot interaction.  Conversely, a cognitive ability provides the robot with the ability to infer the goals and intentions of the person it is interacting with and thereby allows it to do so in safe and helpful manner. 
+
 
+
Cognitive robots achieve their goals by perceiving their environment, paying attention to the events that matter, planning what to do, anticipating the outcome of their own actions and the actions of other agents (people and other robots), and learning from the resultant interaction. They deal with the inherent uncertainty of natural environments by continually learning, reasoning, and sharing their knowledge.
+
 
+
A key feature of cognitive robotics is its focus on predictive capabilities to augment and compensate for perceptual capacities. Also, by being able to view the world from someone else’s perspective, a cognitive robot can anticipate that person’s intended actions and needs.
+
 
+
In cognitive robotics, the robot body can be more than just an instrument for physical manipulation or locomotion: it can also be a component of the cognitive process. In the particular case of humanoid robotics, the robot’s physical morphology, kinematics, and dynamics, as well as the environment in which it is operating, can help it to achieve its key characteristic of adaptive anticipatory interaction by mirroring the actions of the person it is interacting with.
+
 
+
This course provides introduces the key elements of cognitive robotics, touching on all of these issues.  In doing so, it emphasizes both theory and practice and makes extensive use of physical robots, both mobile robots and manipulator arms, as well as different sensor technologies including RGB-D cameras.
+
 
+
==<span style="color:#AB0000">Learning objectives:</span> ==
+
The primary goal of this course is provide students with an intensive treatment of a cross-section of the key elements of robotics, robot vision, AI, and cognitive science. Students will learn about the fundamentals of 2D and 3D visual sensing, focussing on the some essential techniques for mobile robots and robot arms.  They will then learn about the kinematics and inverse kinematics of mobile robots, addressing locomotion, mapping, and path planning, as well as robot arm kinematics, manipulation, and programming. Based on these foundations, students will progress quickly to cover the topics that gives cognitive robotics its special focus, including reasoning, cognitive architectures, learning and development, memory, attention, prospection by internal simulation, and social interaction.
+
 
+
==<span style="color:#AB0000">Outcomes:</span> ==
+
After completing this course, students should be able to:
+
* Apply their knowledge of machine vision and robot kinematics to create computer programs that control mobile robots and robot arms, enabling the robots to recognize and manipulate objects and navigate their environments. 
+
* Explain how a robot can be designed to exhibit cognitive goal-directed behaviour through the integration of computer models of visual attention, reasoning, learning, prospection, and social interaction.
+
* Create computer programs that realize limited instances of each of these models.
+
 
+
==<span style="color:#AB0000">Content details:</span> ==
+
(For a detailed lecture plan, see [[Cognitive Robotics Lecture Plan]].
+
 
+
The course will cover the following topics:
+
* Cognitive robotics
+
* Robot vision
+
* Mobile robots
+
* Robot arms
+
* Constraint-based reasoning for robotics
+
* Cognitive architectures
+
* Learning and development
+
* Memory and Prospection
+
* Internal simulation 
+
* Visual attention
+
* Social interaction
+
 
+
==<span style="color:#AB0000">Faculty:</span> ==
+
David Vernon
+
 
+
==<span style="color:#AB0000">Delivery:</span> ==
+
Face-to-face
+
 
+
==<span style="color:#AB0000">Recommended reading</span> ==
+
[http://homepages.inf.ed.ac.uk/rbf/BOOKS/VERNON/vernon.htm Vernon 1991] D. Vernon, ''Machine Vision: Automated Visual Inspection and Robot Vision'', Prentice-Hall, 1991.
+

Latest revision as of 06:12, 13 January 2022

The following pages provide support material for the course on Cognitive Robotics.

General Resources

Cognitive Robotics Resources

Software

Software Installation Guide
GitHub Repository

Resources for Modules 9 - 12 on Implementing Robot Control with CRAM

Module 11: Zero Prerequisites Demo Tutorial: Simple Fetch and Place CRAM demo tutorial, including code to be copied to pick-and-place.lisp
Module 12: Lynxmotion AL5D Pick and Place with CRAM using the Gazebo Lynxmotion AL5D simulator
Legacy version of Module 11: Creating a CRAM Package for the Simple Mobile Manipulation Plan CRAM intermediate tutorial, including code to be copied to simple-mobile-manipulation-plan.lisp