Tim Barfoot

Professor
BASc (Eng Sci Aero, Toronto), PhD (Toronto), PEng (Ontario), IEEE Fellow

Institute for Aerospace Studies
University of Toronto
4925 Dufferin Street, Room 189
Toronto, ON M3H 5T6 Canada
tim.barfoot [at] utoronto.ca
+1 416-667-7719 (office)
+1 416-667-7799 (fax)
linkedin
wikipedia
google scholar citations
arXiv
calendar

TDB

Jobs

Potential students, please refer to the main UTIAS site for the application procedure; the normal cycle is to submit your application in January to start in September of the same year. Please also note that despite the name of my lab, my interests in robotics have broadened from "space" applications to any situation involving navigation of mobile robots (see detailed research statement below). Potential postdocs, email me directly if you have a strong track record in the robotics community.


Research





The purpose of our lab's research program is to advance visual navigation of mobile robots. Our work finds application in transportation, planetary exploration, mining, warehouses, offices, and military scenarios.

Over the last 20 years, our lab has spent a lot of time building and testing different navigation approaches in the field. Much of our work is focused on a navigation stack we pioneered called teach and repeat (T&R). T&R has been particularly interesting in that it allows a robot to repeat a long (several kilometre) route that was taught manually, using only a single core sensor (stereo camera, lidar, radar) for feedback (no GPS needed). T&R has been successful because it avoids the need to construct a map of the world in a single privileged coordinate frame and instead utilizes a topometric map. We also spent a lot of time improving the robustness of visual localization in the presence of lighting and seasonal change.

Today we are continuing to expand the possibilities for T&R-style navigation as well as the underlying state estimation tools upon which it relies. We are looking at the idea of cross-modal teach and repeat where one type of vehicle or agent teaches a route for another; for example we might fly a drone over an environment then expect a ground vehicle to execute the route. We are also looking at multi-robot teach and repeat where several vehicles cooperatively teach and then repeat routes in a coordinated fashion; this has applications in both space exploration (coordinated cargo transport) and defence. We are exploring how machine learning and foundation models can be used to improve our perception, primarily with an eye towards improving assessment of driveable surfaces around a robot. We continue to investigate the benefits of different sensing modalities including Doppler sensors such as FMCW radar but also FMCW lidar, both of which can natively produce velocity measurements. On the state estimation front, we are always interested in fun new mathematical ideas that advance our core localization and mapping tools; some current topics include certifiably optimal estimation, data-driven Koopman estimation, and advanced Lie groups. This blurb is inevitably already out of date so please refer to the papers below for the latest!


Book on State Estimation

For several years I've been teaching a graduate course on state estimation for robotics and expanded my notes into a book that was originally published in 2017 and a second edition was published in 2024:

State Estimation for Robotics -- Second Edition (585 pages)

If you find any typos/errors, please email me as I will continue to keep an up-to-date unofficial copy here as well as a list of errata for the published version (see the preamble at the above link). Please make sure you have the latest version before filing a bug report.

The official first edition can be found on the Cambridge University Press page here; the second edition is here; you might even be able to download the published version if your institution subscribes to Cambridge. A Chinese version of the first edition is available through the Xi'an Jiao Tong University Press here or as a pdf.

     

Some additional resources:

State Estimation Short Course Based on 2nd Edition (4 Lectures)
State Estimation for Robotics -- First Edition (399 pages; no longer being updated)
Review by Luca Carlone (MIT)
SO(3) and SE(3) Identities and Approximations (2 pages)
Lie Group Summary Sheet by Johann Laconte

Teaching

TDB

Multimedia

TDB

Community Service

Editor in Chief for IEEE Transactions on Field Robotics (TFR) 2025-present
Associate Editor for IEEE Transactions on Field Robotics (TFR) 2024-2025
Associate Editor for Field Robotics (FR) 2020-2024
Associate Editor for the Journal of Field Robotics (JFR) 2012-2020
Advisory Board Member for the International Journal of Robotics Research (IJRR) 2024-present
Senior Editor for the International Journal of Robotics Research (IJRR) 2011-2024
Foundation Board Member for Robotics: Science and Systems (RSS) 2019-2025
Area Chair for Robotics: Science and Systems (RSS) 2012-13
General Chair for Field and Service Robotics (FSR) 2015
Program Co-Chair of Computer and Robot Vision (CRV) 2012-13
Associate Editor for the IEEE International Conference on Robotics and Automation (ICRA) 2012, 2017, 2019