About | News | Team | Publications | Activity | Scholar

Eshed Ohn-Bar
Assistant Professor
Boston University
Email: eohnbar [at] gmail [dot] com


About

At Boston University, I'm heading the Human-to-Everything (H2X) Lab. Our overarching goal is to develop intelligent technologies with robust autonomy and real-time assistance capabilities. Our research spans machine intelligence, computer vision, and systems for human-machine interaction (particularly for accessibility).

If you are interested in joining the lab to research machine learning and perception for intelligent systems, please email me your CV.

News

Team


Past Members

For code and project pages, please see our GitHub repo.

Publications 2024 | 2023 | 2022 | 2021 | 2020 | 2019 | 2018 | 2017 | 2016 | 2015 | 2014 | 2013

2024

Text to Blind Motion
H. Kim, K. Sengupta, M. Kuribayashi, H. Kacorri, E. Ohn-Bar
Neural Information Processing Systems (NeurIPS), 2024

Scalable Early Childhood Reading Performance Prediction
Z. Shangguan, Z. Huang, E. Ohn-Bar, O. Ozernov-Palchik, D. Kosty, M. Stoolmiller, H. Fien
Neural Information Processing Systems (NeurIPS), 2024

Unified Local-Cloud Decision-Making via Reinforcement Learning
K. Sengupta, Z. Shangguan, S. Bharadwaj, S. Arora, E. Ohn-Bar, and R. Mancuso
European Conference on Computer Vision (ECCV), 2024
[project page]

Neural Volumetric World Models for Autonomous Driving
Z. Huang, J. Zhang, and E. Ohn-Bar
European Conference on Computer Vision (ECCV), 2024
[project page]

Motion Diversification Networks
H. Kim and E. Ohn-Bar
Conference on Computer Vision and Pattern Recognition (CVPR), 2024
[project page]

Feedback-Guided Autonomous Driving (highlight, top 2.8% of submissions)
J. Zhang, Z. Huang, A. Ray, and E. Ohn-Bar
Conference on Computer Vision and Pattern Recognition (CVPR), 2024
[project page]

Uncertainty-Guided Never-Ending Learning to Drive
L. Lai, E. Ohn-Bar, S. Arora, and J. Yi
Conference on Computer Vision and Pattern Recognition (CVPR), 2024
[project page]

2023

Learning to Drive Anywhere
R. Zhu, P. Huang, E. Ohn-Bar, and V. Saligrama
Conference on Robot Learning (CoRL), 2023
[project page]

XVO: Generalized Visual Odometry via Cross-Modal Self-Training
L. Lai, Z. Shangguan, J. Zhang, and E. Ohn-Bar
International Conference on Computer Vision (ICCV), 2023
[project page]

Coaching a Teachable Student (highlight, top 2.6% of submissions)
J. Zhang, Z. Huang, and E. Ohn-Bar
Computer Vision and Pattern Recognition (CVPR), 2023
[project page]

2022

ASSISTER: Assistive Navigation via Conditional Instruction Generation
Z. Huang*, Z. Shangguan*, J. Zhang, G. Bar, M. Boyd, and E. Ohn-Bar
European Conference on Computer Vision (ECCV), 2022
[code]

SelfD: Self-Learning Large-Scale Driving Policies From the Web
J. Zhang, R. Zhu, and E. Ohn-Bar
Computer Vision and Pattern Recognition (CVPR), 2022
[data]

2021

X-World: Accessibility, Vision, and Autonomy Meet
J. Zhang*, M. Zheng*, M. Boyd, and E. Ohn-Bar
International Conference on Computer Vision (ICCV), 2021
[evaluation server and data]

Learning by Watching
J. Zhang and E. Ohn-Bar
Computer Vision and Pattern Recognition (CVPR), 2021

2020

Learning Situational Driving
E. Ohn-Bar, A. Prakash, A. Behl, K. Chitta, and A. Geiger
Computer Vision and Pattern Recognition (CVPR), 2020

Exploring Data Aggregation in Policy Learning for Vision-based Urban Autonomous Driving
A. Prakash, A. Behl, E. Ohn-Bar, K. Chitta, and A. Geiger
Computer Vision and Pattern Recognition (CVPR), 2020

Label Efficient Visual Abstractions for Autonomous Driving
A. Behl, K. Chitta, A. Prakash, E. Ohn-Bar, and A. Geiger
International Conference on Intelligent Robots and Systems (IROS), 2020

Virtual Navigation for Blind People: Transferring Route Knowledge to the Real-World
J. Guerreiro, D. Sato, D. Ahmetovic, E. Ohn-Bar, K. Kitani, and C. Asakawa
International Journal of Human-Computer Studies (IJHCS), 2020

Learning Context-Dependent Personal Preferences for Adaptive Recommendation
K. Higuchi, H. Tsuchida, E. Ohn-Bar, Y. Sato, and K. Kitani
ACM Transaction on Interactive Intelligent Systems (T-IIS), 2020

2019

A-EXP4: Online Social Policy Learning for Adaptive Robot-Pedestrian Interaction
P. Jin, E. Ohn-Bar, K. Kitani, and C. Asakawa
International Conference on Intelligent Robots and Systems (IROS), 2019
[pdf | bibtex]


Forecasting Time-To-Collision from Monocular Video: Feasibility, Dataset, and Challenges
A. Manglik, X. Weng, E. Ohn-Bar, and K. Kitani
International Conference on Intelligent Robots and Systems (IROS), 2019
[pdf | demo | code | project | bibtex]


Towards Understanding Interaction of Visually Impaired Navigators with Surrounding Pedestrians
E. Ohn-Bar, J. Guerreiro, D. Ahmetovic, K. Kitani, and C. Asakawa
H-Augmented Workshop, Robotics: Science and Systems (RSS), 2019
[pdf | bibtex]



Impact of Expertise on Interaction Preferences for Navigation Assistance of Visually Impaired Individuals
D. Ahmetovic, J. Guerreiro, E. Ohn-Bar, K. Kitani, and C. Asakawa
Web for All Conference (W4A), 2019
Best Paper Award
[pdf | bibtex]

2018

Personalized Dynamics Models for Adaptive Assistive Navigation Systems (oral presentation)
E. Ohn-Bar, K. Kitani, and C. Asakawa
2nd Conference on Robot Learning (CoRL), Proceedings of Machine Learning Research, 2018 Acceptance rate: ~7%
[pdf | data | bibtex]

Variability in Reactions to Instructional Guidance during Smartphone-Based Assisted Navigation of Blind Users
E. Ohn-Bar, J. Guerreiro, K. Kitani, and C. Asakawa
International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp / IMWUT), 2018 Acceptance rate: ~20%
[pdf | bibtex]

Human-Interactive Subgoal Supervision for Efficient Inverse Reinforcement Learning
X. Pan, E. Ohn-Bar, N. Rhinehart, Y. Xu, Y. Shen, and K. M. Kitani
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2018 Acceptance rate: 25%
[pdf | bibtex]

How Context and User Behavior Affect Indoor Navigation Assistance for Blind People
J. Guerreiro, E. Ohn-Bar, D. Ahmetovic, K. Kitani, and C. Asakawa
Web for All Conference (W4A), 2018
[pdf | bibtex]

Modeling Expertise in Assistive Navigation Interfaces for Blind People
E. Ohn-Bar, J. Guerreiro, D. Ahmetovic, K. Kitani, and C. Asakawa
International Conference on Intelligent User Interfaces (IUI), 2018 Acceptance rate: 23%
[pdf | bibtex]

Environmental Factors in Indoor Navigation Based on Real-World Trajectories of Blind Users
H. Kacorri, E. Ohn-Bar, K. Kitani, and C. Asakawa
Conference on Human Factors in Computing Systems (CHI), 2018 Acceptance rate: 26%
[pdf | bibtex]

SmartPartNet: Part-Informed Person Detection for Body-Worn Smartphones
H. Yu, E. Ohn-Bar, D. Yoo, and K. Kitani
Winter Conf. on Applications of Computer Vision (WACV), 2018 Acceptance rate: 37%
[pdf | bibtex]


2017

Are All Objects Equal? Deep Spatio-Temporal Importance Prediction in Driving Videos
E. Ohn-Bar and M. Trivedi
Pattern Recognition (PR), 2017 Impact factor: 5.898
[pdf | data and code | project | bibtex]

RefineNet: Refining Object Detectors for Autonomous Driving
R. N. Rajaram, E. Ohn-Bar, and M. Trivedi
IEEE Transactions on Intelligent Vehicles (T-IV), 2017
[pdf | bibtex]

Contextual Visual Object Recognition and Behavior Modeling for Human-Robot Interactivity
E. Ohn-Bar
PhD Thesis, 2017
[pdf]

Multi-scale Volumes for Deep Object Detection and Localization
E. Ohn-Bar and M. Trivedi
Pattern Recognition (PR), 2017 Impact factor: 5.898
[pdf | data | bibtex]

2016

Looking at Humans in the Age of Self-Driving and Highly Automated Vehicles
E. Ohn-Bar and M. Trivedi
IEEE Transactions on Intelligent Vehicles (T-IV), 2016
[pdf | bibtex]

Long-term, Multi-Cue Tracking of Hands in Vehicles
A. Rangesh, E. Ohn-Bar, and M. Trivedi
IEEE Transactions on Intelligent Transportation Systems (T-ITS), 2016 Impact factor: 5.74
[pdf | data | bibtex]

Looking at Pedestrians at Different Scales: A Multiresolution Approach and Evaluations
R. N. Rajaram, E. Ohn-Bar, and M. Trivedi
IEEE Transactions on Intelligent Transportation Systems (T-ITS), 2016 Impact factor: 5.74
[pdf | bibtex]

What Makes an On-road Object Important? (oral presentation)
E. Ohn-Bar and M. Trivedi
IEEE International Conference on Pattern Recognition (ICPR), 2016 Acceptance rate: 14%
Best student paper award finalist
[pdf | data and code | project | bibtex]


To Boost or Not to Boost? On the Limits of Boosted Trees for Object Detection (oral presentation)
E. Ohn-Bar and M. Trivedi
IEEE International Conference on Pattern Recognition (ICPR), 2016 Acceptance rate: 14%
Best student paper award finalist
[pdf | Models, Results on Caltech/FDDB/WIDER and training code | bibtex]


RefineNet: Iterative Refinement for Accurate Object Localization
R. N. Rajaram, E. Ohn-Bar, and M. Trivedi
IEEE Intelligent Transportation Systems Conference (ITSC), 2016
[pdf | bibtex]

Surround Vehicles Trajectory Analysis with Recurrent Neural Networks
A. Khosroshahi, E. Ohn-Bar, and M. Trivedi
IEEE Intelligent Transportation Systems Conference (ITSC), 2016
[pdf | bibtex]


Pedestrians and their Phones - Detecting Phone-based Activities of Pedestrians for Autonomous Vehicles
A. Rangesh, E. Ohn-Bar, K. Yuen, and M. Trivedi
IEEE Intelligent Transportation Systems Conference (ITSC), 2016
[pdf | bibtex]

Multi-Perspective Vehicle Detection and Tracking: Challenges, Dataset, and Metrics
J. V. Dueholm, M. S. Kristoffersen, R. Satzoda, E. Ohn-Bar, T. B. Moeslund, and M. Trivedi
IEEE Intelligent Transportation Systems Conference (ITSC), 2016
[pdf | bibtex]

Detection and Localization with Multi-scale Models (oral presentation)
E. Ohn-Bar and M. Trivedi
IEEE International Conference on Pattern Recognition (ICPR), 2016 Acceptance rate: 14%
[pdf | bibtex]

2015

On Surveillance for Safety Critical Events: In-Vehicle Video Networks for Predictive Driver Assistance Systems
E. Ohn-Bar, A. Tawari, S. Martin, and M. Trivedi
Computer Vision and Image Understanding (CVIU), 2015 Impact factor: 2.77
[pdf | bibtex]

Learning to Detect Vehicles by Clustering Appearance Patterns
E. Ohn-Bar and M. Trivedi
IEEE Transactions on Intelligent Transportation Systems (T-ITS), 2015 Impact factor: 5.74
[pdf (with supplementary) | code | bibtex]

On Performance Evaluation of Driver Hand Detection Algorithms: Challenges, Dataset, and Metrics
N. Das, E. Ohn-Bar, and M. Trivedi
IEEE Conference on Intelligent Transportation Systems (ITSC), 2015
[pdf | data | bibtex]

An Exploration of Why and When Pedestrian Detection Fails
R. N. Rajaram, E. Ohn-Bar, and M. Trivedi
IEEE Conference on Intelligent Transportation Systems (ITSC), 2015
[pdf | bibtex]


A Comparative Study of Color and Depth Features for Hand Gesture Recognition in Naturalistic Driving Settings
E. Ohn-Bar and M. Trivedi
IEEE Intelligent Vehicles Symposium (IV), 2015
[pdf | bibtex]


Can Appearance Patterns Improve Pedestrian Detection?
E. Ohn-Bar and M. Trivedi
IEEE Intelligent Vehicles Symposium (IV), 2015
[pdf | bibtex]

2014

Hand Gesture Recognition in Real-Time for Automotive Interfaces: A Multimodal Vision-based Approach and Evaluations
E. Ohn-Bar and M. Trivedi
IEEE Transactions on Intelligent Transportation Systems (T-ITS), 2014 Impact factor: 5.74
[pdf | bibtex]


Beyond Just Keeping Hands on the Wheel: Towards Visual Interpretation of Driver Hand Motion Patterns
E. Ohn-Bar and M. Trivedi
IEEE Conference on Intelligent Transportation Systems (ITSC), 2014
[pdf | bibtex]


Vision on Wheels: Looking at Driver, Vehicle, and Surround for On-Road Maneuver Analysis (oral presentation)
E. Ohn-Bar, A. Tawari, S. Martin, and M. Trivedi
Mobile Vision Workshop, IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2014
[pdf | bibtex]

Head, Eye, and Hand Patterns for Driver Activity Recognition (oral presentation)
E. Ohn-Bar, S. Martin, A. Tawari, and M. Trivedi
IEEE International Conference on Pattern Recognition (ICPR), 2014 Acceptance rate: 14%
Best Industry Related Paper Award Runner Up
[pdf | bibtex]


Fast and Robust Object Detection Using Visual Subcategories (oral presentation)
E. Ohn-Bar and M. Trivedi
Mobile Vision Workshop, IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2014
[pdf | code | bibtex]

Predicting Driver Maneuvers by Learning Holistic Features
E. Ohn-Bar, A. Tawari, S. Martin, and M. Trivedi
IEEE Intelligent Vehicles Symposium (IV), 2014
[pdf | bibtex]

Go with the Flow: Improving Multi-View Vehicle Detection with Motion Cues
A. Ramirez, E. Ohn-Bar, and M. Trivedi
IEEE International Conference on Pattern Recognition (ICPR), 2014
[pdf | bibtex]

2013

Driver Hand Activity Analysis in Naturalistic Driving Studies: Issues, Algorithms and Experimental Studies
E. Ohn-Bar, S. Martin, and M. Trivedi
Journal of Electronic Imaging: Special Section on Video Surveillance and Transportation Imaging Applications (JEI), 2013
[pdf | bibtex]

Joint Angles Similarities and HOG2 for Action Recognition (oral presentation)
E. Ohn-Bar and M. Trivedi
Human Activity Understanding from 3D Data Workshop, IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2013
[pdf | code | slides | bibtex]

The Power is in Your Hands: 3D Analysis of Hand Gestures in Naturalistic Video (oral presentation, Best Paper Award)
E. Ohn-Bar and M. Trivedi
Analysis and Modeling of Faces and Gestures Workshop, IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2013 Acceptance rate: 30%
[pdf | dataset | slides | bibtex]


Partially Occluded Vehicle Recognition and Tracking in 3D
E. Ohn-Bar, S. Sivaraman, and M. Trivedi
IEEE Intelligent Vehicles Symposium (IV), 2013
[pdf | poster | bibtex]

  • In-Vehicle Hand Activity Recognition Using Integration of Regions (oral presentation)
    E. Ohn-Bar and M. Trivedi, IEEE Intelligent Vehicles Symposium (IV), 2013. [pdf | bibtex]

  • Hand Gesture-based Visual User Interface for Infotainment (oral presentation)
    E. Ohn-Bar, C. Tran, M. Trivedi, Automotive User Interfaces and Interactive Vehicular Applications (AUTO-UI), 2012. [pdf | bibtex]

  • Professional Activity

    Area Chair
  • CVPR 2024, 2025
  • CHI 2025
  • ICRA 2017, 2025
  • IEEE Intelligent Vehicles Symposium (2017-2024)

    Program Committee/Workshop Organization
  • Workshop on Accessibility, Vision, and Autonomy at CVPR 2022, 2023, 2024
  • Workshop on Human Behavior Understanding at ICCV 2019, FG 2018
  • Workshop on Observing and Understanding Hands at CVPR, ICCV, ECCV (2015-2019)
  • Workshop on Automatic Traffic Surveillance at CVPR

    Reviewer
  • Computer Vision: CVPR, SIGGRAPH, PAMI, CVIU, CVPRW-ATS, CVPRW-HANDS, IMAVIS, T-SMC, T-CSVT, JEI
  • Accessibility: CHI, ASSETS, T-ACCESS
  • Intelligent Vehicles: IV, ITSC, T-ITS, T-VT
  • Robotics and Systems: HRI, IROS, T-HMS, T-IE, T-II