ICCV 2023: 4th Workshop on Visual Perception for Navigation in Human Environments

The JackRabbot Human Motion Forecasting


Workshop Goals

Welcome to the fourth workshop in the JRDB series! Our workshops are designed to tackle perceptual problems that arise when autonomous robots operate, interact, and navigate in human environments including human detection, tracking, forecasting, and body pose estimation, as well as social grouping and activity recognition.

In this workshop, we are excited to explore the challenging task of human motion forecasting in dynamic and unpredictable environments. We will introduce a new competition that challenges participants to develop models capable of accurately predicting human trajectories using the JRDB dataset. We have also invited speakers from the field of visual perception and prediction to offer valuable insights into understanding human action and behavior.

Call for Papers


We invite researchers to submit their papers addressing topics related to autonomous (robot) navigation in human environments. Relevant topics include, but not limited to:

  • Human trajectory forecasting
  • Human motion prediction and safety
  • Visual scene prediction
  • Human-robot Interaction considering predictions
  • Visual and social navigation in crowded scenes
  • Human motion/body skeleton pose prediction
  • Predictive planning and control
  • 2D or 3D human detection and tracking
  • 2D or 3D skeleton pose estimation and tracking
  • Individual, group and social activity recognition
  • Human walking behaviour analysis
  • 2D and 3D semantic, instance or panoptic segmentation
  • Dataset proposals and bias analysis
  • New metrics and performance measure for different visual perception problems related to autonomous navigation


  • Submission deadline for the full papers:
    July 14 - 23:59 PT
  • Acceptance notification of full papers:
    July 28 - 23:59 PT
  • Camera-ready deadline for the full papers:
    August 4 - 23:59 PT
  • Submission deadline for the extended abstracts and JRDB-Forecast competition deadline:
    September 8 - 23:59 PT
  • Acceptance notification of the extended abstracts and announcement of challenge winners:
    September 22 - 23:59 PT


Full-paper are limited to eight pages, including figures and tables, in the ICCV style. Additional pages containing only cited references are allowed. For more information please refer the guidelines provided by the ICCV here. Accepted papers have the opportunity to be presented as a poster during the workshop. However, only papers in ICCV format will appear in the proceedings. By submitting to this workshop, the authors agree to the review process and understand that we will do our best to match papers to the best possible reviewers. The reviewing process is double-blind. Submission to the challenge is independent of the paper submission, but we encourage the authors to submit to one of the challenges.

Submissions can be made here. If you have any questions about submitting, please contact us here.

Submit to our Workshop

Open Challenge

(More information will be provided later)

We are organizing a new challenge on Human Trajectory Forecasting.

The winners will have the opportunity to present their work as a spotlight (5 minutes) and poster presentation during the workshop. However, there is no prize for the challenge, at least not yet.

Guidelines for participation

Participants must strictly adhere to the submission policy provided on the main JRDB webpage, which can be found here. To differentiate challenge submissions from other regular submissions, each submission name should be followed by an ICCV23 tag, e.g., "submissionname_ICCV23". Submissions without this tag will not be considered for the challenge.

Evaluation & Toolkit

We use the first metric after "name" in all the leaderboards as the main evaluation for ranking the entries. For each benchmark, we have also created toolkits to work with the dataset, perform evaluation, and create submissions. These toolkits are available at here.

The challenge deadline is September 8.


Time Title
08:30 - 08:40 Introduction
08:40 - 09:10 Invited talk
09:10 - 09:30 Dataset and Challenge
09:30 - 10:00 Invited talk
10:00 - 10:30 (Real/Virtual) Coffee break & poster session
10:30 - 11:00 Invited talk
11:00 - 11:30 Invited talk
11:30 - 12:00 Challenge winners presentations
12:00 - 12:30 Invited talk
12:30 - 12:40 Discussion, Closing Remarks and Awards

Invited Speakers

Marco Pavone

Associate Professor at Stanford University, USA

Fatma Güney

Assistant Professor at Koc University in Istanbul, Turkey

Patrick Pérez

Valeo VP of AI and Scientific Director of valeo.ai, France

Angjoo Kanazawa

Assistant Professor at UC Berkeley, USA

Ehsan Adeli

Assistant Professor at Stanford University, USA

Program Committee

Name Organization
Andrey Rudenko Bosch
Boris Ivanovic NVIDIA
Chen Tang UC Berkeley
Edwin Pan Stanford
Haofei Xu University of Tübingen - ETH
Huangying Zhan InnoPeak Technology
Mahsa Ehsanpour niversity of Adelaide
Mohammadhossein Bahari EPFL
Mohsen Fayyaz Microsoft
Nathan Tsoi Yale University
Shyamal Buch Stanford
Sandika Biswas IIT Bombay - Monash University
Taylor Mordan EPFL


Hamid Rezatofighi

Monash University

Alexandre Alahi


Ian Reid

The University of Adelaide

Silvio Savarese

Stanford University

Saeed Saadatnejad*


Simindokht Jahangard

Monash University

Duy Tho Le

Monash University

* Corresponding organizer. For inquiries, please contact.