Within the last decade, advances in deep learning, coupled with the creation of large, freely available datasets (e.g., ImageNet), have resulted in remarkable progress in the computer vision, NLP, and broader AI communities. This progress has enabled models to begin to obtain superhuman performance on a wide variety of passive tasks. However, this progress has also enabled a paradigm shift that a growing collection of researchers take aim at: the creation of an embodied agent (e.g., a robot) which learns, through interaction and exploration, to creatively solve challenging tasks within its environment.

The goal of this workshop is to bring together researchers from the fields of computer vision, language, graphics, and robotics to share and discuss the current state of intelligent agents that can:

• See: perceive their environment through vision or other senses.
• Talk: hold a natural language dialog grounded in their environment.
• Listen: understand and react to audio input anywhere in a scene.
• Act: navigate and interact with their environment to accomplish goals.
• Reason: consider and plan for the long-term consequences of their actions.

The Embodied AI 2021 workshop will be held virtually in conjunction with CVPR 2021. It will feature a host of invited talks covering a variety of topics in Embodied AI, many exciting challenges, a poster session, and panel discussions.

The Embodied AI 2021 workshop is hosting many exciting challenges covering a wide range of topics such as rearrangement, visual navigation, vision-and-language, and audio-visual navigation. More details regarding data, submission instructions, and timelines can be found on the individual challenge websites.

Challenge winners will be given the opportunity to present a talk at the workshop. Since many challenges can be grouped into similar tasks, we encourage participants to submit models to more than 1 challenge. The table below describes, compares, and links each challenge.

Challenge	Task	Video	Spotlight	Interactive Actions?	Simulation Platform	Scene Dataset	Observations	Stochastic Acuation?	Action Space

AI2-THOR ObjectNav	ObjectNav		1st Place		AI2-THOR	RoboTHOR	RGB-D	✓	Discrete
AI2-THOR Rearrangement	Rearrangement			✓	AI2-THOR	iTHOR	RGB-D, Localization		Discrete
ALFRED	Vision-and-Language Interaction			✓	AI2-THOR	iTHOR	RGB		Discrete
Habitat	ObjectNav		1st Place 2nd Place		Habitat	Matterport3D	RGB-D, Localization		Discrete
Habitat	PointNav v2		1st Place 2nd Place		Habitat	Gibson	Noisy RGB-D	✓	Discrete
iGibson	Interactive Navigation		1st Place 2nd Place 4th Place	✓	iGibson	iGibson	RGB-D	✓	Continuous
iGibson	Social Navigation		1st Place 3rd Place 4th Place 5th Place	✓	iGibson	iGibson	RGB-D	✓	Continuous
MultiON	Multi-Object Navigation		1st Place 2nd Place 3rd Place		Habitat	Matterport3D	RGB-D, Localization		Discrete
Robotic Vision Scene Understanding	Rearrangement (SCD)				Isaac Sim	Active Scene Understanding	RGB-D, Pose Data, Flatscan Laser	✓	Discrete
Robotic Vision Scene Understanding	Semantic SLAM				Isaac Sim	Active Scene Understanding	RGB-D, Pose Data, Flatscan Laser	Partially	Discrete
RxR-Habitat	Vision-and-Language Navigation				Habitat	Matterport3D	RGB-D		Discrete
SoundSpaces	Audio Visual Navigation				Habitat	Matterport3D	RGB-D, Audio Waveform		Discrete
TDW-Transport	Rearrangement			✓	TDW	TDW	RGB-D, Metadata	✓	Discrete

We invite high-quality 2-page extended abstracts in relevant areas, such as:

• Simulation Environments
• Visual Navigation
• Rearrangement
• Embodied Question Answering
• Simulation-to-Real Transfer
• Embodied Vision & Language

The submission deadline is May 14th (Anywhere on Earth). Papers should be no longer than 2 pages (excluding references) and styled in the CVPR format. Paper submissions are now closed.

Note. The order of the papers is randomized each time the page is refreshed.