SoundSpaces: Audio-Visual Navigation in 3D Environments
By Changan Chen, Unnat Jain, Carl Schissler, Sebastià Vicenc Amengual Garí, Ziad Al-Halah, Vamsi Krishna Ithapu, Philip W. Robinson, Kristen Grauman. 2019
343 citations recorded by the source corpus.
Subfields: Cognitive Neuroscience, Computer Vision and Pattern Recognition, Geology, Multimodal Learning, 3D Vision & Pose, Robotics & Control
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Cognitive Neuroscience
- Daniel L. K. Yamins
- Josh Tenenbaum
- Antonio Torralba
- Chuang Gan
- James J. DiCarlo
- Ali Farhadi
- Cheston Tan
- D. Bull
In Computer Vision and Pattern Recognition
- Kristen Grauman
- Luc Van Gool
- Ali Farhadi
- Jitendra Malik
- Abhinav Kumar Gupta
- Roozbeh Mottaghi
- Trevor Darrell
- Li Fei-Fei
In Geology
- Ali Farhadi
- Antonio Torralba
- D. Bull
- G. Sukhatme
- Nantheera Anantrasirichai
- Josh Tenenbaum
- Jesse Thomason
- Aniruddha Kembhavi
In Multimodal Learning
- Chuang Gan
- Antonio Torralba
- Josh Tenenbaum
- Ali Farhadi
- Josh H. McDermott
- Aniruddha Kembhavi
- D. Gutfreund
- Roozbeh Mottaghi
In 3D Vision & Pose
- Josh Tenenbaum
- D. Bull
- Nantheera Anantrasirichai
- Roozbeh Mottaghi
- Ali Farhadi
- Antonio Torralba
- Jesse Thomason
- Kiana Ehsani
In Robotics & Control
- Roozbeh Mottaghi
- Luca Weihs
- Kiana Ehsani
- Aniruddha Kembhavi
- Ali Farhadi
- Antonio Torralba
- Chuang Gan
- Matt Deitke
Citations in the corpus
- A Survey of Embodied AI: From Simulators to Research Tasks (2021, background): “Embodied AI also enables flexibility and possibly greater performance since various modalities like depth, language [59] and audio [67] can be easily integrated through learning-based approaches.”
- Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion (2021, background): “While mapping environments during inference has shown promise on both VLN (Fang et al., 2019; Chen et al., 2021) and ALFRED (Blukis et al., 2021), we leave the incorporation of mapping to future work.”
- ProcTHOR: Large-Scale Embodied AI Using Procedural Generation (2022, background): “40 [22] Changan Chen, Unnat Jain, Carl Schissler, Sebastia Vicenc Amengual Gari, Ziad Al-Halah, Vamsi Krishna Ithapu, Philip Robinson, and Kristen Grauman.”
- Artificial intelligence in the creative industries: a review (2020, background): “Combining audio and visual sensors can further improve navigation of egocentric observations in complex 3D environments, which can be done through deep reinforcement learning approach (Chen et al. 2020).”
- The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark Towards Physically Realistic Embodied AI (2021, background): “Popular tasks include point-goal navigation [31], audio-visual navigation [16, 9], vision-language navigation [1], and semantic-goal navigation [8].”
- The rise and potential of large language model based agents: a survey (2025, unknown): “Soundspaces [268] proposes the identification of spatial geometric elements guided by reverberant audio input [265].”