Image Captioners Are Scalable Vision Learners Too

By Michael Tschannen, Manoj Kumar, Andreas Steiner, Xiaohua Zhai, Neil Houlsby, Lucas Beyer. 2023

Subfields: Computer Vision and Pattern Recognition, Multimodal Learning, Representation & Self-Supervised Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

1. Andriy Mulyar
2. Zach Nussbaum
3. Brandon Duderstadt

In Multimodal Learning

1. Andriy Mulyar
2. Zach Nussbaum
3. Brandon Duderstadt

In Representation & Self-Supervised Learning

1. Andriy Mulyar
2. Zach Nussbaum
3. Brandon Duderstadt

Citations in the corpus

• Nomic Embed Vision: Expanding the Latent Space (2024, background): “Future work can investigate if similar strategies to those shown in Tschannen et al. (2023) can be adapted with a strong general purpose text encoder.”