Image-Based Recommendations on Styles and Substitutes

By Julian McAuley, Christopher Targett, Javen Qinfeng Shi, Anton van den Hengel. 2015

2,890 citations recorded by the source corpus.

Humans inevitably develop a sense of the relationships between objects, some of which are based on their appearance. Some pairs of objects might be seen as being alternatives to each other (such as two pairs of jeans), while others may be seen as being complementary (such as a pair of jeans and a matching shirt). This information guides many of the choices that people make, from buying clothes to their interactions with each other. We seek here to model this human sense of the relationships between objects based on their appearance. Our approach is not based on fine-grained modeling of user annotations but rather on capturing the largest dataset possible and developing a scalable method for uncovering human notions of the visual relationships within. We cast this as a network inference problem defined on graphs of related images, and provide a large-scale dataset for the training and evaluation of the same. The system we develop is capable of recommending which clothes and accessories will go well together (and which will not), amongst a host of other applications.

Subfields: Computer Vision and Pattern Recognition

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

Citations in the corpus

Pretrained Transformers Improve Out-of-Distribution Robustness (2020, background): “Figure 6 shows the Amazon results for BERT Base, Table 5 shows the MNLI results, and”
Unsupervised Data Augmentation for Consistency Training (2019, methodology): “We conduct experiments on six language datasets including IMDb, Yelp-2, Yelp-5, Amazon-2, Amazon-5 and DBPedia [40, 70], We obtain large datasets of Yelp reviews and Amazon reviews [41] as the unlabeled data for Yelp-2 Yelp-5, Amazon-2 and Amazon-5.”
CTRL: A Conditional Transformer Language Model for Controllable Generation (2019, background): “We train on 140 GB of text drawing from a wide variety of domains: Wikipedia (En, De, Es, Fr), Project Gutenberg 1 , submissions from 45 subreddits, OpenWebText 2 , a large collection of news data (Hermann et al., 2015; Barrault et al., 2019; Sandhaus, 2008; Grusky et al., 2018), Amazon Reviews (McA”
The Effect of Natural Distribution Shift on Question Answering Models (2020, methodology): “We sampled Amazon product reviews belonging to the “Home and Kitchen” category from the dataset released by McAuley et al. (2015).”
WT5?! Training Text-to-Text Models to Explain their Predictions (2020, methodology): “To test this transfer, we used the Amazon Reviews dataset (He & McAuley, 2016; McAuley et al., 2015) which contains reviews for a wide variety of products across diverse categories.”
Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks (2020, neutral): “In RCT, HYPERPARTISAN, AGNEWS, HELPFULNESS, and IMDB, the results even exceed those of DAPT, highlighting the efficacy of this cheaper adaptation technique.”
Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering (2016, methodology): “For example, [26] learns a distance metric to classify whether two given items are compatible or not.”
VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback (2015, methodology): “This embedding is efﬁcient in the sense that all items share the same embedding matrix which signiﬁcantly reduces the number of parameters to learn.”
Learning Visual Clothing Style with Heterogeneous Dyadic Co-Occurrences (2015, methodology): “This work is partly funded by AOL-Program for Connected Experiences and a Google Focused Research award.”
Deep Interest Network for Click-Through Rate Prediction (2017, methodology): “sets and experiment codes are made available1. 6.1 Datasets and Experimental Setup Amazon Dataset2. Amazon Dataset contains product reviews and metadata from Amazon, which is used as benchmark dataset[13, 18, 23]. We conduct experiments on a subset named Electronics, which contains 192,403 users, 63”
Deep Weighted Averaging Classifiers (2018, methodology): “For text we use paragraph-length product reviews (Amazon; 1–5 stars) [32] and movie reviews (IMDB; positive or negative) [31], sentences extracted from movie reviews and labeled in terms of subjectivity [40], and a dataset of Stack Overflow question titles sampled from 20 different categories [61].”
ELLE: Efficient Lifelong Pre-training for Emerging Data (2022, methodology): “…we select a representative task that is relatively stable, i.e., MNLI (Williams et al., 2018), H YPER P ARTISAN (Kiesel et al., 2019), H ELPFULLNESS (McAuley et al., 2015), C HEM P ROT (Kringelum et al., 2016) and ACL-ARC (Jurgens et al., 2018) for WB, N S , R EV , B IO and CS, respectively.”
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5 (2021, methodology): “, 2015), Amazon Review for sentiment analysis (McAuley et al., 2015), DBPedia for Wikipedia article classification into topics (Lehmann et al.”
Pitfalls of Graph Neural Network Evaluation (2018, background): “B Datasets description and statistics Amazon Computers and Amazon Photo are segments of the Amazon co-purchase graph [McAuley et al., 2015], where nodes represent goods, edges indicate that two goods are frequently bought together, node features are bag-of-words encoded product reviews, and class la”
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts (2021, background): “The sentiment training examples for CTRL came from Amazon reviews (McAuley et al., 2015).”
Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks (2019, methodology): “To test the scalability of GCN training algorithms, we constructed a much larger graph with over 2 millions of nodes and 61 million edges based on Amazon co-purchasing networks [11, 12].”
On the Computational Inefficiency of Large Batch Sizes for Stochastic Gradient Descent (2018, background): “Although [24] showed that training on the Amazon Reviews dataset [22] can be done within 4 hours, they tune hyper-parameters heavily.”
Understanding Convolutional Neural Networks for Text Classification (2018, methodology): “b) Elec: electronic product reviews for sentiment classification introduced by Johnson and Zhang (2015), assembled from the Amazon review dataset (McAuley and Leskovec, 2013; McAuley et al., 2015), containing 200k train and 25k test evenly split reviews.”