Computer Vision

September 10, 2021
When a Wayfair customer shops for a product that is just right for her home, color plays a big role. For example, a customer might say, “I am looking for a green chair.” Or she might say, “I am looking for a teal chair.” There may be various versions of these customer color search stories. As data scientists at Wayfair, we want to solve these customer problems by algorithmically extracting the color information from the products and assigning customer-friendly color names.
10 Min Read
July 7, 2021
High-quality lifestyle imagery is core to Wayfair’s ability to merchandise its catalog effectively and help customers shop confidently. Creating lifestyle images through 3D models enables rapid production of product visual merchandising at scale, drives simultaneous reduction in cost and speed to produce imagery, and unlocks new ways (e.g. AR, VR) for customers to engage with products. Early tests show 3D-generated images can provide high quality visual detail of our products and increase conversion rates for flagship brands (main products in Wayfair’s portfolio and to which customers most relate or identify Wayfair). Therefore, producing 3D models quickly and accurately is key to further reducing 3D imagery costs and driving revenue. In this blog, we will introduce how machine learning is utilized to aid 3D modeling at Wayfair.
10 Min Read
September 16, 2019
Stylistic preference is an important factor when a home goods customer is deciding which product to buy, but it is very difficult to identify and define. Although designers have established different style categories, labeling a scene as adhering to a particular style is a highly subjective task. Furthermore, customers often cannot verbalize their style preferences, but can identify their preferences by looking at images. Thus, it is crucial to show products in a room context that are tailored to a customer's taste.
1 Min Read
April 29, 2019
This week in Wayfair Data Science’s explainer series, we’re discussing object pose estimation, an important problem in robotics and augmented reality (AR) applications. In robotics, when given a 3D model of an object a mobile robot must be able to localize it in space in order to manipulate it. This localization process is also central to our AR work at Wayfair. On the Wayfair app, you can explore how our products look in your room using AR. The ability to estimate the pose of the selected item while you are moving your smartphone around your room is essential to providing the best AR experience. In this video, Wayfair data science manager Esra Cansizoglu explains how we solve this problem using perspective-n-point algorithm in a RANSAC framework.
1 Min Read
March 18, 2019
This week in Wayfair Data Science’s explainer series, Senior Machine Learning Engineer Tim Zhang lays out what you need to know about training image synthesis. Training image synthesis is a fairly young project for the Computer Vision team at Wayfair. We have explored a few different use cases that can take advantage of this approach, such as search-with-photo, image-based 3D geometry generation, and camera perspective estimation. Looking forward, we are aiming at faster rendering speed and more intelligent domain randomization.
1 Min Read
May 25, 2018
Wayfair has over nine million unique items in its catalog, and tens of thousands of new ones are added every day. These products come from 8,000 different suppliers who sometimes sell the exact same products -- two completely unrelated suppliers could be buying the exact same area rug from a manufacturer, for example, but giving it slightly different names and even pricing it differently. One of the challenges of maintaining our catalog is therefore the risk of product duplication. At Wayfair, we pride ourselves on giving our customers a great shopping experience, and seeing items that look almost-but-not-quite identical on the site is confusing and might seem unfair, particularly if they have different prices.
4 Min Read
May 18, 2018
Last year, Wayfair launched Visual Search, a new and novel way to find products on our website. Users can now upload photos of furniture they like and find visually similar matches in an instant. If you need a little refresher on this technology, the original blog post can be found here.
4 Min Read
December 1, 2017
Multiple recommendation systems at Wayfair use collaborative filtering based models to understand user behavior and identify like-minded customers. Despite its success, collaborative filtering has a few significant drawbacks, such as the cold start problem and a limited scope of recommendable products. By leveraging image based product embeddings, Wayfair has created a new recommendation algorithm based on product visual similarity.
9 Min Read