Shopee Price Match Guarantee Algorithm based on multimodal learning

Yaxuan Fang, Junhan Wang, Lei Jia*, Fung Wai Kin

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

Abstract

Shopee has been a popular online shopping website in the Southeast Asia. Customers appreciate its easy, secure, and fast online shopping experience tailored to their region. At the same time, it allows customers to choose the one with the lower price of the same product. It relies on the product matching, that is the same product with the same description image must be removed. The base technology to achieve this function is multimodal learning, in which we focus on the images and text. In our article, we proposed a new multimodal learning model mainly based on transformer and BERT. For image matching, we use NFNet, Swin-Transformer and Efficientnet to get image embeddings. For text matching, we use Distil-Bert, Albert, Multilingual Bert and TF-IDF to get text embeddings. After we get the embedding vector, we choose KNN to classify. We use cosine and distance to measure the similarity of the different models. It is worth mentioning that the loss function is Arcface, not the traditional Softmax, which improve the difficulty of training to ensure the final performance in the test periods. In addition, 7 models vote for the final results ensuring the effect of prediction. To avoid the bad matching result, we add some postprocessing process.

Original languageEnglish
Title of host publication2021 IEEE International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology, CEI 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages59-62
Number of pages4
ISBN (Electronic)9780738146492
DOIs
Publication statusPublished - 24 Sept 2021
Externally publishedYes
Event2021 IEEE International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology, CEI 2021 - Fuzhou, China
Duration: 24 Sept 202126 Sept 2021

Publication series

Name2021 IEEE International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology, CEI 2021

Conference

Conference2021 IEEE International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology, CEI 2021
Country/TerritoryChina
CityFuzhou
Period24/09/2126/09/21

Keywords

  • Arcface
  • multimodal learning
  • post-processing
  • Shopee
  • voting

Fingerprint

Dive into the research topics of 'Shopee Price Match Guarantee Algorithm based on multimodal learning'. Together they form a unique fingerprint.

Cite this