#community-help

Utilizing CLIP for Custom Embedding on Ecommerce Sites

TLDR Alain sought to understand how to use CLIP for custom embedding in ecommerce, involving both images and product names. Jason advised using both for optimal embedding.

Powered by Struct AI
2
1mo
Solved
Join the chat
Oct 20, 2023 (1 month ago)
Alain
Photo of md5-5e5db1a0aff2d6e6cf93891cc2747355
Alain
01:16 AM
Follow up question on my earlier one https://typesense-community.slack.com/archives/C01P749MET0/p1696928604553359, I’ve got embedding vectors working from CLIP now - when using CLIP to get the custom embedding would I pass the image and text (product name in this case) into CLIP or just the image to get the custom embedding? Unsure if there is a difference from Typesense perspective? Thanks!

(Use case initially will be “similar products” & “you might also like” on ecommerce sites)
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
02:58 PM
would I pass the image and text (product name in this case) into CLIP
You want to do this, since CLIP embeds both the text and image