#community-help

Query about Embedding using Falcon LLM and Typesense Support

TLDR gaurav wants to use Falcon LLM for embedding in their search database and asks if Typesense supports dynamic embedding. Kishore Nallan clarifies that LLMs generate text and can't produce embeddings.

2mo

Join the chat

Jul 11, 2023 (2 months ago)

Photo of md5-c793ac7faa870e19aa043d1f9b35abd1

gaurav

12:47 PM

Hi, i was planning to try Falcon LLM as an embedding for my search based database. I had already used openai LLM which has static embedding. but Openai isnt working for me and i was planning to use Falcon LLM as embedding for my data. Falcon LLM has dynamic embedding, ie. the length of the embedding changes based on input strings.
Any idea if typesense can support dynamic embedding?

Photo of md5-4e872368b2b2668460205b409e95c2ea

Kishore Nallan

01:37 PM

You can't use an LLM for generating embedding. Embedding requires a model which accepts a text and returns a vector. LLMs generate text. Maybe I'm missing something here.

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 2779 threads (79% resolved)

Join Our Community Manage subscription

Similar Threads

Finding Similar Documents Using JSON and Embeddings

Manish wants to find similar JSON documents and asks for advice. Jason suggests using Sentence-BERT with vector query and provides guidance on working with OpenAI embeddings and Typesense. They discuss upcoming Typesense features and alternative models.

5mo

Utilizing Vector Search and Word Embeddings for Comprehensive Search in Typesense

Bill sought clarification on using vector search with multiple word embeddings in Typesense and using them instead of OpenAI's embedding. Kishore Nallan and Jason informed him that their development version 0.25 supports open source embedding models. They also resolved Bill's concerns regarding search performance, language support, and limitations in the search parameters.

225

2mo

Integrating OpenAI Embeddings with DocSearch Scraper

Marcos was looking for how to use OpenAI embeddings with DocSearch. Jason guided with an update to the scraper config, and suggested the GTE built-in model for generic use.