TLDR Denny asked how to use embedded, particularly vector, data with OpenAI in a chatbot. Kishore Nallan guided to use search responses in chatbot for summarisation.
Is there a way to some how pull my embedded data and use it with the openai chat completion API?
Can you elaborate what you mean by "embedded data"? Vector value?
yes, vector value
Yeah, that will be returned as part of search response
but how do i integrate it in a chat bot version?
because right now, if i search “Hi, please show me black TVs”, it will use every word in that sentence to query
You have to get the top few responses and feed that text into the chatbot and ask it to produce an answer from that
using fine tuning?
No need. You are basically asking the LLM to summarise the top results for you. For example for question answering.
Indexed 3051 threads
Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI