TLDR Denny asked how to use embedded, particularly vector, data with OpenAI in a chatbot. Kishore Nallan guided to use search responses in chatbot for summarisation.
Can you elaborate what you mean by "embedded data"? Vector value?
yes, vector value
Yeah, that will be returned as part of search response
but how do i integrate it in a chat bot version?
because right now, if i search “Hi, please show me black TVs”, it will use every word in that sentence to query
You have to get the top few responses and feed that text into the chatbot and ask it to produce an answer from that
using fine tuning?
No need. You are basically asking the LLM to summarise the top results for you. For example for question answering.
Denny
Thu, 21 Sep 2023 05:34:50 UTCIs there a way to some how pull my embedded data and use it with the openai chat completion API?