Hello!
I am writing regarding my post on GitHub. Is there any known solution to Auto-embedding generation directly from SageMaker AI Inference Endpoint to TypeSense?
Any help will be highly appreciated.
Thank you in advance.
BR,
Mehti
j
Jason Bosco
12/18/2024, 7:53 PM
Not at the moment. But we do support vLLM, so if they have an adapter for sagemaker then it might work
👍 1
m
Mehti Musaev
12/19/2024, 9:59 PM
@Jason Bosco thanks for your quick response! Is there any documentation/examples of using vLLM for populating embeddings to TypeSense?