Hi all, hope you are all having a great day. We ...
# community-help
d
Hi all, hope you are all having a great day. We have a challenge in that the docker container version of Typesense cannot download the LLM's as the cert has expired and linux blocks non-secure downloads. We can get it directly from https://huggingface.co/sentence-transformers/all-MiniLM-L12-v2/model.onnx, but have no idea where to tell Typesense where to change the location. Anyone know?
j
Those models.typesense.org links work fine for me. Do you have a proxy somewhere that might be interrupting the SSL connection?
d
@Jason Bosco yup .. it's probably the VPN disallowing downloads from non-secure endpoints.
If we can't get around that, do you know if there is a way to just copy the files to the /models folder and have TS not try to download them?
j
<http://models.typesense.org|models.typesense.org>
does have a valid SSL certificate btw:
Copy code
echo | openssl s_client -servername <http://models.typesense.org|models.typesense.org> -connect <http://models.typesense.org:443|models.typesense.org:443> 2>/dev/null | openssl x509 -noout -dates
notBefore=May 19 00:00:00 2024 GMT
notAfter=Jun 16 23:59:59 2025 GMT
1
If we can't get around that, do you know if there is a way to just copy the files to the /models folder and have TS not try to download them?
You can download the directory from hugging face and place them in the
models
directory inside the data dir and Typesense will pick it up from there