Hi Community. I am new to Typesense and was readi...
# community-help
a
Hi Community. I am new to Typesense and was reading on this. There is an availability of using GPUs which was listed as optional and required installing Nvidia's packages for leveraging. Also, data is kept on disk I read. These are my questions: 1. Currently, typesense only supports Nvidia based GPUs, is there a plan to support other GPUs? 2. Can we connect and Object Storage with Typesense (like minio, S3 bucket, etc.)? Is there a plan to provide this as a feature?
j
We have no plans to support non-nvidia GPUs or object storage.
👍 1
a
Thank You @Jason Bosco for this information
k
@Akshay Jain What do you need the Object Storage for? For the
data_dir
?
a
Yes, I was looking to use object storage as the path for data_dir, I know it will be a tradeoff with the speed though.
k
If you are self-hosting on Kubernetes, I have good news for you. The upcoming version 0.3.6 of the operator https://github.com/akyriako/typesense-operator will support S3-compliant and Parallel File Systems (can support a bandwidth performance up to TB/s and supports millions of IOPS, which makes it ideal for processing high-performance computing workloads) for the storage backend, or any RWX & POSIX-compliant file system of your choice for that matter. The feature is already implemented and now under testing, still not publicly available for preview though. Release date scheduled for 20.01.26
a
Ohh thats a good addition, so using the operator I will be able to configure something like Minio and keep my data there, did I understand you right?
k
MinIO specifically not; because it doesnt have a csi-provisioner to automatically create the volumes via PVCs, but you can use AWS-S3 or any other cloud's S3-compliant backend (if we are talking strictly about object storage solutions). If you are on-prems you can now additionally use NFS storage types (via democratic-csi). We are currently investigating how we can surpass the limitations of MinIO and provision the volume automatically via a PV Claim. On the footnote, after the latest developments with MinIO Community edition I would totally not recommend someone relying on it.
✅ 1
👍 1
j
That's interesting to hear! I'm really curious to hear how an S3 backend exposed via a POSIX-compliant file system layer works out when used with Typesense!
I vaguely remember a few folks trying to do this a while ago with Azure's object storage system, and the translation layer they were using would throw errors, because we rely on the availability of hard links in Typesense, but the translation layer didn't support it...