#community-help

Python Code Snippet for JSONL Conversion and Bulk Write

TLDR Vishal inquires about a Python code snippet to convert dataframe rows to JSONL and bulk write to a collection. Jason shares a potential solution, and they discuss their process with ChatGPT.

Powered by Struct AI
13
3mo
Solved
Join the chat
Jun 09, 2023 (3 months ago)
Vishal
Photo of md5-178450ab9171fe1c7eba3a5eb7e1a312
Vishal
05:16 PM
is there a python code snippet that loops goes through each row in a dataframe, converts each row to jsonl and bulk writes to a collection? (the documentation mentioned something about the library converting to jsonl)
Vishal
Photo of md5-178450ab9171fe1c7eba3a5eb7e1a312
Vishal
05:17 PM
haha
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
05:18 PM
(Accuracy not guaranteed 😅 )
Vishal
Photo of md5-178450ab9171fe1c7eba3a5eb7e1a312
Vishal
05:18 PM
yeah I use chatgpt all the time to navigate through your documentation and create snippets
05:18
Vishal
05:18 PM
its not quite there yet
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
05:18 PM
Yeah, I’ve started using it to generate the first draft of quick snippets like this and then edit it to get it work.
05:18
Jason
05:18 PM
And then give it any errors I see, and ask it to fix those
Vishal
Photo of md5-178450ab9171fe1c7eba3a5eb7e1a312
Vishal
05:19 PM
thats my process as well!
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
05:19 PM
I’ve been able to get to say 90% and then I have to tweak the remaining
Vishal
Photo of md5-178450ab9171fe1c7eba3a5eb7e1a312
Vishal
05:20 PM
any idea if you are going to release the management gui in the open source version so we can see cluster status, get a list of collections, etc?
Jason
Photo of md5-8813087cccc512313602b6d9f9ece19f
Jason
05:21 PM
We don’t have plans to do that at the moment, but if you search the GitHub repo, there’s an open source dashboard someone from the community built
Vishal
Photo of md5-178450ab9171fe1c7eba3a5eb7e1a312
Vishal
05:21 PM
yeah saw that, was a bit hesitant on using it