https://typesense.org logo
Join Slack
Powered by
Hi All, can anyone explain while running song repo...
# community-help
v
Hi All, can anyone explain while running song repo. why i have to ingest first and then only i will able to see data.Also it is ingesting only 1k data but we see 30M data how?
k
Can you please elaborate what you mean by "see 30M data" -- where are you seeing this?
v
if we take example of book search engine in that we see 32M data in demo but when we run that repo in local we see we have to add 1k data then only we able to see 32M data. I don't understand how 32M data comes, if we are ingesting only 1k data on locally. let assume that remaining is store in cloud then why we need to ingest again to see the output.
k
Ah I see, the repo does not have all 32M docs, only 1K as sample dataset.
You can download the whole dataset from https://openlibrary.org/
v
i am having difficulty to ingest 50M data directly to typsense.
k
What trouble are you facing?
v
i have 50M data json but i have split it into 5 parts and i am ingesting one by one .but it is giving error on second.Will i able to ingest on same collection.
k
Again, can you please me more specific, as to what "error". In general, giving as much as information as you can will allow us to quickly get a sense of what's happening and help out.
v
i have two json which contain 1lakh data each.when i ingest second i have to delete the first collection then only second get ingested
Below is error :-
(node:6650) UnhandledPromiseRejectionWarning: ObjectAlreadyExists: Request failed with HTTP code 409 | Server said: A collection with name 
artist
already exists. at ObjectAlreadyExists.TypesenseError [as constructor] (/media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/Errors/TypesenseError.js2328) at new ObjectAlreadyExists (/media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/Errors/ObjectAlreadyExists.js2542) at ApiCall.customErrorForResponse (/media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/ApiCall.js33721) at /media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/ApiCall.js19598 at step (/media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/ApiCall.js3323) at Object.next (/media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/ApiCall.js1453) at step (/media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/ApiCall.js18139) at Object.next (/media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/ApiCall.js1453) at fulfilled (/media/sf_Backup/vikram/typesense-instantsearch-demo/node_modules/typesense/lib/Typesense/ApiCall.js558) at processTicksAndRejections (internal/process/task_queues.js975)
j
It looks like the script you’re using to ingest is trying to create the collection even it already exists. You want to update it to only create the collection if it doesn’t already exist
v
Thanks. working now
Open in Slack
PreviousNext
Powered by