Aleksei Bochkov
10/03/2024, 6:56 PMsearch_parameters = {
"q": query,
"query_by": "*",
"per_page": 250,
"page": 1,
}
first_search_results = client.collections[
settings.TYPESENSE_SCHEMA_NAME
].documents.search(search_parameters)
And also get a total number of results
total_results = first_search_results["found"]
I then calculate total number of pages
total_pages = (total_results // per_page) + (
1 if total_results % per_page > 0 else 0
)
And then I do requests for each page
for page in range(2, total_pages + 1):
search_parameters["page"] = page
page_search_results = client.collections[
settings.TYPESENSE_SCHEMA_NAME
].documents.search(search_parameters)
This is taking a lot of time if I have 200+ pages. Is there more efficient way to grab all the results? Thanks