#community-help

Data Propagation Time from Firestore to Typespace

TLDR Bryan questioned about data propagation time from Firestore to Typespace. Jason clarified that it typically takes less than 10 seconds, and indexing takes less than a second.

26mo

Join the chat

Nov 17, 2021 (26 months ago)

Photo of md5-80f38442a17b678831f4735a7f38a93a

Bryan

04:16 PM

Hi everyone. How long will propogation take from firestore to typespace using the extension? If I add a document in firestore, how long until a typespace search will return that document? (assuming using typespace cloud in the same region)

Photo of md5-8813087cccc512313602b6d9f9ece19f

Jason

05:06 PM

There’s an element of latency involved in how quickly Firestore triggers change notifications… I’m mot sure how variable this is. But typically the overall latency should be less than say 10s for data to show up in Typesense.

From Typesesne’s perspective, as soon as data is indexed and the API call returns, it should available to search.

Bryan

07:07 PM

how long for indexing to complete usually?

Jason

07:08 PM

A single record will complete in less than a second.

For batches of records, it completely depends on the size of your dataset. For eg: I've indexed 2.2M records (recipes demo you see on the home page) in about 3-4 minutes by importing all records in a single batch import API call

Bryan

08:06 PM

thx!

Typesense

Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI

Indexed 3005 threads (79% resolved)

Join Our Community

Similar Threads

Transforming Firebase Collection Data before Indexing to Typesense

David wants to transform data before indexing to Typesense. Jason suggests forking the extension and using a Google Cloud function. David successfully implements the solution.

6mo

High Cost Concerns with firestore-typesense-search Extension

Minyong is confused by the high costs of using the firestore-typesense-search extension and asks for ways to reduce them. Jason confirms that the extension does not batch requests and advises Minyong to consult Firebase support.

15mo

Typesense Firestore Real-Time Update Query

DomijKu required help with real-time updates on frontend when backends changes occur. Jason, CaptainCodeman and Loic explained triggering updates via direct subscription to Firestore, cloud function triggers, and stream subscriptions. Loic recommended switching to Typesense for searches beyond 20 documents.

19mo