also I wonder about a rough average of a common documentation website scrap's time (I know there can be 1 page to 1000 🙂 but tryin' to get a really vague idea)

For scraping the Typesense docs site, it takes roughly 15 minutes IIRC, and generates ~10K search records

Thank you 😊