Bogdan B
11/20/2025, 2:17 PMjs_render=true. The scraper takes about 1h to complete, mainly because of js_render . Are there any tips on how to make this faster? Ideally I would only enable js_render on specific paths but I don't think that's possible right now. Thank you for any suggestions! Should I run two scrapers in parallel with 2 different indexes? I haven't explored this and not sure what limitations I might get especially because I use faceting.Fanis Tharropoulos
11/20/2025, 3:13 PMBogdan B
11/20/2025, 3:35 PMfacet=true in the scraper config and later in the frontend I use algoliaHelper.addFacetRefinement(fieldName, value) . I haven't investigated yet if it is possible to still use faceting this way when data is spread over multiple indexes. But I might be getting ahead of myself, if there is a way to make the scraper run faster without using multiple indexes whilst js_render=true then happy to try something simplerFanis Tharropoulos
11/21/2025, 9:32 AMjs_render should be an option. If you face any issues, feel free to reply on this thread so we can take a look. Ideally, if issues arise, we would advise sending us a DM so we can test the scraper against the website.Bogdan B
11/21/2025, 1:42 PMFanis Tharropoulos
11/24/2025, 8:02 AMjs_render as well, though.Bogdan B
11/24/2025, 10:58 AMjs_render per each start_url that would work great and simplify things quite a bit. Thanks for the help @Fanis TharropoulosFanis Tharropoulos
11/25/2025, 11:13 AMBogdan B
11/25/2025, 11:31 AM