Docsearch Custom Settings in Typesense Scraper
TLDR Marcos wants to specify
symbols_to_index without forking the docsearch scraper. Jason suggests opening a GitHub issue to add support for custom settings in the scraper.
Mar 29, 2023 (6 months ago)
symbols_to_indexusing the docsearch scrapper?
I can't just update the schema since it'll be overridden next update.
custom_settingslike the Algolia's?
custom_settingsoptions in the docsearch.config.json:
custom_settingsare Algolia's specific collection settings
Indexed 2764 threads (79% resolved)
Solving Typesense Docsearch Scraper Issues
Sandeep was having issues with Typesense's docsearch scraper and getting fewer results than with Algolia's scraper. Jason helped by sharing the query they use and advised checking the running version of the scraper. The issue was resolved when Sandeep ran the non-base regular docker image.
Docsearch Scrapper Metadata Configuration and Filter Problem
Marcos faced issues with Docsearch scrapper not adding metadata attributes and filtering out documents without content. Jason helped fix the issue by updating the scraper and providing filtering instructions.
Trouble with DocSearch Scraper and Pipenv Across Multiple OSs
James ran into errors when trying to build Typesense DocSearch Scraper from scratch, and believes it’s because of a bad Pipfile.lock. Jason attempted to replicate the error, and spent hours trying to isolate the issue but ultimately fixed the problem and copied his bash history for future reference. The conversation touches briefly on the subject of using a virtual machine for testing.
Crawler Deleting Old Collection and Creating New Name
James faced issues with Typesense as the crawler changed collection names, breaking their production website. Jason suggested changing "index_name" in their config file to their desired name and explained the reason behind the name combination differences.
Issues with migrating search from Algolia to Typesense
Nacho encountered issues with migrating search from Algolia to Typesense, including a custom component that interfered with the search and an incorrect element being used as the title. Jason provided guidance on removing the component and adjusting search configuration.