Hello mates, thank you for typesense!! :) We're go...
# community-help
j
Hello mates, thank you for typesense!! :) We're going to implement typesense for some docusaurus powered website, deployed on some k8s cluster. Do you know if there is a way to scrape the site intra-cluster and get the search results using the public (ingress) URLs (scrap http://someservice.namespace.svc.cluster but then have https://docs.example.com used in search results) ?
j
Hmm I’m not sure if that’s possible unless you modify the scraper source code…
Any reason you can’t use the public URL for scraping?
j
We can, but we have to pass the authentication and it'll add noise to the ingress logs
Will check the scraper code
Never had such request I bet?
j
Not so far!