Hello Team, I have trouble while searching for data which contains the speical character like &. below is my snap shot dummy json data: {"company_id":"11609817","parent_id":"365","track_id":"1","security_id":"12", "symbol":"Ram&Madhu","company_nm":"Mahindra & Mahindra","short_name":"M&M" Whenever I search this data it gives me bad request error, intially when I created json file special character are encoded into UTF-8 still that was not coming into search. Can anybody please suggest a way here.

Could you share a set of curl commands like this that replicates the issue: https://gist.github.com/jasonbosco/7c3432713216c378472f13e72246f46b

So while creating batch document I should use text/plain, is that right?

Hi Suraj, if you can just post a snippet that i can run to see the actual error, it would be easy for me to figure out what's going wrong.

Hi Kishor.. class SearchParameters { q: m&m queryBy: security_nm,symbol,brand.brandName queryByWeights: 3,2,1 prefix: true,true,true infix: null maxExtraPrefix: null maxExtraSuffix: null filterBy: null sortBy: null facetBy: null maxFacetValues: null facetQuery: null numTypos: null page: null perPage: 100 groupBy: null groupLimit: null includeFields: null excludeFields: null highlightFullFields: null highlightAffixNumTokens: null highlightStartTag: null highlightEndTag: null snippetThreshold: null dropTokensThreshold: null typoTokensThreshold: null pinnedHits: null hiddenHits: null highlightFields: null splitJoinTokens: null preSegmentedQuery: true enableOverrides: null prioritizeExactMatch: false maxCandidates: null prioritizeTokenPosition: null exhaustiveSearch: null searchCutoffMs: null useCache: null cacheTtl: null minLen1typo: null minLen2typo: null }

The HTML response above is from your web server? I need to see the actual response from the Typesense API.

Now I am not getting any error as of now but with & it is not giving me result. it is sending me empty result

When I tried locally on a small sample set, querying with

m&m

does fetch that record for me. Please share a sample dataset so I can try it, for e.g. like this (as Jason shared earlier): https://gist.github.com/jasonbosco/7c3432713216c378472f13e72246f46b

This is my jsol file , below is data

Please post the search Java snippet also. Again, you need to post a fully reproduceable example so I run and check. Otherwise it's hard for me to help. Please post a full program in Java client that creates collection, indexes document and queries that show cases the issue.

Code

Will check and get back to you in an hour or so.

Thanks @Kishore Nallan for your quick response, appreciate🙏

@suraj bhandari That M&M document is not even getting indexed. If you check the response of the import call, you will see this error:

Field `security` has been declared in the schema, but is not found in the document.

@Kishore Nallan below is the right jsonl file, on which collection is created

{"company_id":"3005","parent_id":"16795","exchange_id":"2","security":"","symbol":"M&MFIN","company_nm":"Mahindra & Mahindra Financial Services Ltd","short_company_nm":"M & M Fin. Serv.","code":"INE774D0102","series":"","brand":[{"heading":"Financial Services","brandName":"MAHINDRA FINANCE FINSMART"}]}
{"company_id":"3004","parent_id":"27242","exchange_id":"2","security":"","symbol":"BLKASHYAP","company_nm":"B.L.Kashyap & Sons Ltd","short_company_nm":"B.L.Kashyap","code":"INE350H1032","series":"","brand":[{"heading":"Construction & Civil Engineering","brandName":"BLK"}]}
{"company_id":"4354","parent_id":"28","exchange_id":"2","security":"","symbol":"ARUNAHTEL","company_nm":"Aruna Hotels Ltd","short_company_nm":"Aruna Hotels","code":"INE95701019","series":"","brand":[{"heading":"HotelBusiness","brandName":"ARUNA"}]}

I'm yet to look. Since I juggle supporting multiple customers it's always useful if you can share a fully reproduceable example that I can just run in one go. When you share snippets like above I still need to put it together into a Java program and run it and test it. That takes a lot of my time.

I Understand, let me put the entire code base here then

Just share a single Java program in static void main that we both can run and get the exact results.

Okay got it..

Again you are adding several snippets instead of a single program which creates, collection, indexes the docs, queries and prints the result. 🙂

Whole code.. jsonl file already sent to you

Thanks will get back to you

@Kishore Nallan After removing

tokenSeparators and preSegmentedQuery *it is wokring fine now.*

Thank you for for help.:pray:

Welcome!