Hi Team, could it be that a "special character" is...
# community-helps
Sergio Behrends
03/01/2023, 1:47 PMHi Team, could it be that a "special character" is messing up indexing or querying?
Although documentation mention that "Typesense will remove special characters", could be that this special character got through, and querying was returning empty values.
Sergio Behrends
03/01/2023, 1:47 PMSergio Behrends
03/01/2023, 1:50 PMWe indexed
Apple TV 128GB 4Kk
Kishore Nallan
03/01/2023, 1:55 PMInteresting, is it possible for you to post a code snippet that I can run to index that data?
s
Sergio Behrends
03/01/2023, 2:14 PMmessage has been deleted
Sergio Behrends
03/01/2023, 2:15 PMPasting the code here seems to clean it 😕
Sergio Behrends
03/01/2023, 2:16 PMMaybe it's a edge case
k
Kishore Nallan
03/01/2023, 2:16 PMOk we might have to handle this explicitly, can you please create an issue on GH?
s
Sergio Behrends
03/01/2023, 2:17 PMDo you have where do you sanitize the input? Maybe I can take a look
k
Kishore Nallan
03/01/2023, 2:19 PMI Just checked, we explicitly split on space and newline. Because non visible white space is not differentiated from regular unicode which we can't split on because that's valid.