Adding Colon as Token Separator in Java Client
TLDR Ivy encountered issues adding ":" as a token separator using the Java client for Typesense. Jason asked them to open a Github issue for further investigation.
Powered by Struct AI
1
6
6mo
Jun 08, 2023 (6 months ago)
Ivy
Ivy
02:25 PMHey all! I'm trying to add
How does Typesense use
.name(schema.name.asString)
.fields(typesenseFields)
.enableNestedFields(true)
.tokenSeparators(listOf(":", "-", ",", "\""))```
:
as a token separator using the Java client, but in Typesense, I don't see it. So not sure if it worked and it's not showing up or it didn't work 😅How does Typesense use
""
as a token_separator also?"token_separators": [
"",
"-",
",",
"\""
] ```
val typesenseSchema = CollectionSchema().name(schema.name.asString)
.fields(typesenseFields)
.enableNestedFields(true)
.tokenSeparators(listOf(":", "-", ",", "\""))```
Jason
Jason
04:45 PMCC: Kishore Nallan ^
Ivy
Ivy
04:48 PMThis might be an issue on Typesense vs the Java client Jason
04:48
Ivy
04:48 PM[","]
works, but not [":"]
or [":", ","]
Jason
Jason
04:55 PMHmmm, mind copy-pasting that schema into a Github issue? Need to take a closer look
Ivy
Typesense
Lightning-fast, open source search engine for everyone | Knowledge Base powered by Struct.AI
Indexed 3015 threads (79% resolved)
Similar Threads
Restricting `token_separators` to a Specific Field in Typesense
Loic asked Jason about applying `token_separators` to a specific field in Typesense. Jason suggested opening a github issue to add this feature.
3
18mo
Updating token_separators in Typesense Cloud Issue
Loic encountered an error while trying to update token_separators in Typesense Cloud. Jason suggested creating a new schema and reindexing data.
3
16mo
Typesense Search Issue with Special Characters
Saurabh faced an issue in Typesense when searching for "security". Kishore Nallan explained special characters are removed and suggested adding "-" as a token separator in the configuration.
2
6mo