Upsert Script Issues and Missing Spaces in Typesense
TLDR Alex is experiencing issues with missing spaces in Typesense, specifically appearing more frequently during upserts. The missing spaces persist despite changing versions and implementing a workaround. Despite detailed troubleshooting with Kishore Nallan, the issue remains unresolved. The problem appears to be random and unpredictable. Further testing and dataset sharing were suggested for resolution.
Mar 31, 2022 (18 months ago)
Alex
01:42 PMKishore Nallan
02:21 PMAlex
02:30 PMKishore Nallan
02:32 PMKishore Nallan
02:33 PMAlex
02:33 PMKishore Nallan
02:34 PMAlex
02:34 PMApr 06, 2022 (17 months ago)
Alex
08:53 PMAlex
09:23 PMApr 07, 2022 (17 months ago)
Kishore Nallan
01:12 AMAlex
11:31 AMAlex
11:33 AM{"count":1,"highlighted":"$500- $1500","value":"$500- $1500"}],"field_name":"price_str","stats":{"total_values":3}}]
Kishore Nallan
11:34 AMprice_str
field in the document object also has this space missing?Alex
11:35 AM-H 'Connection: keep-alive' \
-H 'Accept: application/json, text/plain, /*' \
-H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/99.0.4844.84 Safari/537.36' \
-H 'Content-Type: text/plain' \
-H 'Origin: http://alex.pc-america.com:3010' \
-H 'Referer: http://alex.pc-america.com:3010/' \
-H 'Accept-Language: pl-PL,pl;q=0.9' \
--data-raw '{"searches":[{"query_by":"concat","sort_by":"instock:desc,popularity:desc,_text_match:desc","prioritize_exact_match":false,"num_typos":1,"drop_tokens_threshold":0,"typo_tokens_threshold":2,"highlight_fields":"concat,description,name","highlight_full_fields":"description,name","collection":"products","q":"","facet_by":"productType,price_str,brand,categories,lastDay,lastWeek,lastMonth,instock,free_shipping,price,_Application/Usage,_Form Factor,_Provided Support,_Service Type,_Service Availability Days,_Service Availability Hours,_Service Duration,_Service Location,_Product Family,_Processor Manufacturer,_Output Receptacles,_Operating System,_Processor Type,_Color,_Processor Model,_Standard Memory,_Operating System Platform,_Processor Speed,_Total Solid State Drive Capacity,_Media Size,_Ethernet Technology,_Graphics Controller Manufacturer,_Graphics Controller Model,_Processor Core,_Weight (Approximate),_Operating System Architecture,_Drive Type,_License Type,_Media Type Supported,_Network Technology,_Graphics Memory Accessibility,_HDMI,_Keyboard Localization,_Operating System Language,_License Quantity,_Input Voltage,_Rack Height,_Total Number of USB Ports,_Screen Size,_Maximum Power Supply Wattage,_Input Current,_Power Rating (VA),_Input Receptacles,_Placement,_Output Voltage,_Touchscreen,_Wireless LAN Standard,_Screen Resolution,_Wireless LAN,_USB Type-C,_Energy Star,_Environmentally Friendly,_Optical Drive Type,_Bluetooth,_Phase,_Device Supported,_Firewall Protection Supported,_Limited Warranty,_Media Type,_PDU Type,_Power Rating (Watt),_Number of Cells,_Mounting Orientation,_Finger Print Reader,_Length,_Keyboard Backlight,_License Validation Period,_Screen Mode,_Host Interface,_Interfaces/Ports Details,_Processor Generation,_Storage Capacity,_TAA Compliant,_Cable Length,_USB,_DisplayPort,_Platform Supported,_Drive Interface,_Memory Technology,_Number of Total Memory Slots,_Port/Expansion Slot Details,_Layer Supported,attrib.lvl0,categories.lvl0","filter_by":"price_str:=[
$500 - $1500
] && price:=[1490..1501]","max_facet_values":100,"page":1,"per_page":60},{"query_by":"concat","sort_by":"instock:desc,popularity:desc,_text_match:desc","prioritize_exact_match":false,"num_typos":1,"drop_tokens_threshold":0,"typo_tokens_threshold":2,"highlight_fields":"concat,description,name","highlight_full_fields":"description,name","collection":"products","q":"","facet_by":"price_str","filter_by":"price:=[1490..1501]","max_facet_values":100,"page":1,"per_page":1},{"query_by":"concat","sort_by":"instock:desc,popularity:desc,_text_match:desc","prioritize_exact_match":false,"num_typos":1,"drop_tokens_threshold":0,"typo_tokens_threshold":2,"highlight_fields":"concat,description,name","highlight_full_fields":"description,name","collection":"products","q":"","facet_by":"price","filter_by":"price_str:=[$500 - $1500
]","max_facet_values":100,"page":1,"per_page":1}]}' \--compressed \
--insecure
Alex
11:36 AMKishore Nallan
11:38 AMprice_str
field in the actual document returned in the result in the hits
array in the JSON response?Alex
11:42 AMAlex
11:45 AMKishore Nallan
11:46 AMAlex
11:46 AMAlex
11:47 AMKishore Nallan
11:47 AMKishore Nallan
11:48 AMAlex
11:49 AMKishore Nallan
11:49 AMAlex
11:51 AMKishore Nallan
11:52 AMAlex
12:12 PMAlex
12:14 PMAlex
12:15 PMKishore Nallan
12:17 PMKishore Nallan
12:17 PMAlex
12:19 PMAlex
12:24 PMKishore Nallan
12:30 PMAlex
12:39 PMAlex
01:07 PMKishore Nallan
01:13 PMApr 08, 2022 (17 months ago)
Alex
12:12 PMKishore Nallan
12:20 PMTypesense
Indexed 2764 threads (79% resolved)
Similar Threads
Handling Kinesis Stream Event Batching with Typesense
Dui had questions about how to handle Kinesis stream events with Typesense. Kishore Nallan suggested using upsert mode for creation/update and differentiating with logical deletion. After various discussions including identifying and resolving a bug, they finalized to introduce an `emplace` action in Typesense v0.23.


Resolving Typesense v0.22.0 Import Issues
Anton encountered issues importing documents in batches using Typesense v0.22.0. Kishore Nallan suggested using atomic import and proposed a debug build. After multiple trials, they were able to reproduce and fix the issue. Anton confirmed the solution was working.

Typesense Server Bulk Import/Upsert Issue Resolved
Adam was confused about the discrepancy between the successful responses and the actual indexed data while working with a custom WP plugin integrating with Typesense. The issue was a bug related to fetching documents in the wrong order, not a Typesense problem.

Phrase Search Relevancy and Weights Fix
Jan reported an issue with phrase search relevancy using Typesense Instantsearch Adapter. The problem occurred when searching phrases with double quotes. The team identified the issue to be related to weights and implemented a fix, improving the search results.


Issue with `included_fields` Command in Typesense
SamHendley encountered an issue with the `included_fields` command in Typesense versions 0.23.0 and 0.24.0.rc17. Jason helped identify it as a bug in the 0.24.X version, which was later addressed in release 0.24.0.rcn19.