Hello all, I am exploring Typesense and like it so far. I have a design question and would like to get your thoughts on this. In my case, I am trying to build a Typesense collection that is similar to yellow pages. Data for this collection come from different sources, typically as CSV files. There are fields that are common to each CSV source (Eg., First Name, Last Name, Phone Number) . There are also fields that are specific to a particular source (Eg., Source 1 may contain 'Occupation' and Source 2 may contain 'Hobbies'). The Typesense collection will have all the fields incorporated in it. I would like to host Typesense on AWS. My question is how to ingest the data into Typesense. Should I use an intermediate DB like DynamoDB to handle the consolidation of data from different CSV sources. Thereby making Typesense read of data from DynamoDB. Another question is how to handle duplicate records from CSV files.

The Typesense collection will have all the fields incorporated in it.

That sounds good, given your use case.