Hi, I insert docs by using import?action=create bu...
# community-helpb
Bill
09/02/2024, 11:47 AMHi, I insert docs by using import?action=create but when I index a new document it doesn't continue the id number sequentially but starts from lower. Is there any way to set the id number?
k
Kishore Nallan
09/02/2024, 1:12 PMThe ID will be sequential. Are you able to show a small reproduction of the issue?
b
Bill
09/02/2024, 1:14 PMI use Typesense v27.0.0. I just add docs with import?action=create and when I index a new doc the id starts with a lower number. For example, I import docs with ids [235,236,237..]. When I index a new it starts from id = 10.
k
Kishore Nallan
09/02/2024, 1:21 PMAre you saying some docs have their own IDs and some have missing IDs?
b
Bill
09/02/2024, 1:21 PMall the docs that I import have ids
Bill
09/02/2024, 1:22 PMwhen I index a new one it hasn't
k
Kishore Nallan
09/02/2024, 1:22 PMIf you are going to insert a new document without an ID then it will use an auto genrator counter for giving it an ID. That has no knowledge about previous IDs of documents since IDs can be alphanumeric.
b
Bill
09/02/2024, 1:22 PMIf the last imported doc has id: 26. When I index a new one it should have 27
Bill
09/02/2024, 1:23 PMYes but the auto generator starts from 10 instead of 26
k
Kishore Nallan
09/02/2024, 1:24 PMYeah that's how it is, you can't mix documents with and without IDs to have same sequence. We don't support that.
b
Bill
09/02/2024, 1:24 PMSo in order to set the auto generator to start from 26 should I have to index 16 more docs?
Bill
09/02/2024, 1:25 PMIs there any other way? The generator. starts at 10 and my last doc id is 225
k
Kishore Nallan
09/02/2024, 1:26 PMGenerator begins at zero. Maybe there were some earlier docs that were indexed without ID and deleted.
Kishore Nallan
09/02/2024, 1:26 PMEither generate IDs for all docs or don't. Cannot mix those two modes.
b
Bill
09/02/2024, 1:27 PMI'm referring to initial typesense doc id
Bill
09/02/2024, 1:27 PMthat is always number not special doc id
Bill
09/02/2024, 1:27 PM"id" key in doc
k
Kishore Nallan
09/02/2024, 1:28 PMI don't fully follow what you are saying but don't depend on IDs generated by Typesense for internal use.
Kishore Nallan
09/02/2024, 1:28 PMAs long as you have an id field in the document Typesense will only use to that as identifier
b
Bill
09/02/2024, 1:32 PMWhen you index a new doc, it gets an auto generated id in "id" key
Bill
09/02/2024, 1:32 PMIf you import doc the id key should start from the id of the latest inserted doc
k
Kishore Nallan
09/02/2024, 1:33 PMPlease share an example that shows the problem, it's much easier.
Kishore Nallan
09/02/2024, 1:34 PMID already does start from latest inserted doc. But if you delete docs we can't decrease IDs to account for that. It will keep increasing.
b
Bill
09/02/2024, 1:36 PMI insert this doc: {"name": "test", "id": "12"} by using import?action=create. Then i index a new doc ({"name": "test"}) (without import?action=create - normal POST). The new doc get's id eg. 5 instead of 13.
k
Kishore Nallan
09/02/2024, 1:43 PMYeah that's what I'm saying. You can't mix those modes.
b
Bill
09/02/2024, 1:46 PMSo the only way to sync id generator is to create eg. 12 docs
Bill
09/02/2024, 1:46 PM?
k
Kishore Nallan
09/02/2024, 1:46 PMAlways send a document ID.
Kishore Nallan
09/02/2024, 1:46 PMWhy do some docs have missing IDs?
b
Bill
09/02/2024, 1:48 PMWhy should I send id if its auto generated
Bill
09/02/2024, 1:48 PM?
k
Kishore Nallan
09/02/2024, 1:50 PMWhy do you send "12" in the example above then?
b
Bill
09/02/2024, 1:51 PMBecause I migrate data from one cluster to another. I can't change the ids because they are saved in my db also
k
Kishore Nallan
09/02/2024, 1:51 PMYeah if you send IDs you have to send always. That's what I've been trying to say. What you want to do is not possible.
b
Bill
09/02/2024, 2:01 PMSo i need to create 12 docs and delete them in order to sync the id generator.
Bill
09/02/2024, 2:02 PMIt would be very useful if we can set it after importing docs in a feature version of typesense.
k
Kishore Nallan
09/02/2024, 2:24 PMI don't see us being able to support this.