The quality of the retrieval is completely dependent on the model used... Could you check if the distance_threshold in vector_query is too low may be?