Ok got it, then bucketing on text match scores will help you I think. It will introduce a certain amount of fuzziness into text match scores so that the vector distance is used for re-ranking.