This looks like a limitation on the react-instantsearch side. I see an open discussion in their repo asking for this, with no response yet:
https://github.com/algolia/instantsearch/discussions/5276
I’d recommend following up there.
Until them you might have to build your own custom refinement list