It's a design decision to use in-memory indices over persistent on-disk indices: it's a crucial factor for the performance. For production usage especially with large collections, we recommend running HA set-up with 3 nodes: this helps with all forms of high availability, including rolling rotations for upgrades.