The most visible benefit of a GPU would be indexing performance when using automatic embeddings.
For generating embeddings during search for semantic search, you'll only see the benefit of a GPU if you have sufficiently high concurrency of search requests. At low volumes, CPU should be fine