sounds like your server might be hitting memory limits and writing to swap. If you're confident no operations are happening for you, the server might be re-allocating resources to other users on your shared server.