I've separated the load out into a bunch of different types of databases now. to protect the query process and to as well protect the data. That way we dont have surmounted failure. We just have sections go into outage.
Im almost to the point where this system will be able to be used by other parties. and also making a local sync server so that way companies can hold their data locally to their own office to be in compliance with many state governments about data storage. Hopefully if everything goes right all this sensitive data will be captured into a local box at the clients office and encrypted as a black box format.
That way the data is truly local and protected in a cloud setup.