Linux is very good with handling hundreds of thousands of files in folders - that is a good choice.
For backup I suggest using rsync to do a mirror copy of the vaults. If you do not have a backup yet, ideally start the initial backup over the weekend, then use a daily rsync copy to keep the vault copy up to date. This will let you just copy the changes, rather than having to copy the whole vault over.