If you can maintain network quality (latency, throughput, packet loss) the tradeoffs of using a SAN/NAS solution can be well worth it. For example it makes moving services+storage between compute a trivial affair.
To (inexactly) translate SAN/NAS into AWS terms for those that may not be familiar with these types of on-prem deployments:
S3/EFS/Glacier is NAS–files are stored and retrieved over the network.
EBS is SAN–the storage is exposed as a block level device over the network and appear as locally attached devices.
To (inexactly) translate SAN/NAS into AWS terms for those that may not be familiar with these types of on-prem deployments: S3/EFS/Glacier is NAS–files are stored and retrieved over the network. EBS is SAN–the storage is exposed as a block level device over the network and appear as locally attached devices.