Fsx
FSx for Windows File Server
- FSx for windows file server is a fully managed native windows file server / file share
- It can integrate with managed or self managed Active Directory
- Can be deployed as Single or Multi AZ
- In Single AZ mode , uses replication within AZ to ensure resilience to hardware failures
- Can perform on demand and scheduled backups
- File system by default is private to VPC but can be accessed outside VPC using Hybrid Networking
- FSx can deliver from 8MB/s to 2GB/s performance, 100ks of iops & less than 1ms latency
- VSS - Allows users to restore to a previous version
- Native windows file system accessed over SMB
- Uses Windows permission model
- Supports Distributed File System or DFS
FSx for Lustre
- file system designed for high performance workloads
- Managed Lustre file system designed for High Performance Computing(HPC) Linux Clients
- 100s GB/s throughput & sub millisecond latency
- This can be deployed in 2 modes Persistent or Scratch
- Scratch is optimized for very high end performance . It has no replication and does not support high availability
- Persistence is longer term has High Availability in an AZ & is self healing
- Accessible over hybrid networking like VPN & Direct Connect
- The file system can be associated with an S3 repository
- At start data is in repository. It is lazily loaded in a Lustre file system as needed
- hsm_archive command can be used to sync changes from Lustre back to S3 repository
- Lustre stores meta data onto Metadata Targets(MST)
- Data is split into Object Storage Targets(OST). Each is 1.17Tib in size
- Baseline performance is based on size of the file system. File system starts with 1.2Tib and then increases in increments of 2.4 Tib
- Scratch gives a baseline performance of 200 MB/s per Tib of storage
- Persistent type offers 3 levels 50 MB/s, 100 MB/s & 200 MB/s per Tib of storage
- Both types can burst upto 1300 MB/s per Tib based on credits