Technical Documentation: Difference between revisions
| (One intermediate revision by one other user not shown) | |||
| Line 28: | Line 28: | ||
| Block Storage || 3 copies, all SSD || 740 TB | | Block Storage || 3 copies, all SSD || 740 TB | ||
|- | |- | ||
| Object Storage || S3 and Swift API || 58 PB | | Object Storage || S3 and Swift API, [https://en.wikipedia.org/wiki/Erasure_code EC] 8+3 || 58 PB | ||
|- | |- | ||
| Ceph FS || High performance multi read/write <br> NVMe || 1.2 PB | | Ceph FS || High performance multi read/write <br> NVMe, [https://en.wikipedia.org/wiki/Erasure_code EC] 4+2 || 1.2 PB | ||
|} | |} | ||
| Line 50: | Line 50: | ||
* [[Backing up Object Store]] buckets to tape | * [[Backing up Object Store]] buckets to tape | ||
* Using [[rclone]] on our system | * Using [[rclone]] on our system | ||
* Configuring [[Bucket Object Versioning]] | |||
Latest revision as of 18:16, 27 November 2025
Welcome to the technical documentation wiki of the Secure Data for Health (SD4H) project. This is the primary source for users with questions on equipment and services.
Infrastructure
| Hardware | Description | Availability |
|---|---|---|
| Compute VM | Up to 64 vcores and 480 GB of RAM | 7 680 cores |
| Up to 64 vcores and 240 GB of RAM | 10 176 cores | |
| High Availability VM | Up to 64 cores and 480 GB Connected to UPS and Diesel Generators |
3 072 cores |
| GPU | Up to 2 A100-40 per VM | 20 GPU |
| Up to 2-A100-80 per VM | 8 GPU |
| Hardware | Description | Availability |
|---|---|---|
| Block Storage | 3 copies, all SSD | 740 TB |
| Object Storage | S3 and Swift API, EC 8+3 | 58 PB |
| Ceph FS | High performance multi read/write NVMe, EC 4+2 |
1.2 PB |
How to
- Store and Share data on the platform
- Networking between two projects.
- Install the OpenStack Client
- SSH to a server via Bastion
Services
- Globus Data transfer and Sharing
- Elastic HPC: High perforamce Computing in the Cloud
Object Store
- Object Store Quick Start
- Backing up Object Store buckets to tape
- Using rclone on our system
- Configuring Bucket Object Versioning