Technical Documentation: Difference between revisions
Jump to navigation
Jump to search
(→How to) |
No edit summary |
||
| (17 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
<strong>Welcome to the technical documentation wiki of the Secure Data for Health (SD4H) project.</strong> | <strong>Welcome to the technical documentation wiki of the Secure Data for Health (SD4H) project.</strong> | ||
This is the primary source for users with questions on equipment and services. | This is the primary source for users with questions on equipment and services. | ||
Most of our services are deployed on Juno, an infrastructure that we manage along the Calcul Québec Team, we can be joined for any question at [mailto:juno@calculquebec.ca juno@calculquebec.ca] | |||
== Infrastructure == | == Infrastructure == | ||
| Line 10: | Line 13: | ||
! Hardware !! Description !! Availability | ! Hardware !! Description !! Availability | ||
|- | |- | ||
| rowspan="2" | Compute VM || Up to 64 vcores and 480 GB of RAM|| | | rowspan="2" | Compute VM || Up to 64 vcores and 480 GB of RAM|| 7 680 cores | ||
|- | |- | ||
|| Up to 64 vcores and 240 GB of RAM || | || Up to 64 vcores and 240 GB of RAM || 10 176 cores | ||
|- | |- | ||
| High Availability VM || Up to 64 cores and 480 GB <br> Connected to UPS and Diesel Generators || | | High Availability VM || Up to 64 cores and 480 GB <br> Connected to UPS and Diesel Generators || 3 072 cores | ||
|- | |- | ||
| rowspan="2" | GPU || Up to 2 A100-40 per VM || 20 GPU | | rowspan="2" | GPU || Up to 2 A100-40 per VM || 20 GPU | ||
| Line 26: | Line 29: | ||
! Hardware !! Description !! Availability | ! Hardware !! Description !! Availability | ||
|- | |- | ||
| Block Storage || | | Block Storage || 3 copies, all SSD || 740 TB | ||
|- | |- | ||
| Object Storage || S3 and Swift API || | | Object Storage || S3 and Swift API, [https://en.wikipedia.org/wiki/Erasure_code EC] 8+3 || 58 PB | ||
|- | |- | ||
| Ceph FS || High performance multi read/write <br> | | Ceph FS || High performance multi read/write <br> NVMe, [https://en.wikipedia.org/wiki/Erasure_code EC] 4+2 || 1.2 PB | ||
|} | |} | ||
| Line 37: | Line 40: | ||
* [[Store and Share data]] on the platform | * [[Store and Share data]] on the platform | ||
* [[Networking]] between two projects. | * [[Networking]] between two projects. | ||
* Install the [[OpenStack Client]] | * Install and configure the [[OpenStack Client]] | ||
* [[SSH to a server via Bastion]] | |||
==Services== | ==Services== | ||
* [[Globus]] Data transfer and Sharing | * [[Globus]] Data transfer and Sharing | ||
* [[Elastic HPC]]: High | * [[Elastic HPC]]: High Performance Computing in the Cloud | ||
==Object Store== | ==Object Store== | ||
| Line 48: | Line 52: | ||
* [[Object Store Quick Start]] | * [[Object Store Quick Start]] | ||
* [[Backing up Object Store]] buckets to tape | * [[Backing up Object Store]] buckets to tape | ||
* Using [[Bucket policy]] | |||
* Using [[rclone]] on our system | * Using [[rclone]] on our system | ||
* Configuring [[Bucket Object Versioning]] | |||
Latest revision as of 19:43, 29 June 2026
Welcome to the technical documentation wiki of the Secure Data for Health (SD4H) project. This is the primary source for users with questions on equipment and services.
Most of our services are deployed on Juno, an infrastructure that we manage along the Calcul Québec Team, we can be joined for any question at juno@calculquebec.ca
Infrastructure
| Hardware | Description | Availability |
|---|---|---|
| Compute VM | Up to 64 vcores and 480 GB of RAM | 7 680 cores |
| Up to 64 vcores and 240 GB of RAM | 10 176 cores | |
| High Availability VM | Up to 64 cores and 480 GB Connected to UPS and Diesel Generators |
3 072 cores |
| GPU | Up to 2 A100-40 per VM | 20 GPU |
| Up to 2-A100-80 per VM | 8 GPU |
| Hardware | Description | Availability |
|---|---|---|
| Block Storage | 3 copies, all SSD | 740 TB |
| Object Storage | S3 and Swift API, EC 8+3 | 58 PB |
| Ceph FS | High performance multi read/write NVMe, EC 4+2 |
1.2 PB |
How to
- Store and Share data on the platform
- Networking between two projects.
- Install and configure the OpenStack Client
- SSH to a server via Bastion
Services
- Globus Data transfer and Sharing
- Elastic HPC: High Performance Computing in the Cloud
Object Store
- Object Store Quick Start
- Backing up Object Store buckets to tape
- Using Bucket policy
- Using rclone on our system
- Configuring Bucket Object Versioning