Technical Documentation: Difference between revisions

Jump to navigation Jump to search
no edit summary
No edit summary
No edit summary
 
(33 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<strong>Welcome to the technical documentation wiki of the Secure Data for Health (SD4H) project.</strong>
<strong>Welcome to the technical documentation wiki of the Secure Data for Health (SD4H) project.</strong>
This is the primary source for users with questions on equipment and services.
This is the primary source for users with questions on equipment and services.
Most of our services are deployed on Juno, an infrastructure that we manage along the Calcul Québec Team, we can be joined for any question at [mailto:juno@calculquebec.ca juno@calculquebec.ca]


== Infrastructure ==
== Infrastructure ==


{| class="wikitable" style="margin:auto"
 
|+ SH4H infrastructure
{| class="wikitable"  
|+ Computing
|-
|-
! Hardware  !! Description !!  Availability
! Hardware  !! Description !!  Availability
|-
|-
| rowspan="2" | Compute VM  ||  Up to 64 cores and 480 GB ||   1024 cores
| rowspan="2" | Compute VM  ||  Up to 64 vcores and 480 GB of RAM||  7 680 cores
|-
    || Up to 64 vcores and 240 GB of RAM || 10 176 cores 
|-
| High Availability VM ||  Up to 64 cores and 480 GB <br> Connected to UPS and Diesel Generators || 3 072 cores
|-
|-
    || Up to 64 cores and 240 GB || 1536 cores 
| rowspan="2" | GPU  ||  Up to 2 A100-40 per VM || 20 GPU
|-
|-
    || Up to 2-A100-80 per VM || 8 GPU
|}


| High Availability VM ||  Up to 64 cores and 480 GB <br> Connected to UPS and Diesel Generators || 1024 cores
{| class="wikitable"
|+ Storage
|-
|-
| Block Storage || All SSD   || 273 TB
! Hardware   !! Description !!  Availability
|-
|-
| Object Storage || S3 and Swift API || 5PB
| Block Storage || 3 copies, all SSD  || 740 TB
|-
|-
| Ceph FS || High performance multi read/write <br> All SSD || 1PB
| Object Storage ||  S3 and Swift API, [https://en.wikipedia.org/wiki/Erasure_code EC] 8+3 || 58 PB
|-
| Ceph FS || High performance multi read/write <br> NVMe, [https://en.wikipedia.org/wiki/Erasure_code EC] 4+2  || 1.2 PB


|}
|}


==How to==
* [[Store and Share data]] on the platform
* [[Networking]] between two projects.
* Install and configure the [[OpenStack Client]]
* [[SSH to a server via Bastion]]


==Services==
==Services==


[[Globus]] Data transfer and Sharing  
* [[Globus]] Data transfer and Sharing
[[Elastic HPC]]: High perforamce Computing in the Cloud
* [[Elastic HPC]]: High Performance Computing in the Cloud
 
==Object Store==
 
* [[Object Store Quick Start]]
* [[Backing up Object Store]] buckets to tape
* Using [[Bucket policy]]
* Using [[rclone]] on our system
* Configuring [[Bucket Object Versioning]]
172

edits

Navigation menu