Technical Documentation: Difference between revisions

Jump to navigation Jump to search
no edit summary
No edit summary
 
(26 intermediate revisions by 3 users not shown)
Line 1: Line 1:
<strong>Welcome to the technical documentation wiki of the Secure Data for Health (SD4H) project.</strong>
<strong>Welcome to the technical documentation wiki of the Secure Data for Health (SD4H) project.</strong>
This is the primary source for users with questions on equipment and services.
This is the primary source for users with questions on equipment and services.
Most of our services are deployed on Juno, an infrastructure that we manage along the Calcul Québec Team, we can be joined for any question at [mailto:juno@calculquebec.ca juno@calculquebec.ca]


== Infrastructure ==
== Infrastructure ==
Line 10: Line 13:
! Hardware  !! Description !!  Availability
! Hardware  !! Description !!  Availability
|-
|-
| rowspan="2" | Compute VM  ||  Up to 64 vcores and 480 GB of RAM||  1024 vcores
| rowspan="2" | Compute VM  ||  Up to 64 vcores and 480 GB of RAM||  7 680 cores
|-
|-
     || Up to 64 vcores and 240 GB of RAM || 1536 vcores  
     || Up to 64 vcores and 240 GB of RAM || 10 176 cores  
|-
|-
| High Availability VM ||  Up to 64 cores and 480 GB <br> Connected to UPS and Diesel Generators || 1024 vcores
| High Availability VM ||  Up to 64 cores and 480 GB <br> Connected to UPS and Diesel Generators || 3 072 cores
|-
|-
| rowspan="2" | GPU  ||  Up to 2 A100-40 per VM || 20 GPU
| rowspan="2" | GPU  ||  Up to 2 A100-40 per VM || 20 GPU
Line 26: Line 29:
! Hardware  !! Description !!  Availability
! Hardware  !! Description !!  Availability
|-
|-
| Block Storage || All SSD  || 273 TB
| Block Storage || 3 copies, all SSD  || 740 TB
|-
|-
| Object Storage ||  S3 and Swift API || 5PB
| Object Storage ||  S3 and Swift API, [https://en.wikipedia.org/wiki/Erasure_code EC] 8+3 || 58 PB
|-
|-
| Ceph FS || High performance multi read/write <br> All SSD || 1PB
| Ceph FS || High performance multi read/write <br> NVMe, [https://en.wikipedia.org/wiki/Erasure_code EC] 4+2  || 1.2 PB


|}
|}
==How to==
* [[Store and Share data]] on the platform
* [[Networking]] between two projects.
* Install and configure the [[OpenStack Client]]
* [[SSH to a server via Bastion]]


==Services==
==Services==


* [[Globus]] Data transfer and Sharing
* [[Globus]] Data transfer and Sharing
* [[Elastic HPC]]: High perforamce Computing in the Cloud
* [[Elastic HPC]]: High Performance Computing in the Cloud
 
==Object Store==
 
* [[Object Store Quick Start]]
* [[Backing up Object Store]] buckets to tape
* [[Backing up Object Store]] buckets to tape
* [[Object store and sharing]] buckets to tape
* Using [[Bucket policy]]
* Using [[rclone]] on our system
* Configuring [[Bucket Object Versioning]]
172

edits

Navigation menu