Store and Share data: Difference between revisions

no edit summary
No edit summary
 
(5 intermediate revisions by the same user not shown)
Line 6: Line 6:
= Configuring S3 access =
= Configuring S3 access =


==Install the openstack client==
# You first need to have your [[OpenStack Client]] installed and configured.
You will need to install and configure the [https://pypi.org/project/python-openstackclient/ openstack client] on your machine.
# Then, with the client you generate an e2c/S3 id and secret
 
<tabs>
<tab name="Fedora/RedHat Linux">
You can install the client form you package manager
{{Code
  |lang="bash"
  |contents=
sudo dnf install python-openstackclient-doc.noarch
# test the installation
openstack --version
}}
</tab>
<tab name="Debian/Ubuntu Linux">
You can install the client form you package manager
{{Code
  |lang="bash"
  |contents=
sudo apt-get install python python-dev python-pip
sudo pip install python-openstackclient
# test the installation
openstack --version
}}
</tab>
 
<tab name="pip">
This will get you the latest version of the client
{{Code
  |lang="bash"
  |contents=
pip install python-openstackclient
# test the installation
openstack --version
 
}}
</tab>
 
<tab name="OSX">
 
You need to have [https://brew.sh/ homebew] installed, then the client can be install using pipx
{{Code
  |lang="bash"
  |contents=
brew install pipx
pipx install python-openstackclient
# test the installation
openstack --version
}}
</tab>
 
<tab name="windows">
Install your favorite linux distribution
with [https://learn.microsoft.com/en-us/windows/wsl/install-manual Windows Subsystem Linux]
and follow the precedure from another tab :)
</tab>
 
</tabs>
 
==Get the RC file from Juno==
 
Once the client is install you need to set credentials to login. You can get these credentials by connecting to the [https://juno.calculquebec.ca/ Juno web page]. Select the right project to store your data and download the RC file:
 
[[File:Openstack rc.gif|caption|frame|none| the RC file from the Juno website]]
 
Lets say the we have saved the files here <code> $HOME/id/myproject-openrc.sh.</code>
 
==Create the S3 (ec2) Credentials==


With the client is installed and the RC files downloaded in step 1 you can create the S3 ID and secret.


<syntaxhighlight lang="bash" line>
<syntaxhighlight lang="bash" line>
Line 94: Line 29:
</syntaxhighlight>
</syntaxhighlight>


The important values here are </code>access<code> and <code>secret</code> which are the S3 [aws_]access_key_id and [aws_]secret_access_key respextively. AWS stands for Amazon Web Services, they are the creator of the S3 API.   
The important values here are access<code> and <code>secret</code> which are the S3 [aws_]access_key_id and [aws_]secret_access_key respextively. AWS stands for Amazon Web Services, they are the creator of the S3 API.   
 
 
=Manage you S3 buckets with Globus=


==Manage you S3 buckets with Globus==
See the [[Globus]] documentation


Use you CCDB account to connect to the [https://www.globus.org/ globus web site] and serche for the ''SD4H Globus S3 Collection'' collections in the file manager tab.
=Use a S3 client to manage your bucket=
There are a few clients that can be used to access Ceph S3 api. We recomend [[rclone]], it is fast and and flexible.
123

edits