Store and Share data: Difference between revisions

From SD4H wiki
Jump to navigation Jump to search
Line 15: Line 15:
   |contents=
   |contents=
sudo dnf install python-openstackclient-doc.noarch
sudo dnf install python-openstackclient-doc.noarch
# test the installation
openstack --version
}}
}}
</tab>
</tab>
Line 23: Line 25:
   |contents=
   |contents=
pip install python-openstackclient
pip install python-openstackclient
# test the installation
openstack --version
}}
}}
</tab>
</tab>
Line 28: Line 33:
<tab name="OSX">
<tab name="OSX">


how to osx
You need to have [https://brew.sh/ homebew] installed, then the client can be install using pipx
 
{{Code
  |lang="bash"
  |contents=
brew install pipx
pipx install python-openstackclient
# test the installation
openstack --version
}}
 


</tab>
</tab>
</tabs>
</tabs>

Revision as of 20:29, 8 November 2024

Intro

SD4H has a large Object Store. Objects are accessible through a web API via the Rados Gateway (radosgw) service. Both the S3 and swift API standards are supported by the radosgw.

In an Object Store, an object is the equivalent of a file on a posix file system. The object store gives users a lot of flexibility, but the steps to do simple tasks like sharing and transferring data involve somewhat of a learning cure. We propose a procedure here so this curve is as gentle as possible. Once done, the procedure will be both more secure and more flexible than sharing data on a share HPC platform or on some VM owned by your group.

Configuring S3 access

You will need to install and configure the openstack client on your machine.

You can install the client form you package manager

sudo dnf install python-openstackclient-doc.noarch
# test the installation
openstack --version

Or with pip

pip install python-openstackclient
# test the installation
openstack --version

You need to have homebew installed, then the client can be install using pipx


brew install pipx
pipx install python-openstackclient
# test the installation
openstack --version