Due to limited user-level permissions on managed clusters, installing and maintaining Python packages becomes a challenging task for novice users. This script uses Anaconda environments and environment modules (Lmod) to simplify this process. There are three simple steps to install and use Python packages using rcac-conda-env
:
- Create an Anaconda environment using
rcac-conda-env
. During the process, the script automatically creates module file for using the environment. - Load the module generated by
rcac-conda-env
. By default modules are generated in$HOME/privatemodules
. You will need to add it to your$MODULEPATH
. - Now use
conda
orpip
to install your Python package. Once the installation finishes, you can directlyimport
it in your script. No need to runconda init
orconda activate
.
Prerequisites
- You must have Lmod module software installed and configured on your system. Currently,
rcac-conda-env
generates module files in Lua format only. If you need to use TCL modules or would like to contribute a patch, please contact the maintainers. - Anaconda must be installed as a module. The script assumes that
$CONDA_ENVS_PATH
is defined in your Anaconda module and points to a writable directory, otherwiseconda create -n my_env
command may fail.
User guide for rcac-conda-env
is provided as a manual page with this repository. You will need to add the share
directory to your $MANPATH
.
$ export PATH=/path/to/rcac-conda-env:$PATH
$ export MANPATH=/path/to/rcac-conda-env/share/man:$MANPATH
$ man rcac-conda-env
A shortened version of usage instructions can be obtained with --help
option.
$ rcac-conda-env --help
Several use-cases of rcac-conda-env
is given in this webpage: Python package installation
Kindly cite usage of this tool by pointing to this repository.
Amiya K Maji and Lev Gorenstein. RCAC-CONDA-ENV: A tool for simplifying Python package installation
on HPC clusters, 2019. https://github.com/amaji/rcac-conda-env
This code is maintained by Amiya K Maji ([email protected]) and Lev Gorenstein ([email protected]).
© Purdue University, 2019