A Conda-based, templatable, extendable, R&D-focused infrastructure scaffold aiming at fast iterability and cross-unix robustness.
Some relevant specifications:
- The entire thing is Python-based.
- PyTorch and JAX (plus some respective extensions) are the supported deep learning frameworks. Some inter-operability is also guaranteed.
- The hardware stack of reference is Intel CPU and Nvidia GPU.
- A UNIX (or UNIX-like at least) system is a prerequisite.
-
Ensure that you have not an already-existing Anaconda environment called
RDDL
(or, for our purposes, whichever name you want to call the environment to-be-created). Otherwise, it will be overwritten without further notice! -
Ensure that you are running
bash
orzsh
as shell, since they are the only supported (nofish
, sorry... although I use it as my default shell in most of the cases!), and verify that theconda
(ormamba
, if you want to use it instead) command is available and working correctly. -
Clone the GitHub repository via
git clone https://github.com/emaballarin/RDDL.git
. -
Open the
init.sh
andportablecuda.sh
script files, and check if the environment variables, paths and versions are OK for your system. Please, note that this set of scripts is nothing more than a (useful, though) tool for personal use, shared in the hope it might be useful to someone else too. It is not a full-fledged, stable product. Some rough edges may still be present. In this case, however, minimal modifications should be enough! -
Let the script prepare and install everything, via
./init.sh
. Note that an active Internet connection is still required for everything to work as expected.
After having followed the Essential how-to right above, in order to properly use this
specific conda
setup from the fish
shell, without sacrificing otherwise-working conda
integration, you need to:
-
Ensure that you are starting from a clean (i.e. non-
conda
-integratedfish
setup), undoing any step previously followed in this direction (note: any functionality will be restored by following such procedure!). -
Add the line
source "$HOME/anaconda3/etc/fish/conf.d/conda.fish"
to one (any valid)fish
script sourced on shell startup. -
Install the
bass
plugin forfish
. -
Add the aliases
alias conda_activate="bass source activate"
andalias conda_deactivate="bass source deactivate"
to one (any valid)fish
script sourced on shell startup. -
Use such aliases to activate (at least) the
RDDL
environment. Note that the usualconda
command (fromfish
) currently fails to properly sourcebash
-compatible scripts located in$CONDA_PREFIX/etc/conda/activate.d/
and$CONDA_PREFIX/etc/conda/deactivate.d/
whichRDDL
needs!