Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add installation script for OLCF Summit #1

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from
1 change: 0 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -104,7 +104,6 @@ celerybeat.pid
# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
Expand Down
13 changes: 13 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -95,6 +95,13 @@ From the `scalable-bo/build` folder, execute the following commands:
```console
../install/thetagpu.sh
```
### For Summit (OLCF)

From the `scalable-bo/build` folder, execute the following commands:

```console
../install/summit.sh
```

## Organization of the repository

Expand Down Expand Up @@ -209,3 +216,9 @@ cd experiments/theta/jobs/
cd experiments/thetagpu/jobs/
```


### For Summit (OLCF)

```console
cd experiments/summit/jobs/
```
22 changes: 22 additions & 0 deletions experiments/summit/jobs/minimalistic-frnn-test.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
#!/bin/bash
#BSUB -nnodes 1
#BSUB -W 2:00
#BSUB -q debug
#BSUB -P fus145

# https://docs.olcf.ornl.gov/systems/summit_user_guide.html#common-bsub-options

source ../../../build/activate-dhenv.sh

export RANKS_PER_NODE=1
export NUM_NODES=1
export PYTHONPATH=../../../build/dhenv/lib/python3.8/site-packages/:$PYTHONPATH

which python
echo $PATH

echo "Running: jsrun -E LD_LIBRARY_PATH -E PYTHONPATH -E PATH -n $(( $NUM_NODES * $RANKS_PER_NODE )) python -m scalbo.benchmark.minimalistic_frnn"
jsrun -E LD_LIBRARY_PATH -E PYTHONPATH -E PATH -n $(( $NUM_NODES * $RANKS_PER_NODE )) -r1 -g6 -a1 -c42 -bpacked:42 which python
jsrun -E LD_LIBRARY_PATH -E PYTHONPATH -E PATH -n $(( $NUM_NODES * $RANKS_PER_NODE )) -r1 -g6 -a1 -c42 -bpacked:42 printenv
jsrun -E LD_LIBRARY_PATH -E PYTHONPATH -E PATH -n $(( $NUM_NODES * $RANKS_PER_NODE )) -r1 -g6 -a1 -c42 -bpacked:42 python -c "import scalbo; print(scalbo.__path__)"
jsrun -E LD_LIBRARY_PATH -E PYTHONPATH -E PATH -n $(( $NUM_NODES * $RANKS_PER_NODE )) -r1 -g6 -a1 -c42 -bpacked:42 python -m scalbo.benchmark.minimalistic_frnn
7 changes: 7 additions & 0 deletions install/env/summit.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
#!/bin/bash

. /etc/profile

module load gcc
module load cmake
module load open-ce/1.5.2-py38-0
46 changes: 46 additions & 0 deletions install/summit.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
#!/bin/bash

. /etc/profile

set -e

module load cmake
module load open-ce/1.5.0-py38-0
#module load open-ce

conda create -p dhenv --clone open-ce-1.5.0-py38-0 -y
#conda create -p dhenv --clone open-ce-1.5.2-py39-0 -y
conda activate dhenv/

# Clone DeepHyper (develop)
git clone -b develop https://github.com/deephyper/deephyper.git

# Clone DeepHyper/Scikit-Optimize (master)
git clone https://github.com/deephyper/scikit-optimize.git

# Clone Plasma Fork (tf2)
git clone -b tf2 https://github.com/deephyper/plasma-python.git

# Install DeepHyper
pip install -e deephyper/
pip install -e scikit-optimize/
pip install -e plasma-python/

# Install Scalable-BO
pip install -e ../src/scalbo/

# Install mpi4py
git clone https://github.com/mpi4py/mpi4py.git
cd mpi4py/

module load gcc

MPICC=mpicc python setup.py install
cd ..

# Install rdkit
####pip install rdkit-pypi

# Copy activation of environment file
cp ../install/env/summit.sh activate-dhenv.sh
echo "conda activate $PWD/dhenv/" >> activate-dhenv.sh