Orchestra

Orchestra is an orchestration system that can coordinate the execution of jobs within a set of distributed heterogeneous compute clusters. It acts as an abstraction layer to hide the complexities of distributed clusters and provide a unified interface to interact with and monitor the service.

It is built from scratch as a GSoC project during the summer of 2021. Find out more about orchestra here

Developing

Requirements

• Python >=3.8
• Docker and Docker Compose (optional)

Create a python virtual env

Using venv

python -m venv venv     # create python environment
source ./venv/bin/activate    # activate python enviroment

Using conda

conda create -n orchestra python=3.8    # create python environment
conda activate orchestra    # activate python enviroment

Install poetry

curl -sSL https://raw.githubusercontent.com/python-poetry/poetry/master/get-poetry.py | python

Install dependencies

python3 scripts/setup_env.py

Install Pre commit hooks

This installs hooks for running python's black formatter and flake8 lint

pre-commit install

Now, refer to the README of the specific project you want to work on.

Roadmap

Check out the roadmap here