New lightning bench (#236)

* New lightning bench

* Add voir instrumentation

* make lightning work

* Add ForeachNode && TorchrunAllNodes

* Diffusion benchmark

* Update pins

* Improve run option logic so it is easier to set and configure after run plan instanciation

* Add prepare script

* Remove stable_baselinecompiled requirements as they are outdated

* new diffusion

* Add diffusion prepare

* Add diffusion to config

* Pin

* prevent pynvml from raising exceptions to milabench

* Add tooll to display environment variables

* Install TIMM explicitly

* Fix TIMM benchmarks

* Update opt to use stdout

* update unit tests

* update examples

---------

Co-authored-by: pierre.delaunay <[email protected]>

.github/workflows/docs.yml

@@ -11,7 +11,7 @@ jobs:
     steps:
     - uses: actions/setup-python@v2
       with:
-        python-version: 3.11
+        python-version: 3.10
 
     - uses: actions/checkout@master
       with:

.github/workflows/tests_integration.yml

@@ -47,7 +47,7 @@ jobs:
     steps:
       - uses: actions/setup-python@v4
         with:
-          python-version: '3.11'
+          python-version: '3.10'
 
       - name: Check out repository code
         uses: actions/checkout@v3

.github/workflows/tests_run.yml

@@ -55,7 +55,7 @@ jobs:
       - uses: conda-incubator/setup-miniconda@v2
         with:
           auto-activate-base: false
-          python-version: 3.11
+          python-version: "3.10"
           miniconda-version: "latest"
           activate-environment: test
 

.github/workflows/tests_unit.yml

@@ -31,13 +31,13 @@ jobs:
 
       - uses: actions/setup-python@v5
         with:
-          python-version: '3.11'
+          python-version: '3.10'
 
       - name: dependencies
         run: |
           pip install -U pip
           pip install poetry
-          poetry env use python3.11
+          poetry env use python3.10
           source $(poetry env info -p)/bin/activate
           #
           # poetry doesnot work when installing those !?

.gitignore

@@ -52,3 +52,6 @@ base/
 
 benchmarks/simple
 benchmarks/voir
+benchmarks/*/base/
+benchmarks/lightning/lightning_logs/
+