Spaces:
Running
Running
Jae-Won Chung
commited on
Commit
•
b5a071f
1
Parent(s):
69897d5
Docker images are open now
Browse files
pegasus/README.md
CHANGED
@@ -24,9 +24,9 @@ Otherwise, you can set up Rust [here](https://www.rust-lang.org/tools/install),
|
|
24 |
Every node must have two things:
|
25 |
|
26 |
1. This repository cloned under `~/workspace/leaderboard`.
|
27 |
-
- If you want a different path, search and replace in `
|
28 |
2. Model weights under `/data/leaderboard/weights`.
|
29 |
-
- If you want a different path, search and replace in `
|
30 |
|
31 |
### Specify node names for Pegasus
|
32 |
|
@@ -37,11 +37,11 @@ Modify `hosts.yaml` with nodes. See the file for an example.
|
|
37 |
|
38 |
### Set up Docker containers on your nodes with Pegasus
|
39 |
|
40 |
-
This
|
41 |
|
42 |
```console
|
43 |
$ cd pegasus
|
44 |
-
$ cp
|
45 |
$ pegasus b
|
46 |
```
|
47 |
|
|
|
24 |
Every node must have two things:
|
25 |
|
26 |
1. This repository cloned under `~/workspace/leaderboard`.
|
27 |
+
- If you want a different path, search and replace in `spawn-containers.yaml`.
|
28 |
2. Model weights under `/data/leaderboard/weights`.
|
29 |
+
- If you want a different path, search and replace in `setupspawn-containers.yaml` and `benchmark.yaml`.
|
30 |
|
31 |
### Specify node names for Pegasus
|
32 |
|
|
|
37 |
|
38 |
### Set up Docker containers on your nodes with Pegasus
|
39 |
|
40 |
+
This spawns one container per GPU (named `leaderboard%d`), for every node.
|
41 |
|
42 |
```console
|
43 |
$ cd pegasus
|
44 |
+
$ cp spawn-containers.yaml queue.yaml
|
45 |
$ pegasus b
|
46 |
```
|
47 |
|
pegasus/{setup-nodes.yaml → spawn-containers.yaml}
RENAMED
@@ -3,5 +3,4 @@
|
|
3 |
# {{ gpu }} is defined in `hosts.yaml`, and will be filled in when Pegasus
|
4 |
# determines the specific node and gpu the generated job command will run on.
|
5 |
# We check {{ gpu }} = 0 to ensure that the image is only built once on each node.
|
6 |
-
-
|
7 |
-
- docker run -dit --name leaderboard{{ gpu }} --gpus '"device={{ gpu }}"' -v /data/leaderboard:/data/leaderboard -v $HOME/workspace/leaderboard:/workspace/leaderboard ml-energy:latest bash
|
|
|
3 |
# {{ gpu }} is defined in `hosts.yaml`, and will be filled in when Pegasus
|
4 |
# determines the specific node and gpu the generated job command will run on.
|
5 |
# We check {{ gpu }} = 0 to ensure that the image is only built once on each node.
|
6 |
+
- docker run -dit --name leaderboard{{ gpu }} --gpus '"device={{ gpu }}"' -v /data/leaderboard:/data/leaderboard -v $HOME/workspace/leaderboard:/workspace/leaderboard mlenergy/leaderboard:latest bash
|
|