jalf/DRL_PROJ
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Pipeline update to rsync at 25 epochs

Browse Source
This commit is contained in:
Johnny Fernandes
2026-04-30 16:26:25 +01:00
parent 7417267117
commit 14aed699ed
3 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+1 -1
View File
@@ -100,7 +100,7 @@ That command:
- uploads `data/` when `--upload-data` is set
- runs `python3 classifier/run.py ...`
- downloads `classifier/outputs/`
- for generator runs, rsyncs `generator/outputs/` back every 50 epochs and again at completion
- for generator runs, rsyncs `generator/outputs/` back every 25 epochs and again at completion
- destroys the instance automatically unless `--keep-on-failure` is set
Useful commands:
pipeline/README.md
+1 -1
View File
@@ -1,6 +1,6 @@
# Pipeline
Orchestrates ephemeral Vast.ai GPU instances: searches for an offer, creates the instance, syncs the project, trains, downloads `outputs/`, and destroys the instance automatically. Generator runs also rsync `generator/outputs/` every 50 epochs while training is still running.
Orchestrates ephemeral Vast.ai GPU instances: searches for an offer, creates the instance, syncs the project, trains, downloads `outputs/`, and destroys the instance automatically. Generator runs also rsync `generator/outputs/` every 25 epochs while training is still running.
## One-time setup
pipeline/orchestrator.py
+1 -1
View File
@@ -74,7 +74,7 @@ EUROPE_REGION_CODES = {
}
# How often (in epochs) to rsync generator outputs back during training
_GENERATOR_SYNC_INTERVAL = 50
_GENERATOR_SYNC_INTERVAL = 25
# Raised when the user aborts interactive offer selection