Files
TIR_PROJ/tools/webots_sweep_gt.sh
T
Johnny Fernandes d00da52c3c Portable Python env + 360° LiDAR ablation flag
Two small features.

(1) Portable interpreter
* `tools/setup_env.sh` exports HERDING_PYTHON (default points to the
  project's conda env; override in your shell to retarget).
* Both `controllers/*/runtime.ini` files now use Webots' env-var
  expansion: `COMMAND = $(HERDING_PYTHON)` so the Webots-launched
  controllers pick up the same interpreter as the bash scripts.
* `tools/run_webots.sh`, `tools/webots_sweep{,_gt}.sh` and
  `tools/calibrate_mecanum.sh` all source `setup_env.sh` at the top
  instead of hard-coding `/home/jalf/miniconda3/envs/tir/bin`.
The hard-coded conda path is now exactly one line in `setup_env.sh`'s
fallback default — a single place to edit on a new machine, or
override-once via `export HERDING_PYTHON=...`.

(2) 360° LiDAR FOV ablation
* New `LIDAR_WEBOTS_360` preset matches the existing
  `protos/ShepherdDog360.proto` (360 rays / 2π FOV / 15 m range).
* `tools/run_webots.sh` reads `HERDING_LIDAR=140|360` and swaps the
  diff-drive proto accordingly (mecanum keeps 140° — the
  ShepherdDogMecanum proto has its own LiDAR section). The variant
  is written into `herding_runtime.cfg` so the controller can read
  it even when Webots strips env vars.
* `controllers/shepherd_dog/shepherd_dog.py` picks the matching
  `lidar_cfg` (`HERDING_WEBOTS.lidar` for 140°, `LIDAR_WEBOTS_360`
  otherwise) and feeds it to `detections_from_scan` so the
  perception pipeline interprets ray angles + max range correctly.

Smoke test: `HERDING_LIDAR=360 tools/run_webots.sh 5 strombom
differential field` launches with `ShepherdDog360.proto`, the
controller logs the new mode/drive/world line, and the dog is
penning sheep through 360° perception (4/5 at step 19200 before I
killed the test). No retraining required because the gym already
trains under `LIDAR_FULL` (360° preset).

126 pytest cases still pass.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-17 02:19:15 +00:00

102 lines
3.6 KiB
Bash
Executable File

#!/usr/bin/env bash
# Headless Webots sweep across modes, drives, worlds, and flock sizes.
# Runs sequentially; each trial gets a hard 150s wall-clock timeout.
# Results are written to webots_sweep.log (tab-separated) and printed.
#
# Usage: bash tools/webots_sweep.sh [output_log]
set -euo pipefail
ROOT="$( cd "$( dirname "${BASH_SOURCE[0]}" )/.." && pwd )"
OUT="${1:-$ROOT/webots_sweep.log}"
TIMEOUT_S=120 # ~80k steps in fast headless mode — covers slow-converging physics
# Source the project python path. Edit tools/setup_env.sh or override
# HERDING_PYTHON in your shell to point at a Python with SB3+PyTorch.
source "$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )/setup_env.sh"
# Columns: mode drive world n_sheep success steps
printf "%-12s %-14s %-12s %7s %7s %s\n" \
"mode" "drive" "world" "n_sheep" "success" "steps" | tee "$OUT"
printf '%s\n' "$(printf '%-12s %-14s %-12s %7s %7s %s' \
'----' '-----' '-----' '-------' '-------' '-----')" | tee -a "$OUT"
run_trial() {
local mode="$1" drive="$2" world="$3" n="$4" policy_dir="${5:-}"
local done_file="$ROOT/training/.run_done"
rm -f "$done_file"
local extra_env=()
extra_env+=(WEBOTS_HEADLESS=1)
extra_env+=(WEBOTS_EXTRA_ARGS="--stdout --stderr")
extra_env+=(HERDING_USE_GT=1)
if [[ -n "$policy_dir" ]]; then
extra_env+=(HERDING_POLICY_DIR="$ROOT/$policy_dir")
fi
local raw
raw=$(
timeout --kill-after=15s "$TIMEOUT_S" \
xvfb-run -a \
env "${extra_env[@]}" \
bash "$ROOT/tools/run_webots.sh" "$n" "$mode" "$drive" "$world" \
2>&1
) || true
# Webots-bin and Xvfb can survive the timeout; kill any orphans now.
pkill -9 -f "webots-bin|Xvfb" 2>/dev/null || true
sleep 1
local success="FAIL"
local steps="timeout"
if echo "$raw" | grep -q "\[dog\] all .* sheep penned at step"; then
success="OK"
steps=$(echo "$raw" | grep "\[dog\] all .* sheep penned at step" \
| grep -oP 'step \K[0-9]+')
fi
printf "%-12s %-14s %-12s %7s %7s %s\n" \
"$mode" "$drive" "$world" "$n" "$success" "$steps" | tee -a "$OUT"
}
# ---------------------------------------------------------------------------
# Analytic baselines (differential only — that's the story context)
# strombom / sequential: canonical baselines
# universal: the actual teacher used to collect BC demos
# ---------------------------------------------------------------------------
for mode in strombom sequential universal; do
for world in field field_round; do
for n in 5 10; do
run_trial "$mode" differential "$world" "$n"
done
done
done
# ---------------------------------------------------------------------------
# BC — world-specific policies
# ---------------------------------------------------------------------------
for drive in differential mecanum; do
for world in field field_round; do
for n in 5 10; do
run_trial bc "$drive" "$world" "$n" \
"training/runs/bc_${drive}_${world}"
done
done
done
# ---------------------------------------------------------------------------
# RL_FAST — MODE=rl with explicit HERDING_POLICY_DIR pointing to rl_fast dirs
# (run_webots.sh rejects "rl_fast" as a mode; "rl" + policy override is correct)
# ---------------------------------------------------------------------------
for drive in differential mecanum; do
for world in field field_round; do
for n in 5 10; do
run_trial rl "$drive" "$world" "$n" \
"training/runs/rl_fast_${drive}_${world}"
done
done
done
echo ""
echo "Sweep complete. Results saved to: $OUT"