InferenceΒΆ
HTTP client for deployed Arena inference endpoints. Deployment metadata is
fetched on construction (unless probe_on_init=False) and exposed as
metadata (StatusResponse).
Use get_action() (RL),
predict() (supervised), or
generate() /
generate_stream() (LLM). Errors raise
ArenaInferenceError.
RL and supervised requests use base64 .npy serialization via
agilerl.arena.inference.serde. LLM requests use plain JSON with
LLMParams.
CLI: arena agent run <deployment> then arena agent generate --prompt '...'
(uses generate_stream; pass a deployment name to generate to override).