GAIA Level-1 Agent – Evaluation Runner
- Log in with your Hugging Face account.
- Run agent answers all 20 questions (takes several minutes). Answers are cached per question, so re-running only fills in what is missing.
- Submit answers sends the cached answers for scoring and updates the leaderboard.
Model is chosen with env vars: MODEL_ID (LiteLLM id + provider API key) or
HF_MODEL_ID + HF_TOKEN. See agent.py.
Questions and answers