Frequently asked questions

Here are a few common issues that people have reported using Inspect WandB

---

ModuleNotFoundError: inspect_evals in inspect_evals

We found that sometimes the environment breaks and ModuleNotFoundError: No module named 'inspect_evals' appears. It seems that uv sync --reinstall fixes the issue.

---

Models Run Log view is illegible

Currently, output.log and the Logs tab contain illegible rich text instead of the executing command’s stdout. This is a known bug being tracked here

---

Using wandb.init as a context manager does not set the wandb project and entity

There are currently 4 ways to configure the WandB project and entity, and using:

with wandb.init(project=..., entity=...):
    inspect_ai.eval(...)

is not one of them - the integration will not detect project and entity set in this way, and will cause an error. Check out Installation and Setup for currently supported methods.