Diagnosing Policy Agent problems