EvaluatorBase#
- class council.evaluators.EvaluatorBase[source]#
Bases:
Monitorable
,ABC
Abstract base class for an agent evaluator.
- execute(context: AgentContext) List[ScoredChatMessage] [source]#
Executes the evaluator on the agent’s context within the given budget.
- Parameters:
context (AgentContext) – The context for executing the evaluator.
- Returns:
A list of scored agent messages resulting from the evaluation.
- Return type:
List[ScoredChatMessage]
- Raises:
None –
- render_as_dict(include_children: bool = True) Dict[str, Any] #
returns the graph of operation as a dictionary
- render_as_json() str #
returns the graph of operation as a JSON string