EvaluatorBase#

class council.evaluators.EvaluatorBase[source]#

Bases: Monitorable, ABC

Abstract base class for an agent evaluator.

execute(context: AgentContext) List[ScoredChatMessage][source]#

Executes the evaluator on the agent’s context within the given budget.

Parameters:

context (AgentContext) – The context for executing the evaluator.

Returns:

A list of scored agent messages resulting from the evaluation.

Return type:

List[ScoredChatMessage]

Raises:

None

render_as_dict(include_children: bool = True) Dict[str, Any]#

returns the graph of operation as a dictionary

render_as_json() str#

returns the graph of operation as a JSON string