Class LocalEvalService

Hierarchy

BaseEvalService
- LocalEvalService

Index

Constructors

Methods

evaluateSession performInference evaluate

Constructors

constructor

new LocalEvalService(agent, parallelism?): LocalEvalService
Parameters
- agent: BaseAgent
- parallelism: number = 4
Returns LocalEvalService
Overrides BaseEvalService.constructor
- Defined in packages/adk/src/evaluation/local-eval-service.ts:14

Methods

evaluateSession

evaluateSession(session): AsyncGenerator<EvalSetResult, void, any>
Parameters
- session: {
      evalSetId: string;
      evalCases: EvalSet[];
      evaluateConfig: EvaluateConfig;
  }
  - evalSetId: string
  - evalCases: EvalSet[]
  - evaluateConfig: EvaluateConfig
Returns AsyncGenerator<EvalSetResult, void, any>
Inherited from BaseEvalService.evaluateSession
- Defined in packages/adk/src/evaluation/base-eval-service.ts:16

performInference

performInference(request): AsyncGenerator<Invocation[], void, any>
Parameters
- request: {
  evalSetId: string;
  evalCases: EvalSet[];
  }
  - evalSetId: string
  - evalCases: EvalSet[]
Returns AsyncGenerator<Invocation[], void, any>
Overrides BaseEvalService.performInference
- Defined in packages/adk/src/evaluation/local-eval-service.ts:51

evaluate

evaluate(request): AsyncGenerator<EvalResult, void, any>
Parameters
- request: {
  inferenceResults: Invocation[][];
  evaluateConfig: EvaluateConfig;
  }
  - inferenceResults: Invocation[][]
  - evaluateConfig: EvaluateConfig
Returns AsyncGenerator<EvalResult, void, any>
Overrides BaseEvalService.evaluate
- Defined in packages/adk/src/evaluation/local-eval-service.ts:76