Skip to main content

Interface: EvalConfig

Properties

afterAll

Optional afterAll: () => Promise<void>

Type declaration

▸ (): Promise<void>

Function that runs after all actions in the eval command. Can use for things like cleaning up resources besides the stores. The stores are cleaned up automatically.

Returns

Promise<void>

Defined in

packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:40


commands

commands: Object

Type declaration

NameType
evaluate?{ [k: string]: { evaluator: EvaluateQualityFunc }; }
generate?{ [k: string]: { generator: GenerateDataFunc ; testCases: SomeTestCase[] ; type: string }; }
report?{ [k: string]: { reporter: ReportEvalFunc }; }

Defined in

packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:15


evaluationStore

evaluationStore: EvaluationStore

Defined in

packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:13


generatedDataStore

generatedDataStore: GeneratedDataStore

Defined in

packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:12


metadataStore

metadataStore: CommandMetadataStore

Defined in

packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:11


reportStore

reportStore: ReportStore

Defined in

packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:14