Interface: EvalConfig
Properties
afterAll
• Optional afterAll: () => Promise<void>
Type declaration
▸ (): Promise<void>
Function that runs after all actions in the eval command. Can use for things like cleaning up resources besides the stores. The stores are cleaned up automatically.
Returns
Promise<void>
Defined in
packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:40
commands
• commands: Object
Type declaration
| Name | Type |
|---|---|
evaluate? | { [k: string]: { evaluator: EvaluateQualityFunc }; } |
generate? | { [k: string]: { generator: GenerateDataFunc ; testCases: SomeTestCase[] ; type: string }; } |
report? | { [k: string]: { reporter: ReportEvalFunc }; } |
Defined in
packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:15
evaluationStore
• evaluationStore: EvaluationStore
Defined in
packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:13
generatedDataStore
• generatedDataStore: GeneratedDataStore
Defined in
packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:12
metadataStore
• metadataStore: CommandMetadataStore
Defined in
packages/mongodb-chatbot-evaluation/src/EvalConfig.ts:11
reportStore
• reportStore: ReportStore