AgentEval (AutoGen) Sample Implementation

This is a sample implementation of the AgentEval framework using AutoGen 0.4 version. It is a simple implementation that demonstrates how to use the framework to evaluate by Agent for Summarization task.

This implementation is based on the [Roadmap]: Integrating AgentEval

Sample Implementation

• AgentEval Experiment Notebook
• AgentEval Sample Library
  • Model Criteria
  • Model Quantification
  • Agent CriticAgent
  • Agent SubCriticAgent
  • Agent QuantifierAgent
  • Agent CriticSummarizerAgent
  • Class Verify (compute coefficient of variation)
  • Orchestrator agent_eval