|
Title:
|
SPECIFYING AND VALIDATING THE AGENT PERFORMANCE EVALUATION METHODOLOGY: THE SYMBIOSIS USE CASE |
|
Author(s):
|
Christos Dimou , Fani A. Tzima , Andreas L. Symeonidis , Pericles. A. Mitkas |
|
ISBN:
|
978-972-8924-87-4 |
|
Editors:
|
António Palma dos Reis |
|
Year:
|
2009 |
|
Edition:
|
Single |
|
Keywords:
|
Evaluation methodology, agent performance, formal specification, metrics representation, Z notation |
|
Type:
|
Full Paper |
|
First Page:
|
125 |
|
Last Page:
|
132 |
|
Language:
|
English |
|
Cover:
|
|
|
Full Contents:
|
click to dowload 
|
|
Paper Abstract:
|
Despite the plethora of frameworks and tools for developing agent systems, there is a remarkable lack of generalized
methodologies for assessing their performance, while adequately addressing the unpredictable and complex nature of
intelligent agents. In this paper, we present a generic methodology for evaluating agent performance, the Agent
Performance Evaluation (APE) methodology that consists of representation tools, guidelines and techniques for
organizing and using metrics, measurements and aggregated characterizations of performance. The main element of APE
is the Metrics Representation Tree, a generic structure that enables efficient manipulation of evaluation-specific
information. A formal specification of the proposed methodology is provided and its applicability is demonstrated
through Symbiosis, an existing multi-agent system to be used as a testbed. |
|
|
|
|
|
|
