Abstract

This document describes methods for evaluating research and development progress in automated planning. It is meant as a resource for the members of the research community participating in the planning initiative. The document attempts to explain the goals of evaluation and provide concrete examples of evaluation methods that are currently being used. It also serves as a source of ideas for designing new methods for evaluation and improving old ones.
The planning initiative is driven by a complex set of goals involving government o cials, members of the scienti c community, and users in the military and industry. Evaluation methods allow those involved in the planning initiative to measure progress toward these goals. This document is not meant to de ne once and for all what these goals should be, but, rather, to provide a basis for ongoing discussion to shape those goals and adapt them to circumstances.

Date

1994

Authors

Paul Cohen, Tom Dean, Yolanda Gil, Matt Ginsberg, Lou Hoebel

Journal

Proc. Workshop ARPA/Rome Laboratory Knowledge-Based Planning and Scheduling Initiative