Overview
- Dedicated to defining measures and methodologies of evaluating performance of intelligent systems
- Covers a wide range of subject areas related to intelligent system
- Written by leading experts from their presentations at workshop held at the National Institute of Standards and Technology (NIST)
- Includes supplementary material: sn.pub/extras
Access this book
Tax calculation will be finalised at checkout
Other ways to access
About this book
To design and develop capable, dependable, and affordable intelligent systems, their performance must be measurable. Scienti?c methodologies for standardization and benchmarking are crucial for quantitatively evaluating the performance of eme- ing robotic and intelligent systems’ technologies. There is currently no accepted standard for quantitatively measuring the performance of these systems against user-de?ned requirements; and furthermore, there is no consensus on what obj- tive evaluation procedures need to be followed to understand the performance of these systems. The lack of reproducible and repeatable test methods has precluded researchers working towards a common goal from exchanging and communic- ing results, inter-comparing system performance, and leveraging previous work that could otherwise avoid duplication and expedite technology transfer. Currently, this lack of cohesion in the community hinders progress in many domains, such as m- ufacturing, service, healthcare, and security. By providing the research community with access to standardized tools, reference data sets, and open source libraries of solutions, researchers and consumers will be able to evaluate the cost and be- ?ts associated with intelligent systems and associated technologies. In this vein, the edited book volume addresses performance evaluation and metrics for intel- gent systems, in general, while emphasizing the need and solutions for standardized methods. To the knowledge of the editors, there is not a single book on the market that is solely dedicated to the subject of performance evaluation and benchmarking of intelligent systems.
Similar content being viewed by others
Keywords
Table of contents (13 chapters)
-
Front Matter
Reviews
From the reviews:
“This book is the result of the 2008 performance Metrics for Intelligent Systems Workshop at the National Institute of Standards and Technology (NIST). It investigates intelligent systems, starting with multiagent systems … . presents an impressive quantity of data, diagrams, proposals, experimental methods, and open topics, and also includes current solutions and relevant literature. … Intelligent systems developers and users will be able to build on this book’s material.” (G. Gini, ACM Computing Reviews, December, 2009)
Editors and Affiliations
Bibliographic Information
Book Title: Performance Evaluation and Benchmarking of Intelligent Systems
Editors: Raj Madhavan, Edward Tunstel, Elena Messina
DOI: https://doi.org/10.1007/978-1-4419-0492-8
Publisher: Springer New York, NY
eBook Packages: Computer Science, Computer Science (R0)
Copyright Information: Springer-Verlag US 2009
Hardcover ISBN: 978-1-4419-0491-1Published: 07 September 2009
Softcover ISBN: 978-1-4899-8300-8Published: 28 November 2014
eBook ISBN: 978-1-4419-0492-8Published: 18 September 2009
Edition Number: 1
Number of Pages: XIX, 338
Topics: System Performance and Evaluation, Control, Robotics, Mechatronics, Artificial Intelligence, Mathematical and Computational Engineering