PerMIS'02
Performance Metrics for Intelligent Systems
August 13 - 15, 2002
Gaithersburg, MD
Workshop Announcement And Call for Papers
http://www.isd.mel.nist.gov/PerMIS_2002.html
Co-Sponsored by
The National Institute of Standards and Technology
Defense Advanced Research Projects Administration
Institute of Electrical and Electronics Engineers Controls Society
National Aeronautics & Space Administration
In Cooperation with
The IEEE Neural Network Council
Workshop Organizers
Elena Messina, NIST
Alex Meystel, Drexel University and NIST
Larry Reeker, NIST
Submission Information
Prospective authors are requested to either send a draft paper
(maximum 8 pages) or an extended abstract for review. All submissions
must be written in English, starting with a succinct statement of the
problem, the results achieved, their significance and a comparison
with previous work. Position papers are welcomed as well.
Electronic submissions (ps, pdf, Word) are strongly preferred.
Please submit to:
Gwendolyn White
gwendolyn.white@nist.gov
Phone: (301) 975-3235
Important Dates
[May 1, 2002: Submissions due] Extended to May 15
June 7, 2002: Notification of acceptance
July 12, 2002: Final papers due
August 13-15, 2002: Workshop
As expectations for intelligent systems continue to grow,
the need for quantitative evaluation of system performance
becomes more critical. This third workshop in a series
will bring together leading researchers to address methods
for measuring the abilities of intelligent systems.
We wish to discuss ideas for quantitative engineering
approaches to measuring intelligence. Performance tests
and competitions are in this class. These measure the
overall system performance in structured situations.
There are mathematical approaches to quantifying the
abilities of a system, be it through complexity measures,
entropy computations, or other calculations of either
internal factors or external manifestations.
Many issues remain. Must performance tests be domain
specific? How can tests be propagated throughout the
community? Is it reasonable to expect that researchers
publish their results? Can systems with fundamentally
different designs be compared? Who determines what the
criteria for evaluation, or "success" are?
Among the topic areas to be considered for this workshop are:
ž Adaptive and Learning Systems
ž Unmanned Autonomous Systems
ž Knowledge Intensive Subsystems
ž Cognitive and Neural Modelling
ž Large Systems with Human-Computer Interaction for Decision Making
ž Evolutionary Computations and Activities
ž Hierarchical and Distributed Controllers with Elements of Autonomy
ž Image Processing, Classification and Interpretation
ž Cooperating Autonomous Robots
ž Multi Agent Systems
ž Optimization, Heuristics and Search Methods
ž Pattern Recognition and Classification
ž Behavior based Control
ž Self-organizing Systems
ž Measuring Systems for Integration Purposes
ž Heuristic Interpretation of test results
ž Automated Interpretation of test results
ž Modeling of Neuro-biological Autonomic Systems
ž Mapping Design Specifications into Performance of
Intelligent Systems
ž Understanding Incomplete and Ambiguous Assignments
ž Interpreting and Performing the Assignment Under Conditions of
Reduced Technological Capabilities
ž How Performance Depends on Knowledge Representation
ž Multiresolutional Ontology of Performance
ž Linkage Between Multiple Sensor Modalities and Performance
in Intelligent Systems
ž Can Natural Language Communication with an Intelligent System
Affect Performance?
ž Testing and Improving Performance by Playing Games
ž Development of SELF in Intelligent Systems
Advisory Board
ž G. Adorni, University of Parma, Italy
ž J. Albus, NIST, USA
ž P. Antsaklis, University of Notre Dame, USA
ž M. Asada, Osaka University, Japan
ž G. A. Bekey, University of Southern California, USA
ž K. Bellman, Aerospace Integration Science Corp., USA
ž J. G. Blitch, SAIC, USA
ž P. Borne, Ecole Centrale de Lille, France
ž H.-H. Bothe, Technical University of Denmark, Denmark
ž B. Chandrasekaran, Ohio State University, USA
ž J. Cherniavsky, NSF, USA
ž M. Cotsaftis, LTME/ECE, France
ž R. Cottam, ETRO VUB, Belgium
ž F. Darema, NSF, USA
ž P. Dario, Scuola Superiore, Italy
ž P. Davis, RAND Graduate School., USA
ž J. Fetzer, University of Minnesota, USA
ž D. Filev, Ford, USA
ž R. Finkelstein, Robotic Technology, Inc., USA
ž D. Fogel, Natural Selection, Inc., USA
ž N. Foo, University of New South Wales, Australia
ž W. Freeman, University of California at Berkeley, USA
ž E. Fromm, Drexel University, USA
ž T. Fukuda, University of Nagoya, Japan
ž D. Gage, DARPA, USA
ž R. Garner, Loebner Prize Winner for 1998 and 1999, USA
ž G. Gerhart, US Army TACOM, USA
ž E. Grant, CRIM, North Carolina State University, USA
ž S. Grossberg, Boston University, USA
ž R. Gudwin, State Univerity of Campinas, Brazil
ž W. Hamel, University of Tennessee, USA
ž W. Hargrove, Oak Ridge National Laboratory, USA
ž M. Herman, NIST, USA
ž E. Horvitz, Microsoft Research, USA
ž M. Jabri, University of Sydney, Australia
ž D. Jaron, Drexel University, USA
ž A. Jones, NIST, USA
ž R. Jordan, Lockheed Martin, USA
ž C. Joslyn, Los Alamos National Laboratory, USA
ž S. Kak, Louisiana State University, USA
ž O. Kaynak, Bogazici University, Istanbul, Turkey
ž H. Kitano, Sony Computer Science Labs, Japan
ž K. Kreutz-Delgado, University of California at San Diego
ž F. Kurfess, California Polytechnic State University
ž J. E. Laird, University of Michigan, USA
ž C. Landauer, Aerospace Integration Science Corp., USA
ž S. Lee, Samsung Advanced Inst. of Technology, Korea
ž C. S. George Lee, Purdue University, USA
ž P. B. Luh, University of Connecticut, USA
ž B. Mirkin, Birkbeck College, GB
ž U. Ozguner, Ohio State University, USA
ž T. Parisini, Politecnico di Milano, Italy
ž K. Passino, Ohio State University, USA
ž L. Perlovsky, AFRL/SNHE, USA
ž L. Pouchard, Oak Ridge National Lab, USA
ž J. Pustejovsky, Brandeis University, USA
ž D. Repperger, AFRL/HECP, USA
ž E. H. Ruspini, SRI International, USA
ž T. Samad, Honeywell, USA
ž A. Sanderson, RPI, USA
ž R. Sanz, University of Madrid, Spain
ž G. Saridis, RPI, USA
ž A. Schultz, Naval Research Laboratory, USA
ž T. Shih, Tamkang University, Taiwan
ž R. Simmons, Carnegie Mellon, USA
ž M. Swinson, Sandia National Lab, USA
ž H. Szu, ONR Navy, USA
ž M. Tilden, Los Alamos National Lab., USA
ž S. Tzafestas, National Techical University of Athens, Greece
ž L. Tsoukalas, Purdue Universtity, USA
ž I. B. Turksen, University of Toronto, Canada
ž C. Weisbin, NASA, USA
ž T. Whalen, Georgia State University, USA
ž A. Wild, Motorola, USA
ž V. Winter, University of Omaha, USA
ž R. Yager, Iona College, USA
ž A. Yavnai, RAFAEL, Israel
ž Y. Ye, IBM T. J. Watson Research Center, USA
ž B. Zeigler, University of Arizona, USA
ž L. Zadeh, University of California at Berkeley, USA
WORKSHOP LOCATION
The workshop will be held at the National Institute of Standards
and Technology, in Gaithersburg, Md, approximately 20 miles from
Washington, D.C.
For Registration and other information, see our web page
http://www.isd.mel.nist.gov/PerMIS_2002.html
This archive was generated by hypermail 2b29 : Wed May 22 2002 - 09:48:49 PDT