Original Article

Information Visualization (2009) 8, 230–238. doi:10.1057/ivs.2009.16

Advancing user-centered evaluation of visual analytic environments through contests

Loura Costelloa, Georges Grinsteina, Catherine Plaisantb and Jean Scholtzc

  1. aUniversity of Massachusetts Lowell, Lowell, MA 01854, USA
  2. bUniversity of Maryland Institute for Advanced Computer Studies, College Park, MD 20742, USA
  3. cPacific Northwest National Laboratory, P.O. Box 999, MSIN K7-22, Richland, WA 99352, USA

Correspondence: Loura Costello, E-mail: loura.costello@gmail.com; Georges Grinstein, E-mail: grinstein@cs.uml.edu; Catherine Plaisant, E-mail: plaisant@cs.umd.edu; Jean Scholtz, E-mail: jean.scholtz@pnl.gov

Received 19 March 2009; Revised 28 April 2009; Accepted 4 May 2009.

Top

Abstract

In this paper, the authors describe the Visual Analytics Science and Technology (VAST) Symposium contests run in 2006 and 2007 and the VAST 2008 and 2009 challenges. These contests were designed to provide researchers with a better understanding of the tasks and data that face potential end users. Access to these end users is limited because of time constraints and the classified nature of the tasks and data. In that respect, the contests serve as an intermediary, with the metrics and feedback serving as measures of utility to the end users. The authors summarize the lessons learned and the future directions for VAST Challenges.

Keywords:

user-centered evaluation, synthetic data, metrics, visual analytics

MORE ARTICLES LIKE THIS

These links to content published by Palgrave Macmillan are automatically generated.

Extra navigation

.
ADVERTISEMENT
Interactive Visualization and Data Analysis, Masters program at Danube University Krems, Austria