Principles, practice and pragmatics of measurement in experimental computer science
We aim to develop and empirically demonstrate principles and processes for measuring the outcomes of Computer Science experiments. Measurement is well-understood in the traditional physical sciences, and our work is intended to extend that strong foundation and robustness to the computational sciences. In particular, we aim to examine and critique current methodologies for measuring outcomes in a number of research-based computational tasks, and to develop improved systems of measurement that should be used when accurate knowledge of the performance of computational methods is of critical importance, for example, when those methods will be embedded in widely-used or mission critical software tools.
Leader: Justin Zobel
Staff: Alistair Moffat, Timothy Baldwin, Yvette Graham
Sponsors: Australian Research Council
Computing and Information Systems
Networks and data in society