The browser you are using is not supported by this website. All versions of Internet Explorer are no longer supported, either by us or Microsoft (read more here: https://www.microsoft.com/en-us/microsoft-365/windows/end-of-ie-support).

Please use a modern browser to fully experience our website, such as the newest versions of Edge, Chrome, Firefox or Safari etc.

DoKnowMe: Towards a Domain Knowledgedriven Methodology for Performance Evaluation

På svenska

Author

Summary, in English

Software engineering considers performance evaluation to be one of the key portions of software quality assurance. Unfortunately, there seems to be a lack of standard methodologies for performance evaluation even in the scope of experimental computer science. Inspired by the concept of “instantiation” in object-oriented programming, we distinguish the generic performance evaluation logic from the distributed and ad-hoc relevant studies, and develop an abstract evaluation methodology (by analogy of “class”) we name Domain Knowledge-driven Methodology (DoKnowMe). By replacing five predefined domain-specific knowledge artefacts, DoKnowMe can be instantiated into specific methodologies (by analogy of “object”) to guide evaluators in performance evaluation of different software and even computing systems. We also propose a generic validation framework with four indicators (i.e. usefulness, feasibility, effectiveness and repeatability), and use it to validate DoKnowMe in the Cloud services evaluation domain. Given the positive and promising validation result, we plan to integrate more common evaluation strategies to improve DoKnowMe and further focus on the performance evaluation of Cloud autoscaler systems.

Publishing year

2016-03

Language

English

Pages

23-32

Publication/Series

SIGMETRICS Performance Evaluation Review

Volume

43

Issue

4

Document type

Journal article

Publisher

Association for Computing Machinery (ACM)

Topic

  • Electrical Engineering, Electronic Engineering, Information Engineering

Status

Published

Project

  • EIT_VR CLOUD Cloud Control
  • LCCC

ISBN/ISSN/Other

  • ISSN: 0163-5999