Fundamental concepts and methodologies in evaluatology

While I have authored three articles introducing Evaluatology, a novel discipline that encompasses the science and engineering of evaluation across various domains, I have struggled to fully depict this challenging yet promising field.This article delves into the fundamental concepts and methodologi...

Full description

Saved in:
Bibliographic Details
Main Author: Jianfeng Zhan
Format: Article
Language:English
Published: KeAi Communications Co. Ltd. 2024-09-01
Series:BenchCouncil Transactions on Benchmarks, Standards and Evaluations
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2772485925000018
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1825199294105255936
author Jianfeng Zhan
author_facet Jianfeng Zhan
author_sort Jianfeng Zhan
collection DOAJ
description While I have authored three articles introducing Evaluatology, a novel discipline that encompasses the science and engineering of evaluation across various domains, I have struggled to fully depict this challenging yet promising field.This article delves into the fundamental concepts and methodologies within Evaluatology. I aim to provide a complete picture of evaluation problems in Evaluatology based on my proposed fundamental methodology of understanding a thing. In diverse engineering fields, testbeds, experimental platforms, or simulation environments are commonly utilized to evaluate design or implementation decisions. However, a rigorous methodology is often lacking. I propose a rigorous methodology rooted in Evaluatology for testbeds, experimental platforms, or simulation environments.
format Article
id doaj-art-d8e6d2d6e6a248acb606efbf6acd419c
institution Kabale University
issn 2772-4859
language English
publishDate 2024-09-01
publisher KeAi Communications Co. Ltd.
record_format Article
series BenchCouncil Transactions on Benchmarks, Standards and Evaluations
spelling doaj-art-d8e6d2d6e6a248acb606efbf6acd419c2025-02-08T05:01:39ZengKeAi Communications Co. Ltd.BenchCouncil Transactions on Benchmarks, Standards and Evaluations2772-48592024-09-0143100188Fundamental concepts and methodologies in evaluatologyJianfeng Zhan0Correspondence to: The International Open Benchmark Council, DE, USA.; The International Open Benchmark Council, DE, USA; Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, ChinaWhile I have authored three articles introducing Evaluatology, a novel discipline that encompasses the science and engineering of evaluation across various domains, I have struggled to fully depict this challenging yet promising field.This article delves into the fundamental concepts and methodologies within Evaluatology. I aim to provide a complete picture of evaluation problems in Evaluatology based on my proposed fundamental methodology of understanding a thing. In diverse engineering fields, testbeds, experimental platforms, or simulation environments are commonly utilized to evaluate design or implementation decisions. However, a rigorous methodology is often lacking. I propose a rigorous methodology rooted in Evaluatology for testbeds, experimental platforms, or simulation environments.http://www.sciencedirect.com/science/article/pii/S2772485925000018EvaluatologyFundamental conceptsFundamental methodologyTestbedExperimental platformSimulation environment
spellingShingle Jianfeng Zhan
Fundamental concepts and methodologies in evaluatology
BenchCouncil Transactions on Benchmarks, Standards and Evaluations
Evaluatology
Fundamental concepts
Fundamental methodology
Testbed
Experimental platform
Simulation environment
title Fundamental concepts and methodologies in evaluatology
title_full Fundamental concepts and methodologies in evaluatology
title_fullStr Fundamental concepts and methodologies in evaluatology
title_full_unstemmed Fundamental concepts and methodologies in evaluatology
title_short Fundamental concepts and methodologies in evaluatology
title_sort fundamental concepts and methodologies in evaluatology
topic Evaluatology
Fundamental concepts
Fundamental methodology
Testbed
Experimental platform
Simulation environment
url http://www.sciencedirect.com/science/article/pii/S2772485925000018
work_keys_str_mv AT jianfengzhan fundamentalconceptsandmethodologiesinevaluatology