| Description |
1 online resource (xvi, 189 pages) : illustrations (chiefly color) |
| Series |
Lecture notes in computer science ; 14521 |
|
Lecture notes in computer science ; 14521.
|
| Contents |
Intro -- Preface -- Organization -- Invited Talks -- BenchCouncil Achievement Award Lecture: Essentially, All Models Are Wrong, but Some Are Useful -- Designing High-Performance and Scalable Middleware and Benchmarks for HPC, AI, and Data Sciences -- Contents -- ICBench: Benchmarking Knowledge Mastery in Introductory Computer Science Education -- 1 Introduction -- 2 Overview -- 2.1 The RPCC Model for Knowledge Points -- 2.2 Metrics -- 2.3 The Process of the Knuth Test -- 3 Methodology -- 3.1 Encoding Questions -- 3.2 Constructing Seed Question Set -- 3.3 Personalizing Question Set |
|
4 Implementation -- 5 Evaluation -- 5.1 Student Performance -- 5.2 System Overhead -- 6 Related Work -- 6.1 The Personalization of Question Set -- 6.2 The Coverage of Question Set -- 7 Conclusion -- References -- Generating High Dimensional Test Data for Topological Data Analysis -- 1 Introduction -- 2 Background -- 3 Related Work -- 4 Overview of the Approach -- 4.1 HMC Sampling of Algebraic Varieties -- 4.2 Sensitivity of HMC Parameters -- 4.3 Combine, Rotate, and Embed Constructions -- 5 Ground Truth Validation -- 6 Examples of Data Generation -- 6.1 Data Generation in R2 and R3 |
|
6.2 Data Generation in Rn for n>3 -- 7 Limitations and Challenges -- 8 Conclusions -- References -- Does AI for Science Need Another ImageNet or Totally Different Benchmarks? A Case Study of Machine Learning Force Fields -- 1 Introduction -- 2 Preliminaries -- 3 Related Works -- 4 Benchmarking MLFF -- 4.1 Sample Efficiency -- 4.2 Time-Series Extrapolation -- 4.3 Cross-Molecule Generalization Benchmarks -- 5 Conclusion -- References -- MolBench: A Benchmark of AI Models for Molecular Property Prediction -- 1 Introduction -- 2 Related Work -- 3 Methodology -- 3.1 Datasets -- 3.2 Models |
|
3.3 Metrics -- 4 Experiments -- 4.1 Results -- 4.2 Stability -- 4.3 Task Coverage -- 4.4 API -- 5 Concluding Remarks -- References -- Cross-Layer Profiling of IoTBench -- 1 Introduction -- 2 Background and Related Work -- 2.1 IoT Benchmarks -- 2.2 Workload Characterizations -- 3 Evaluation Methodology -- 3.1 Methodology -- 3.2 Metric -- 3.3 Tool -- 4 Experiment and Result -- 4.1 Experiment on ARM Platform -- 4.2 Comparative Experiment of ARM and X86 -- 4.3 Experiment Summary -- 5 Conclusions -- References -- MMDBench: A Benchmark for Hybrid Query in Multimodal Database -- 1 Introduction |
|
2 Related Work -- 2.1 Single Model Benchmark Programs -- 2.2 Multi-model Benchmark Programs -- 3 Data Modalities -- 4 Data Generator -- 4.1 Constructing Data -- 4.2 Scaling Data from Different Modalities -- 5 Workload -- 5.1 Framework of Benchmark Program -- 5.2 Multimodal Data Schema in Social Network -- 5.3 Hybrid Query in Social Network -- 6 Evaluation -- 6.1 Polyglot Persistence System for Evaluation -- 6.2 Data Generation -- 6.3 Baseline Evaluation -- 6.4 Latency of Polyglot Persistence -- 6.5 Scaling Data Evaluation -- 6.6 Summary of Evaluation -- 7 Conclusion -- References |
| Summary |
This book constitutes the refereed proceedings of the 14th BenchCouncil International Symposium on Benchmarking, Measuring, and Optimizing, Bench 2023, held in Sanya, China, during December 35, 2023. The 11 full papers included in this book were carefully reviewed and selected from 20 submissions. The Bench symposium invites papers that exhibit three defining characteristics: (1) It provides a high-quality, single-track forum for presenting results and discussing ideas that further the knowledge and understanding of the benchmark community; (2) It is a multi-disciplinary conference, attracting researchers and practitioners from different communities, including architecture, systems, algorithms, and applications; (3) The program features both invited and contributed talks |
| Notes |
International conference proceedings |
|
Includes author index |
|
Online resource; title from PDF title page (SpringerLink, viewed February 27, 2024) |
| Subject |
Electronic data processing -- Congresses
|
|
Information storage and retrieval systems -- Congresses
|
| Genre/Form |
Electronic books
|
|
proceedings (reports)
|
|
Conference papers and proceedings.
|
|
Actes de congrès.
|
| Form |
Electronic book
|
| Author |
Hunold, Sascha, editor.
|
|
Xie, Biwei, editor
|
|
Shu, Kai, editor
|
| ISBN |
9789819703166 |
|
9819703166 |
|
