Performance Evaluation and Benchmarking

This book constitutes the refereed post-conference proceedings from the 15th TPC Technology Conference on Performance Evaluation and Benchmarking, TPCTC 2023, held in Vancouver, British Columbia, Canada, during August 28 September 1, 2023.

The 9 full papers included in this book were carefully reviewed and selected from 17 submissions. These papers focus on various novel ideas and methodologies for Performance evaluation and Benchmarking in emerging technology areas.

Inhalt

.- Multivariate Time Series Anomaly Detection: Fancy Algorithms amd Flawed Evaluation Methology.
.- A Comprehensive Study on Benchmarking Permissioned Blockchains.
.- Benchmarking Generative AI Performance Requires a Holistic Approach.
.- Graph Stores with Application-Level Query Result Caches.
.- Chaosity: Understanding Contemporary NUMA-architectures.
.- Benchmarking Large Language Models: Opportunities and Challenges.
.- The Linked Data Benchmark Council (LDBC): Driving competition and collaboration in the graph data management space.
.- The LDBC Social Network Benchmark Interactive Workload v2: A Transactional Graph Query Benchmark with Deep Delete Operations.
.- A Cloud-Native Adoption of Classical DBMS Performance Benchmarks and Tools.