BigDataBench 大数据和AI基准测试程序集
合集下载
相关主题
- 1、下载文档前请自行甄别文档内容的完整性，平台不提供额外的编辑、内容补充、找答案等附加服务。
- 2、"仅部分预览"的文档,不可在线预览部分如存在完整性等问题,可反馈申请退款(可完整预览的文档不适用该条件!)。
- 3、如文档侵犯您的权益，请联系客服反馈,我们会尽快为您处理(人工客服工作时间：9:00-18:30)。
基准测试集的构建
Good Benchmark
Relevant Portable Scalable Simple
BigDataBench: 大数据和AI基准测试程序集
1. 背景 2. 基准测试基本原理 3. 基准测试方法学 4. 大数据和AI基准测试程序集： BigDataBench
BigDataBench: 大数据和AI基准测试程序集
基准测试（Benchmark）
“ The process of running a specific program or workload on a specific machine or system and measuring the resulting performance .”
Saavedra, R. H., Smith, A. J.: Analysis of benchmark characteristics and benchmark performance prediction, ACM Transactions on Computer System, vol. 14, no. 4, (1996) 344-384
Hardware-centric
Only path left is Domain Specific Architectures Just do a few tasks, but extremely well
Combination
Domain Specific Languages & Architectures
BigDataBench: 大数据和AI基准测试程序集
面临的关键问题
• Understanding workloads
• Domain-specific hardware & Software codesign
• Open-source softwares/ hardwares
A New Golden Age for Computer Architecture: Domain-Specific Hardware/Software Co-Design, Enhanced Security, Open Instruction Sets, and Agile Chip Development. John Hennessy and David Patterson, Stanford and UC Berkeley. June 4, 2018
技术变革的基础
Technology
End of Dennard scaling: power becomes the key constraint Ending of Moore’s Law: transistors improvement slows
Architectural
Limitation and inefficiencies in exploiting instruction level
BigDataBench: 大数据和AI基准测试程序集
基准测试集（Benchmark Suite）
• A popular measure of performance with a variety of applications
• To overcome the danger of placing too many eggs in one basket
BigDataBench: 大数据和AI基准测试程序集
技术变革的机遇
Software-centric
Modern scripting languages amically-typed and encourage reuse
Efficient for programmers but not for execution
parallelism end the uniprocessor era in 2004
Amdahl’s Law and its implications end “easy” multicore era
Products
PC/Server ⇒ IoT, Mobile/Cloud
A New Golden Age for Computer Architecture: Domain-Specific Hardware/Software Co-Design, Enhanced Security, Open Instruction Sets, and Agile Chip Development. John Hennessy and David Patterson, Stanford and UC Berkeley. June 4, 2018
大数据分析与生态系统论坛 BigDataBench: 大数据和AI基准测试程序集
BigDataBench: 大数据和AI基准测试程序集
1. 背景 2. 基准测试基本原理 3. 基准测试方法学 4. 大数据和AI基准测试程序集： BigDataBench
BigDataBench: 大数据和AI基准测试程序集
A New Golden Age for Computer Architecture: Domain-Specific Hardware/Software Co-Design, Enhanced Security, Open Instruction Sets, and Agile Chip Development. John Hennessy and David Patterson, Stanford and UC Berkeley. June 4, 2018
• the weakness of any one benchmark is lessened by the presence of the other benchmarks
• characterize the relative performance
• e.g. EEMBC, SPEC
BigDataBench: 大数据和AI基准测试程序集
Good Benchmark
Relevant Portable Scalable Simple
BigDataBench: 大数据和AI基准测试程序集
1. 背景 2. 基准测试基本原理 3. 基准测试方法学 4. 大数据和AI基准测试程序集： BigDataBench
BigDataBench: 大数据和AI基准测试程序集
基准测试（Benchmark）
“ The process of running a specific program or workload on a specific machine or system and measuring the resulting performance .”
Saavedra, R. H., Smith, A. J.: Analysis of benchmark characteristics and benchmark performance prediction, ACM Transactions on Computer System, vol. 14, no. 4, (1996) 344-384
Hardware-centric
Only path left is Domain Specific Architectures Just do a few tasks, but extremely well
Combination
Domain Specific Languages & Architectures
BigDataBench: 大数据和AI基准测试程序集
面临的关键问题
• Understanding workloads
• Domain-specific hardware & Software codesign
• Open-source softwares/ hardwares
A New Golden Age for Computer Architecture: Domain-Specific Hardware/Software Co-Design, Enhanced Security, Open Instruction Sets, and Agile Chip Development. John Hennessy and David Patterson, Stanford and UC Berkeley. June 4, 2018
技术变革的基础
Technology
End of Dennard scaling: power becomes the key constraint Ending of Moore’s Law: transistors improvement slows
Architectural
Limitation and inefficiencies in exploiting instruction level
BigDataBench: 大数据和AI基准测试程序集
基准测试集（Benchmark Suite）
• A popular measure of performance with a variety of applications
• To overcome the danger of placing too many eggs in one basket
BigDataBench: 大数据和AI基准测试程序集
技术变革的机遇
Software-centric
Modern scripting languages amically-typed and encourage reuse
Efficient for programmers but not for execution
parallelism end the uniprocessor era in 2004
Amdahl’s Law and its implications end “easy” multicore era
Products
PC/Server ⇒ IoT, Mobile/Cloud
A New Golden Age for Computer Architecture: Domain-Specific Hardware/Software Co-Design, Enhanced Security, Open Instruction Sets, and Agile Chip Development. John Hennessy and David Patterson, Stanford and UC Berkeley. June 4, 2018
大数据分析与生态系统论坛 BigDataBench: 大数据和AI基准测试程序集
BigDataBench: 大数据和AI基准测试程序集
1. 背景 2. 基准测试基本原理 3. 基准测试方法学 4. 大数据和AI基准测试程序集： BigDataBench
BigDataBench: 大数据和AI基准测试程序集
A New Golden Age for Computer Architecture: Domain-Specific Hardware/Software Co-Design, Enhanced Security, Open Instruction Sets, and Agile Chip Development. John Hennessy and David Patterson, Stanford and UC Berkeley. June 4, 2018
• the weakness of any one benchmark is lessened by the presence of the other benchmarks
• characterize the relative performance
• e.g. EEMBC, SPEC
BigDataBench: 大数据和AI基准测试程序集