Benchmarking

MLModelScope

An open-source, framework and hardware agnostic, extensible and customizable, distributed platform design for evaluating and profiling ML models across datasets/frameworks/systems.

DLBricks

Composable Benchmark Generation to Reduce Deep Learning Benchmarking Effort on CPUs.

Benanza

Automatic μBenchmark Generation to Compute “Lower-bound” Latency and Inform Optimizations of Deep Learning Models on GPUs.

Scope

An extendable and customizable GPU benchmarking framework