DAWNBench

An End-to-End Deep Learning Benchmark and Competition

ImageNet Inference

Submission Date Model 1-example Latency (milliseconds) 10,000 batch classification cost (USD) Max Accuracy Hardware Framework

Nov 2017

ResNet 152

Stanford DAWN

source

26.8200 $0.13 93.00% 1 P100 / 30 GB / 8 CPU (Google Compute) MXNet 0.11.0

Nov 2017

ResNet 152

Stanford DAWN

source

29.2400 $0.07 93.00% 1 K80 / 61 GB / 4 CPU (Amazon EC2 [p2.xlarge]) MXNet 0.11.0

Nov 2017

ResNet 152

Stanford DAWN

source

49.5100 $0.12 93.35% 1 K80 / 61 GB / 4 CPU (Amazon EC2 [p2.xlarge]) TensorFlow v1.2

Nov 2017

ResNet 152

Stanford DAWN

source

22.2700 $0.11 93.35% 1 P100 / 30 GB / 8 CPU (Google Compute) TensorFlow v1.2