Skip to content
Snippets Groups Projects
Unverified Commit 31b01ee0 authored by Xuan Gu's avatar Xuan Gu Committed by GitHub
Browse files

Update README.md

parent 47bd861c
No related branches found
No related tags found
No related merge requests found
...@@ -84,8 +84,8 @@ when batch_size is large (16, 32, 64, 128), throughput_amp > throughput_tf32. ...@@ -84,8 +84,8 @@ when batch_size is large (16, 32, 64, 128), throughput_amp > throughput_tf32.
- Observation 2: The coefficient of variation of throughput for the 100 iterations is smallest when batch_size = 128. - Observation 2: The coefficient of variation of throughput for the 100 iterations is smallest when batch_size = 128.
Benchmarking with dim = 2, nodes = 1,2, gpus = 8, batch_size = 128 can be used for node health check. **Benchmarking with dim = 2, nodes = 1, 2, gpus = 8, batch_size = 128 can be used for node health check.
For example, the expected throughput for dim = 2, nodes = 1, gpus = 8, batch_size = 128 would be ? ± ? (TF32) and ? ± ? (AMP). For example, the expected throughput for dim = 2, nodes = 1, gpus = 8, batch_size = 128 would be 4700 ± 500 (TF32).**
<img src="https://github.com/xuagu37/Benchmark_nnU-Net_for_PyTorch/blob/main/figures/benchmark_throughput_cv.png" width="400"> <img src="https://github.com/xuagu37/Benchmark_nnU-Net_for_PyTorch/blob/main/figures/benchmark_throughput_cv.png" width="400">
...@@ -95,7 +95,7 @@ For example, the expected throughput for dim = 2, nodes = 1, gpus = 8, batch_siz ...@@ -95,7 +95,7 @@ For example, the expected throughput for dim = 2, nodes = 1, gpus = 8, batch_siz
- Observation 4: Ideally, the improvement of throughput would be linear when the number of GPUs increases. In practice, throughtput stays below the ideal curve when gpus increases. - Observation 4: Ideally, the improvement of throughput would be linear when the number of GPUs increases. In practice, throughtput stays below the ideal curve when gpus increases.
<img src="https://github.com/xuagu37/Benchmark_nnU-Net_for_PyTorch/blob/main/figures/benchmark_gpus_ideal.png" width="400"> <img src="https://github.com/xuagu37/Benchmark_nnU-Net_for_PyTorch/blob/main/figures/benchmark_throughput_gpus_ideal.png" width="400">
#### Notes #### Notes
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment