@@ -95,7 +95,7 @@ For example, the expected throughput for dim = 2, nodes = 1, gpus = 8, batch_siz
...
@@ -95,7 +95,7 @@ For example, the expected throughput for dim = 2, nodes = 1, gpus = 8, batch_siz
- Observation 4: Ideally, the improvement of throughput would be linear when the number of GPUs increases. In practice, throughtput stays below the ideal curve when gpus increases.
- Observation 4: Ideally, the improvement of throughput would be linear when the number of GPUs increases. In practice, throughtput stays below the ideal curve when gpus increases.