@@ -62,8 +62,8 @@ Chnage the following settings in `benchmark_sbatch_submit.sh`:
...
@@ -62,8 +62,8 @@ Chnage the following settings in `benchmark_sbatch_submit.sh`:
1. Data dimention,
1. Data dimention,
2. Number of nodes,
2. Number of nodes,
3. Number of gpus used per node,
3. Number of gpus used per node,
4. Number of iterations for each parameter setting.
4. Number of iterations for each parameter setting,
5. Batch size
5. Batch size.
We will average the benchmark performance over the iterations. The maximum usable (without a OOM error) batch size is 256 and 128 for single and multi-node, respectively.
We will average the benchmark performance over the iterations. The maximum usable (without a OOM error) batch size is 256 and 128 for single and multi-node, respectively.
