diff --git a/README.md b/README.md index 41a6d9401522d3eb0aba5bfd63ca3d24baca57de..6b9fc86d72232671040cd0fc082d967558747d1a 100644 --- a/README.md +++ b/README.md @@ -102,6 +102,6 @@ when batch_size is large (16, 32, 64, 128), throughput_amp > throughput_tf32. #### Notes - It seems running directly via singularity shell will give worse performance (when I WFH). We should run it via sbatch script instead. -- It took around a week to finish all iterations of benchmarking. +- It took around a week to finish 100 iterations of benchmarking for all sets of parameters. - For multi-node benchmarking, we need to use "srun" command; also, the line "#SBATCH --ntasks-per-node=8" has to been added. Otherwise the process will hang. - Benchmarking with dim = 2, nodes = 1, gpus = 8, batch_size = 128 takes ~2mins. If we want to finish it within a minute, we can change the number of batches from 150 (the default value) to a smaller number.