From 692fe0fc3eb140ecb9eced3118105ff3ec8d2506 Mon Sep 17 00:00:00 2001 From: Xuan Gu <xuagu37@gmail.com> Date: Thu, 20 Oct 2022 13:39:43 +0200 Subject: [PATCH] Update README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index eb30ed1..91b9361 100644 --- a/README.md +++ b/README.md @@ -104,3 +104,4 @@ when batch_size is large (16, 32, 64, 128), throughput_amp > throughput_tf32. - It seems running directly via singularity shell will give worse performance (when I WFH). We should run it via sbatch script instead. - It took around a week to finish all iterations of benchmarking. - For multi-node bash script, the line "#SBATCH --ntasks-per-node=8" has to been added; otherwise the process will hang. +- Benchmarking with dim = 2, nodes = 1, gpus = 8, batch_size = 128 takes ~2mins. If we want to finish it within a minute, we can change the number of batches from 150 (the default value) to a smaller number. -- GitLab