- Observation 3: Ideally, throughput would be douled when batch_size doubled. In practice, throughtput does not increase ideally when batch_size > 16.
- Observation 3: Ideally, the improvement of throughput would be linear when batch_size increases. In practice, throughtput stays below the ideal curve when batch_size > 16.