Merge pull request #2957 from CIeNET-International:fix/benchmark-v5p-llama2-70b-configs

PiperOrigin-RevId: 859607658

Author: Google-ML-Automation

benchmarks/maxtext_v5p_model_configs.py

@@ -202,7 +202,7 @@
         model_type="llama2-70b",
         tuning_params={
             "ici_fsdp_parallelism": -1,
-            "per_device_batch_size": 4,
+            "per_device_batch_size": 2,
             "remat_policy": "save_dot_except_mlpwi",
             "max_target_length": 4096,
             "use_iota_embed": True,