Skip to content

Commit ac519e6

Browse files
committed
update xpk parallelism.
1 parent a230776 commit ac519e6

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -350,8 +350,8 @@ After installation completes, run the training script.
350350
skip_first_n_steps_for_profiler=3 \
351351
profiler_steps=3 \
352352
per_device_batch_size=0.25 \
353-
ici_data_parallelism=64 \
354-
ici_fsdp_parallelism=2 \
353+
ici_data_parallelism=32 \
354+
ici_fsdp_parallelism=4 \
355355
ici_tensor_parallelism=1" \
356356
max_train_steps=5000 \
357357
eval_every=100 \

0 commit comments

Comments
 (0)