Skip to content

Commit b3fcc99

Browse files
committed
doc: update README.md with synthetic data iterator usage.
1 parent 9b1e9df commit b3fcc99

1 file changed

Lines changed: 11 additions & 0 deletions

File tree

README.md

100644100755
Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -255,6 +255,17 @@ After installation completes, run the training script.
255255
- In Wan2.1, the ici_fsdp_parallelism axis is used for sequence parallelism, the ici_tensor_parallelism axis is used for head parallelism.
256256
- You can enable both, keeping in mind that Wan2.1 has 40 heads and 40 must be evenly divisible by ici_tensor_parallelism.
257257
- For Sequence parallelism, the code pads the sequence length to evenly divide the sequence. Try out different ici_fsdp_parallelism numbers, but we find 2 and 4 to be the best right now.
258+
- For benchmarking training performance on multiple data dimension input without downloading/re-processing the dataset, the synthetic data iterator is supported.
259+
- Set dataset_type='synthetic' and synthetic_num_samples=null to enable the synthetic data iterator.
260+
- The following overrides on data dimensions are supported:
261+
- synthetic_override_height: 720
262+
- synthetic_override_width: 1280
263+
- synthetic_override_num_frames: 85
264+
- synthetic_override_max_sequence_length: 512
265+
- synthetic_override_text_embed_dim: 4096
266+
- synthetic_override_num_channels_latents: 16
267+
- synthetic_override_vae_scale_factor_spatial: 8
268+
- synthetic_override_vae_scale_factor_temporal: 4
258269

259270
You should eventually see a training run as:
260271

0 commit comments

Comments
 (0)