Skip to content

Commit be8d744

Browse files
meijianhancpersson-amd
authored andcommitted
doc: update README.md with synthetic data iterator usage.
1 parent 5d9cb51 commit be8d744

1 file changed

Lines changed: 11 additions & 0 deletions

File tree

README.md

100644100755
Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -262,6 +262,17 @@ After installation completes, run the training script.
262262
- For use on GPU it is recommended to enable the cudnn_te_flash attention kernel for optimal performance.
263263
- Best performance is achieved with the use of batch parallelism, which can be enabled by using the ici_fsdp_batch_parallelism axis. Note that this parallelism strategy does not support fractional batch sizes.
264264
- ici_fsdp_batch_parallelism and ici_fsdp_parallelism can be combined to allow for fractional batch sizes. However, padding is not currently supported for the cudnn_te_flash attention kernel and it is therefore required that the sequence length is divisible by the number of devices in the ici_fsdp_parallelism axis.
265+
- For benchmarking training performance on multiple data dimension input without downloading/re-processing the dataset, the synthetic data iterator is supported.
266+
- Set dataset_type='synthetic' and synthetic_num_samples=null to enable the synthetic data iterator.
267+
- The following overrides on data dimensions are supported:
268+
- synthetic_override_height: 720
269+
- synthetic_override_width: 1280
270+
- synthetic_override_num_frames: 85
271+
- synthetic_override_max_sequence_length: 512
272+
- synthetic_override_text_embed_dim: 4096
273+
- synthetic_override_num_channels_latents: 16
274+
- synthetic_override_vae_scale_factor_spatial: 8
275+
- synthetic_override_vae_scale_factor_temporal: 4
265276

266277
You should eventually see a training run as:
267278

0 commit comments

Comments
 (0)