Skip to content

Commit a585a75

Browse files
update sharding config.
1 parent ee38d09 commit a585a75

1 file changed

Lines changed: 1 addition & 3 deletions

File tree

src/maxdiffusion/configs/base_wan_14b.yml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -125,13 +125,11 @@ mesh_axes: ['data', 'fsdp', 'tensor']
125125
# conv_out : conv.shape[-1] weight
126126
logical_axis_rules: [
127127
['batch', 'data'],
128-
['activation_heads', 'tensor'],
129128
['activation_length', 'fsdp'],
129+
['activation_heads', 'tensor'],
130130
['activation_batch', 'data'],
131-
['activation_kv', 'tensor'],
132131
['mlp','tensor'],
133132
['embed','fsdp'],
134-
['heads', 'tensor'],
135133
['norm', 'tensor'],
136134
['conv_batch', ['data','fsdp']],
137135
['out_channels', 'tensor'],

0 commit comments

Comments
 (0)