Skip to content

Commit 0affeba

Browse files
committed
Add logical_axis_rules rules for "qkv"
1 parent 77cfb55 commit 0affeba

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

src/MaxText/configs/base.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -455,6 +455,7 @@ logical_axis_rules: [
455455
["kv_lora_up_proj",[]],
456456
['norm', ['tensor', 'tensor_transpose']],
457457
['layers', 'stage'],
458+
['qkv', []],
458459
['kv', []],
459460
['kv_head_dim', []],
460461
['cache_batch_prefill', []],

0 commit comments

Comments
 (0)