Skip to content

add FlashAttentionKwargs and seq_idx to flat collator - #36456

Merged
Cyrilvallez merged 31 commits into
huggingface:mainfrom
garrett361:flash-attn-kwargs-in-flat-collator
Apr 16, 2025
Merged

add FlashAttentionKwargs and seq_idx to flat collator#36456
Cyrilvallez merged 31 commits into
huggingface:mainfrom
garrett361:flash-attn-kwargs-in-flat-collator

use py ints for max_length_{k,q}

3f42490
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs