Skip to content

Ulysses attention: layout pin, saved exchanged Q/K/V, packed Q/K/V all-to-all (on #5779) - #5780

Open
khatwanimohit wants to merge 3 commits into
parambole/ag-l3-ulyssesfrom
mohit/ulysses-gqa-fixes
Open

Ulysses attention: layout pin, saved exchanged Q/K/V, packed Q/K/V all-to-all (on #5779)#5780
khatwanimohit wants to merge 3 commits into
parambole/ag-l3-ulyssesfrom
mohit/ulysses-gqa-fixes

Ulysses attention: exchange Q, K and V in one all-to-all

59904c5
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Oct 15, 2026 in 8s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ 59904c5 Author: @khatwanimohit <moh*******ani​@google.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA