Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[MFMA] MFMA 4x64 64x4 version 2 #539

Draft
wants to merge 4 commits into
base: triton-mlir
Choose a base branch
from

Commits on Mar 19, 2024

  1. [MFMA][FRONTEND] Add more options for forced mfma layout sizes

    This PR:
    - adds an `matrix_instr_nonkdim` options to force MFMA 64x4 and 4x64 layout: 464 corresponds 4(M)x64(N), 644 corresponds 64(M)x4(N)
    - adds tests for this option
    - fixes swizzling patter in some cases
    
    MFMA size heuristic now looks like this:
    
    1. If kernel specific option is set, pick it
    2. If the result tile shape is larger than 32x32, pick mfma32
    3. If the tile shape is smaller than 32x32 but larger than 16x16, pick mfma16
    4. if the tile shape is smaller than 4x64 or 64x4, pick mfma4x4
    5. Otherwise, pick mfma4x64 or mfma64x4, depending on what tile fits into matrices
    binarman committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    da5040d View commit details
    Browse the repository at this point in the history
  2. [MFMA] MFMA 4x64 64x4 version 2

    Extend K dimension of mfma4x64 and mfma64x4 dot operand layout from 4 to 64.
    binarman committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    fde46d8 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. change swizzling pattern

    binarman committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    beb2f66 View commit details
    Browse the repository at this point in the history
  2. add small attention script

    binarman committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    1fdf1ac View commit details
    Browse the repository at this point in the history