Skip to content

Add 2 hard inference challenges: FP8 Block-Scaled GEMM (140), Flash Decoding Attention (141) - #350

Merged
kunal-mansukhani merged 1 commit into
mainfrom
add-inference-140-141
Oct 15, 2026
Merged

kunal-mansukhani merged 1 commit into
mainfrom
add-inference-140-141

Conversation

@kunal-mansukhani

Copy link
Copy Markdown
Contributor

Summary

Two new free, hard LLM-inference challenges (numbers continue after Interview Track's reserved 134–139; #349 left untouched):

ID Name One-line hook
140 FP8 Block-Scaled GEMM DeepSeek-V3 / DeepGEMM E4M3×E4M3 matmul with 1×128 float32 block scales
141 Flash Decoding Attention Long-context single-token multi-head decode (T ≪ S), the flash-decoding regime

Skipped the CEO examples that already exist: MLA Decode (114), Grouped GEMM (99), NVFP4 (89).

Details

  • access_tier = free, difficulty hard
  • Reference implementations accumulate in float64
  • Edge tests: zeros, non-power-of-two shapes, tiny scales, large softmax scores, long KV (8K / 65K)
  • Mojo 1.1 starters (max.gpu / std.memory)
  • validate_challenges.py: 0 errors; black / isort / flake8 / clang-format clean locally

Test plan

  • python scripts/validate_challenges.py → 0 errors
  • Local reference_impl on example + functional tests (CPU)
  • CI lint + check-index green
  • After merge: confirm both appear on api.leetgpu.com/api/v1/challenges

…ecoding Attention (141)

Free, hard LLM-inference kernels. FP8 block-scaled GEMM is the DeepSeek-V3 /
DeepGEMM E4M3 x E4M3 matmul with 1x128 float32 scales. Flash decoding attention
is long-context single-token (T << S) multi-head decode. References accumulate
in float64. Leaves Interview Track #349 (134-139) untouched.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Review bot: needs a human reviewer.

  • adds 2 new challenges (limit 1)

@github-actions github-actions Bot added the needs-human-review Review bot: needs a human reviewer label Oct 15, 2026
@kunal-mansukhani
kunal-mansukhani merged commit d142629 into main Oct 15, 2026
6 checks passed
@kunal-mansukhani
kunal-mansukhani deleted the add-inference-140-141 branch October 15, 2026 16:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs-human-review Review bot: needs a human reviewer

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant