Pinned Loading

1. flash-attention flash-attention Public

   Flash attention style kernel

   Cuda

2. Task-Runtime Task-Runtime Public

   C++

3. tensor-parallel-llm-inference tensor-parallel-llm-inference Public

   A simple vLLM-style inference engine and Llama 3.2 implementation built with PyTorch and Triton.

   Python