AI Engineer // LLM Inference & Systems — Télécom SudParis (IP Paris)
I bring big models to small machines. Upstream llama.cpp contributor, GGUF publisher (64k+ downloads), running 300B+ MoE models 24/7 on a two-node home fleet (Strix Halo 128 GB + RTX 3090).
- llama.cpp — brought up NVIDIA Nemotron-3-Puzzle-75B-A9B (per-layer MoE): C++ graph builder, per-layer hparams, HF→GGUF converter. Merged — PR #25444 (56 files, two maintainer reviews). Follow-up robustness fix — PR #28779.
- Hugging Face — the reference GGUF builds, 64k+ all-time downloads: Hy3-295B-A21B-GGUF (51k), Nemotron-3-Puzzle-75B-A9B-GGUF, DeepSeek-V4-Flash-DSpark-draft-GGUF. Picked as the reference local setup on r/LocalLLaMA for publishing perplexity numbers.
| Repo | What |
|---|---|
| strix-halo-llm-serving | Speculative decoding + kernel work on AMD Strix Halo: DeepSeek-V4-Flash, GLM-5.3-Flash, Qwen3.8 — paired duels, both legs reported |
| escha-port | Porting the ESCHAM 2-bit format (QTIP trellis) into llama.cpp — CUDA/HIP kernels, ×33 prefill, honest head-to-head vs Q4_K_XL |
| qwdense-turbo | 2.28× faster Claude Code on a local Qwen3.6-27B int4 — MTP speculative decoding, tool calling, corruption guards |
| qwdense-llamacpp | llama.cpp native Qwen3.6 MTP lab for long-context agentic coding |
- GETA Solutions — B2C/B2B e-commerce platform (truck tires, parts, transport), designed, built and operated solo: Django 5.2, Stripe (cards, SEPA, Alma), PostgreSQL, TecDoc — live at getasolutions.fr, €18k revenue in August 2026.
- hyte-y70-touch-dashboard ⭐ most-starred — the only Linux dashboard for the HYTE Y70 Touch touchscreen: 10 swipe pages, reverse-engineered LED control.
- federated-learning-privacy — FedAvg + gradient-inversion attacks + DP defenses, with the honest finding that naive Central DP collapses utility on small federations.
- efficient-llm-pipeline — TurboQuant KV-cache compression + LoRA on Phi-4-mini, documenting three architecture-dependent findings the original paper doesn't mention.
Inference — C++, llama.cpp, GGUF, quantization, speculative decoding, vLLM, SGLang, CUDA, ROCm, Vulkan · ML — Python, PyTorch, RAG, Hugging Face · Software — Django, FastAPI, PostgreSQL, Docker, GitHub Actions, Azure