“Attention is all I need”
Building performant AI infrastructure from first principles.
I’m a final-year student at EPITECH Lyon and recently completed an exchange year at Tsinghua University. While at Tsinghua, I was part of the team that earned the Leader Award at Chengdu 80 (2024) — a prestigious international FinTech competition.
With 5 years of hands-on software experience across the stack, I’ve explored nearly every major domain of computer science and chosen to specialize in Artificial Intelligence.
I enjoy digging into the math and systems engineering that power modern ML—then open-sourcing the tools I wish existed.
| Field | Keywords |
|---|---|
| AI / ML | sub-quadratic attention, autograd engines, model compression, NLP |
| Systems | C / C++, GPU & SIMD optimization, multithreading, low-level profiling |
| Data Infra | distributed training, big-data ETL, high-throughput I/O |
| Languages | Python, C, C++, TypeScript, JavaScript, Bash, SQL, … |
| Frameworks | PyTorch, CUDA, React/Next, Docker, WebRTC |
| Project | Brief |
|---|---|
treat |
Novel sub-quadratic attention framework built on Binary-Tree Attention Trees composed from Linear Attention. Achieves O(n log n) context aggregation while retaining full-sequence fidelity. |
saute |
Multi-party discourse processor with hierarchical EDU-level parsing and speaker-aware memory, implemented via stacked linear-attention blocks for efficient long-context reasoning. |
dtorch |
Minimal autograd + neural-network library—clean codebase for educational deep-learning research. |
Argos |
Real-time remote desktop manager leveraging WebRTC, Socket.IO, and low-level thread orchestration. |
excalidraw-latex-gen |
CLI to generate LaTeX-based Excalidraw diagrams automatically. |
Abricot-Norminette |
Ultra-fast, multithreaded C style-checker adopted by EPITECH cohorts. |
- 💼 LinkedIn — Justin Duc
- 🤖 Hugging Face — @JustinDuc
- 📧 Reach out via GitHub or LinkedIn
Although I’ve delved into everything from compiler design to distributed systems, AI remains my primary focus. Blockchain is about the only field I haven’t explored—yet.
Thanks for stopping by! 🚀