AI Research Intern · AMD
Agentic Model Customization
- Designed and built Agentic Model Customization, a framework in which a coding agent adapts LLMs to deployment constraints (throughput, memory, context length) by writing its own data, conversion, and training code.
- Built its core components: a sandboxed agent environment, a GPU scheduler, and an evaluation system that serves each candidate in vLLM to check capability and deployment limits.
- Produced a 1.7B-model variant with a 95% smaller KV cache through latent-attention (MLA) conversion and hybridization, keeping accuracy on par with the base model at 1.8× throughput.
- Removed 60% of parameters through compression while keeping 90% of base capability and long-context throughput above the base.







