nilsmatteson.com *** est. 2026 *** inference engineering *** inferact-sponsored vLLM fellow *** cold starts, model loading, GPU memory *** currently poking at kernel tuning *** music, guitar, running, skiing *** the marquee is HTML baby

about.txt - Notepad
✕

About

I’m Nils, a Swedish-American engineer based in San Jose. I grew up in Boise and moved here after finishing my B.S. in Data Science, with a CS minor, at UW-Madison in May 2026. I’m now studying for an M.S. in Computer Science at Northeastern’s Silicon Valley campus.

I’m interested in inference engineering: what happens between starting a model server and getting a useful response, where the time goes, and which parts of that work can be reused. That takes me into model loading, GPU memory, caching, and the details of how an engine starts and recovers.

Currently, I work with Simon Mo as an Inferact-sponsored vLLM open-source fellow. I’ve been working on startup performance and reusable engine preparation, and lately on kernel tuning in FlashInfer. I like following a slow startup through the stack until I can explain what changed. A faster run is useful; understanding why it got faster is the part that keeps me interested. Some of that work is linked on the work page.

Outside of that, I make music in Ableton, play guitar, run, and ski when I can. The site looks like Windows 98 on purpose; desktop computing peaked then and I see no reason to pretend otherwise.

You can reach me at nilsmatteson@icloud.com, or find my code on GitHub.