Pikachu

Researcher

Shawn Westfall

Most engineers load models with Hugging Face then serve something basic and get stuck on cost, latency, or scale. In this course, we will 

ML Research Engineer and Book Author 

O'Reilly Media

@Packtpub

Abi Aryan

Founder and Research Engineering Lead @ Abide AI 

AI Systems Design & Inference Engineering

goabiaryan

<h3>Why I enrolled</h3>
<p class="p2-tall">I'm currently automating aspects of malware reverse engineering with ML and agents. We currently use SOTA models such as Claude and Gemini, however I've been experimenting with local models to see how far off they are from the results we're getting with the SOTA models. Because my job is to understand low level internals of executable binaries I'm naturally intrigued with the low level details for LLM inference, GPU performance, and optimization at the local level in my own lab environment. The more I work with ML/AI the more I realize I'd like to work more closely with the tech stack and not just applying it to my specific, job related, tasks. </p>
<p></p>

<p></p>
<h3>What I’ll apply</h3>
<p class="p2-tall">I'm excited to utilize the inference gateway within my own home lab environment, and I'm also excited to do more detailed research into many of the inference optimization algorithms that we discussed. </p>
<p></p>

Certificate

Learn more about this course