Stay Ahead in AI: Evaluate Any New LLM in 15 Minutes

Hosted by Sherveen Mashayekhi

88 students

What you'll learn

Spot signals that actually matter, fast

I'll teach you reliable, structured methods for testing and evaluating new LLMs the day they come out.

Decide fit fast: SOTA, niche, or avoid

We'll talk about how to map models to your toolkit so you don't skip out on task-specific strengths and weaknesses.

The flaws with benchmarks and OPO (other people's opinions)

You might go... why does this guy hate benchmarks so much? By the end of this session, you will, too!

Why this topic matters

New AI models are launching weekly. Most people look to outdated benchmarks or biased influencers to try to evaluate what tools and LLMs to use. But we should all be building an instinctual understanding of how to judge these tools and models ourselves. And it's not as hard as it might sound. You'll learn how to form your own evidence-based perspective that you can trust.

You'll learn from

Sherveen Mashayekhi

Founder & CEO @ Free Agency, AI Product Leader & Investor

Sherveen has been an AI product leader and founder in tech for over a decade, but more importantly, is a long-time obsessive about startups.

He's a first adopter of AI tools and sits in exclusive circles of founders + venture capitalists building the cutting edge of applied AI products. As the founder and CEO of Free Agency (backed by investors like Maveron, Bloomberg Beta, Kevin Durant, and Kygo), he now helps tech professionals navigate the modern hiring landscape, with clients landing roles at companies like OpenAI, Amazon, and Stripe.

He's the host of three shows + podcasts about early stage tech: The Feedback Loop, Three Course Founders, and The Sherveen Show, where he talks multiple times a week with the most exciting technologists, CEOs, and investors building the future.

See more: https://youtube.com/@sherveenshow

Clients hired at companies like...