Test Search on Any Website with Quepid and Javascript

Hosted by Charlie Hull and Doug Turnbull

Fri, Aug 29, 2025

4:30 PM UTC (45 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

'Relevant Search' masterclass
Doug Turnbull and Nick Zadrozny
View syllabus

What you'll learn

What is Quepid - the search relevance workbench

Learn about Quepid, the leading open source tool for tuning relevance in Solr, Elasticsearch, and other search engines

How to connect Quepid to your site

How Charlie has developed a method for evaluating search for any website, directly through its web interface

From human to LLM labels

Gathering human judgements of relevance lets you build offline test sets to tune search, augmented by LLM labels

Why this topic matters

You can't improve search quality unless you can measure it. Quepid lets you gather relevance judgements for a set of search queries, but it usually needs access to the search engine back end - which isn't always easy to get. I'll show you a way to connect Quepid to any site with this one Javascript hack.. You'll also learn how Quepid can use AI to augment your human judgements

You'll learn from

Charlie Hull

Principal Consultant, The Search Juggler

I'm Charlie Hull, The Search Juggler - a leading figure in the search industry, known for an honest, neutral and pragmatic viewpoint; I have held multiple roles including senior consultant, strategic advisor, project manager, sales & marketing director, conference organiser & speaker, trainer, writer & mentor. I am deeply connected with the business & technology of website and enterprise search engines with particular experience of small, high-value consulting companies. My past experience in software engineering gives me a highly informed perspective on search technology with a particular focus on open source platforms such as LuceneApache SolrElasticsearch and OpenSearch.  More recently I have helped several companies use modern AI techniques to supercharge search, including Moonpig, the UK's leading online supplier of greeting cards and gifts.


Doug Turnbull

Principal Consultant, SoftwareDoug LLC

Doug Turnbull (aka softwaredoug) is an expert in search technology and relevance engineering. Most recently Doug worked as Principal Engineer at Daydream, where he built hybrid fashion search systems combining lexical and vector retrieval. Doug has developed LLM-driven search quality programs for e-commerce and social media search. Previously, he led machine-learning-driven search initiatives at Reddit, significantly improving search relevance with Learning to Rank. Doug also advanced e-commerce search at Shopify and served as CTO at OpenSource Connections. He co-authored the influential book Relevant Search (Manning, 2016), co-authored AI Powered Search (Manning 2024), and created popular open-source tools, including Quepid and the Elasticsearch Learning to Rank plugin. He regularly speaks at industry conferences, making information retrieval accessible to every engineer.

Reddit
OpenSource Connections
Shopify.com
LexisNexis

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.

© 2025 Maven Learning, Inc.