Meest recente aflevering
The Hard Truths About AI Agents: Why Benchmarks Lie and Frameworks Fail Building AI agents that actually work is harder than the hype suggests — and most people are doing it wrong. In this special "YAAP: Unplugged" episode (a live panel from AI Tinkerers meetup at the Hugging Face offices in Paris), Yuval sits down with A
Tijd: 39:54
Building AI agents that actually work is harder than the hype suggests — and most people are doing it wrong. In this special "YAAP: Unplugged" episode (a live panel from AI Tinkerers meetup at the Hugging Face offices in Paris), Yuval sits down with Aymeric Roucher (Project Lead for Agents at Hugging Face) and Niv Granot (Algorithms Group Lead at AI21 Labs) for an unfiltered discussion about the uncomfortable realities of agent development.
Key Topics:
Why current benchmarks are broken: From MMLU's limitations to RAG leaderboards that don't reflect real-world performanceThe tool use illusion: Why 95% accuracy on tool calling benchmarks doesn't mean your agent can actually planLLM-as-a-judge problems: How evaluation bottlenecks are capping progress compared to verifiable domains like codingFramework: friend or foe? When to ditch LangChain, LlamaIndex, and why minimal implementations often work betterThe real agent stack: MCP, sandbox environments, and the four essential components you actually needBeyond the hype cycle: From embeddings that can't distinguish positive from negative numbers to what comes after agentsFrom FIFA World Cup benchmarks that expose retrieval failures to the circular dependency problem with LLM judges, this conversation cuts through the marketing noise to reveal what it really takes to build agents that solve real problems — not just impressive demos.
Warning: Contains unpopular opinions about popular frameworks and uncomfortable truths about the current state of AI agent development.
GUID: b285ed06-e3cc-41e7-aa81-fc894f86c75d
Releasedatum: 10-6-2025 15:00:00
