DeveloperWeek 2025: Full Schedule

arrow_back View All Dates

10:00am PST

PRO Session: Striking the Balance: Leveraging Human Intelligence with LLMs for Cost-Effective Annotations

Thursday February 13, 2025 10:00am - 10:25am PST

Shambhavi Srivastava, Appen, AI Solutions Architect

Data annotation involves assigning relevant information to raw data to enhance machine learning (ML) model performance. While this process is crucial, it can be time-consuming and expensive. The emergence of Large Language Models (LLMs) offers a unique opportunity to automate data annotation. However, the complexity of data annotation, stemming from unclear task instructions and subjective human judgment on equivocal data points, presents challenges that are not immediately apparent.

In this session, Chris Stephens, Field CTO and Head of AI Solutions at Appen will provide a overview of an experiment that the company recently conducted to test the tradeoff between quality and cost of training ML models via LLMs vs human input. Their goal was to differentiate between utterances that could be confidently annotated by LLMs, and those that required human intervention. This differentiation was crucial to ensure a diverse range of opinions or to prevent incorrect responses from overly general models. Chris will walk audience members through the dataset used as well as methodology for the experiment, as well as the company’s research findings.

Speakers

Shambhavi Srivastava

AI Solutions Architect, Appen

Thursday February 13, 2025 10:00am - 10:25am PST
AI DevWorld Main Stage

AI DevWorld

Tracks & Topics Gen AI / LLMs
Session Type PRO Session
Conferences AI DevWorld, Generative AI & LLMs (AI DevWorld), AI DevWorld: AI Strategy Conference, Applied AI Innovation (AI DevWorld)
In-Person/Virtual In Person

2:00pm PST

PRO Session: From Thought to Action: How Agentic AI Will Reshape Enterprise AI

Thursday February 13, 2025 2:00pm - 2:25pm PST

AI DevWorld Main Stage

Utkarsh Contractor, Aisera, VP of AI

Enterprises are on the cusp of a transformative shift. They are moving beyond task-specific AI to embrace agentic systems capable of autonomous decision-making and actions through probabilistic reasoning. This evolution marks a new era of autonomy, where AI not only augments human capabilities but also drives business outcomes by:
- Optimizing Operations: Self-regulating systems enhance efficiency, ensure compliance, and proactively mitigate risks.
- Accelerating Innovation: Data-driven insights fuel strategic decision-making, enabling rapid market adaptation.
- Enhancing Customer Experience: Intelligent agents anticipate customer needs, delivering personalized solutions.

Although the potential benefits are immense, successful implementation demands a strategic approach that encompasses ethical considerations, security, and complexity management.

Join Utkarsh Contractor, VP of AI/ML at Aisera, as we explore the opportunities and challenges of this paradigm shift and how organizations can harness agentic AI to achieve sustained competitive advantage.

Speakers

Utkarsh Contractor

VP of AI, Aisera

Utkarsh Contractor is the VP of AI at Aisera, where he leads the AI team working on Enterprise LLMs and GenAI applications. He is also a Senior Research Fellow at Stanford University, focusing his research and experiments on intersection of language and vision in large multimodal... Read More →

Thursday February 13, 2025 2:00pm - 2:25pm PST
AI DevWorld Main Stage

AI DevWorld

Session Type PRO Session
Conferences AI DevWorld, AI DevWorld: Industry AI Conference, AI for the Enterprise (AI DevWorld), Generative AI & LLMs (AI DevWorld), AI DevWorld: AI Strategy Conference
In-Person/Virtual In Person

2:30pm PST

KEYNOTE (AI DevWorld): SambaNova Systems -- Composition of Experts: A Modular Approach to Scaling AI Models

Thursday February 13, 2025 2:30pm - 2:55pm PST

AI DevWorld Main Stage

Anton McGonnell, SambaNova Systems, VP of Product

This session, led by Anton McGonnell, Head of Software Products at SambaNova Systems, presents an in-depth exploration of the Composition of Experts approach in AI - a model made up of many models that work in conjunction with each other - and in particular the benefits to individual developers. Instead of building one monolithic model, this strategy composes workflows using many specialised, independent "expert" models. This proves to be more efficient, modular, and extensible.

The talk will provide a deep dive into the advantages of this technique, which promotes reusability, saves on alignment tax, and enables granular access control. By detailing real-world implementations, attendees will learn best practices for breaking down problems, assigning appropriate experts, and orchestrating data flow between them. McGonnell will discuss how an architecture with a large memory capacity, enables this approach by hosting and serving thousands of models in parallel on a single node without performance degradation. This makes the Composition of Experts approach highly scalable and reduces the total cost of ownership for inference.

Additionally, the session will offer crucial hardware considerations for executing Composition of Experts at scale. It will examine how specialised architectures can allow hosting thousands of models in parallel on a single node. With companies increasingly relying on AI, reliability and cost-efficiency are paramount concerns. Composition of Experts tackles these challenges through modularity and inference optimisation. By attending, developers and engineers can expect to gain highly applicable skills for improving the scalability, performance, and governance of AI in production environments.

Speakers

Anton McGonnell

VP of Product, SambaNova Systems

Anton McGonnell is SambaNova’s VP of Product and leads the team defining their cutting-edge full-stack chips-to-model platform.Prior to SambaNova, Anton played a pivotal role in shaping the development and implementation of advanced machine learning technologies at UIPath.Anton... Read More →

Thursday February 13, 2025 2:30pm - 2:55pm PST
AI DevWorld Main Stage

5. KEYNOTES & FEATURED

Tracks & Topics Gen AI / LLMs
Session Type OPEN Session
Conferences OPEN Session, AI DevWorld, Generative AI & LLMs (AI DevWorld), AI DevWorld: AI Strategy Conference
In-Person/Virtual In Person