Loading…
← Back to schedule
PRO WORKSHOP: Harnessing Microservices for Scalable and Resilient AI Applications LIMITED
Tuesday February 11, 2025 1:00pm - 1:25pm PST
AI DevWorld MAIN STAGE
Mayank Jindal, Amazon, Software engineer

AI applications present unique challenges related to scalability, complexity and resource optimization. This talk explores how microservices architecture can effectively address these challenges by decomposing AI systems into modular, independently deployable services. By adopting microservices, AI workloads—such as data preprocessing, model training and inference can be scaled and managed independently, leading to more flexible, efficient and resilient systems.

Attendees will learn how microservices architecture enables horizontal scaling of AI tasks allowing components like model inference engines to scale seamlessly as demand grows without affecting the entire application. We will also explore how microservices improve fault isolation ensuring that failures in one service do not propagate and disrupt the entire system. The session will cover asynchronous communication patterns, such as message queues and event-driven architectures which are particularly well-suited for decoupling AI services and handling complex, resource-heavy processes in parallel.

In addition, we will discuss strategies for orchestrating AI workflows and managing dependencies between services ensuring smooth operation even as the system grows more complex. The talk will also highlight best practices for designing resilient, scalable microservices that meet the specific needs of AI applications such as managing data flows, balancing computational loads and ensuring consistency across distributed services.

By the end of this session, attendees will understand how microservices can enable more scalable, flexible and fault-tolerant AI architectures. Whether developing real-time AI solutions, processing large datasets or managing multi-stage machine learning pipelines, participants will gain practical strategies for leveraging microservices to build scalable and resilient AI systems.
Speakers
avatar for Mayank Jindal

Mayank Jindal

Software engineer, Amazon
Mayank Jindal is a seasoned software engineer with extensive experience in creating microservices at Amazon, a global leader in technology and e-commerce. With a deep passion for architecting scalable and robust systems, Mayank has played a pivotal role in designing and implementing... Read More →
Tuesday February 11, 2025 1:00pm - 1:25pm PST
AI DevWorld MAIN STAGE
  AI DevWorld
Log in to leave feedback.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link