Loading…
DeveloperWeek 2025 has ended
← Back to schedule
[Virtual] OPEN Session: Harnessing Microservices for Scalable and Resilient AI Applications
Wednesday February 19, 2025 12:00pm - 12:25pm PST
VIRTUAL Frontend World
Mayank Jindal, Amazon, Software engineer

AI applications present unique challenges related to scalability, complexity and resource optimization. This talk explores how microservices architecture can effectively address these challenges by decomposing AI systems into modular, independently deployable services. By adopting microservices, AI workloads—such as data preprocessing, model training and inference can be scaled and managed independently, leading to more flexible, efficient and resilient systems.

Attendees will learn how microservices architecture enables horizontal scaling of AI tasks allowing components like model inference engines to scale seamlessly as demand grows without affecting the entire application. We will also explore how microservices improve fault isolation ensuring that failures in one service do not propagate and disrupt the entire system. The session will cover asynchronous communication patterns, such as message queues and event-driven architectures which are particularly well-suited for decoupling AI services and handling complex, resource-heavy processes in parallel.

In addition, we will discuss strategies for orchestrating AI workflows and managing dependencies between services ensuring smooth operation even as the system grows more complex. The talk will also highlight best practices for designing resilient, scalable microservices that meet the specific needs of AI applications such as managing data flows, balancing computational loads and ensuring consistency across distributed services.

By the end of this session, attendees will understand how microservices can enable more scalable, flexible and fault-tolerant AI architectures. Whether developing real-time AI solutions, processing large datasets or managing multi-stage machine learning pipelines, participants will gain practical strategies for leveraging microservices to build scalable and resilient AI systems.
Speakers
avatar for Mayank Jindal

Mayank Jindal

Software engineer, Amazon
Mayank Jindal is a seasoned software engineer with extensive experience in creating microservices at Amazon, a global leader in technology and e-commerce. With a deep passion for architecting scalable and robust systems, Mayank has played a pivotal role in designing and implementing... Read More →
Wednesday February 19, 2025 12:00pm - 12:25pm PST
VIRTUAL Frontend World https://app.events.ringcentral.com/events/developerweek-productworld-ai-devworld-2025/reception
  AI DevWorld
Feedback form is now closed.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link