MogiMogiJobsPowered by MobiusEngineLet Mogi apply

Amazon

Senior ML Software Engineer, Data Plane

Cupertino, CA · 3 months ago

On-siteFull-time

$261,500 to $261,500 a year

About the job

The MLIL DataPlane team is looking for a Senior Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large models run efficiently on custom hardware - spanning model execution, memory management, data movement, and serving integration. Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models. This is a ground-up effort with rapidly evolving hardware and software. We need a senior IC who...