MogiMogiJobsPowered by MobiusEngineLet Mogi apply

Amazon

Sr. Software Development Engineer AI/ML, Inference Model Enablement, AWS Neuron

Cupertino, CA · 3 months ago

On-siteFull-time

$261,500 to $261,500 a year

About the job

We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators. Join us to optimize the latest models to run really fast on the Trainium hardware. As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state-of-the-art open-source and customer LLMs, both dense and MoE, for inference on Trainium accelerators. You will also drive improvements in model enablement speed and experience, while advancing inference usability and quality through inference features, infrastructure optimization, tools, and automation. Key job responsibilities * Deliver high-performance models using...