Amazon
Sr. Software Development Engineer AI/ML, Inference Model Enablement, AWS Neuron
On-siteFull-time
$261,500 to $261,500 a year
About the job
We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators. Join us to optimize the latest models to run really fast on the Trainium hardware. As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state-of-the-art open-source and customer LLMs, both dense and MoE, for inference on Trainium accelerators. You will also drive improvements in model enablement speed and experience, while advancing inference usability and quality through inference features, infrastructure optimization, tools, and automation. Key job responsibilities * Deliver high-performance models using...