MogiMogiJobsPowered by MobiusEngineLet Mogi apply

Amazon

Software Engineer-AI/ML, Inference Team - AWS Neuron

Seattle, WA · 1 month ago

On-siteFull-time

$194,400 to $194,400 a year

About the job

AWS Neuron is the complete software stack for AWS Inferentia and Trainium — AWS purpose-built accelerators for cloud-scale machine learning. Join the Machine Learning Inference Applications team to build the serving technology that lets customers run large-scale model inference fast and efficiently on Neuron chips. As an engineer on this team, you'll work on core serving technologies within open-source frameworks such as vLLM and SGLang, optimizing model serving performance on Neuron and broadening the range of models we support out of the box. Your work directly accelerates how quickly new models are enabled, shipped, and delivered to customers. Key job responsibilities - Contribute core...