Amazon
Sr. Software Development Engineer, Inference Team - AWS Neuron
On-siteFull-time
$227,400 to $227,400 a year
About the job
AWS Neuron is the complete software stack for AWS Inferentia and Trainium, AWS purpose-built accelerators for cloud-scale machine learning. This senior software engineering role is part of the Machine Learning Inference Applications team and focuses on delivering high-performance model inference solutions for customer workloads running on Inferentia- and Trainium-powered instances. The engineer will lead the development of core serving technologies within open-source frameworks (such as vLLM and SGLang) to enable customers to serve large-scale inference efficiently on AWS Neuron. The engineer will also drive excellence in inference framework optimization and engineering best practices. The...