Amazon
Software Engineer II - AI/ML, Neuron Inference, Neuron Inference
On-siteFull-time
$223,600 to $223,600 a year
About the job
The Annapurna Labs team at Amazon Web Services (AWS) builds the AWS Neuron SDK, the software development kit used to accelerate deep learning and GenAI workloads on AWS Trainium machine learning accelerators. The Neuron Inference organization is at the forefront of optimizing inference performance for a wide range of ML models and model architectures on AWS's custom ML accelerators. We are working across the stack from PyTorch to the hardware-software boundary, our engineers build systematic infrastructure, develop high-performance kernels for ML functions, ensuring every compute unit is fine-tuned for optimal performance for our customers' demanding workloads. We combine deep hardware...