MogiMogiJobsPowered by MobiusEngineLet Mogi apply

Amazon

Software Development Engineer I, Inference models optimization, AWS Neuron Inference

Cupertino, CA · 1 week ago

On-siteFull-time

$185,000 to $185,000 a year

About the job

The Annapurna Labs team at Amazon Web Services (AWS) builds the AWS Neuron SDK, the software development kit used to accelerate deep learning and GenAI workloads on AWS Trainium machine learning accelerators. The Neuron Inference organization is at the forefront of optimizing inference performance for a wide range of ML models and model architectures on AWS's custom ML accelerators. We are working across the stack from PyTorch to the hardware-software boundary, our engineers build systematic infrastructure, develop high-performance kernels for ML functions, ensuring every compute unit is fine-tuned for optimal performance for our customers' demanding workloads. We combine deep hardware...