Machine Learning Engineer / SME (LLM Eval & RAG Testing) - SME | TS/SCI

McLean, VA · 2 days ago

About the job

Active TS/SCI required. U.S. citizenship required. Location: On-site in McLean, VA (Full-Time). Prove which LLMs actually work for the mission. You'll design RAG and LLM evaluation experiments, tune models on custom data, and run GPU-accelerated benchmarks so the team ships AI systems they can trust. What you'll do • Test, evaluate and validate AI systems with a focus on LLM-based systems (including RAG testing) • Design and run experiments that benchmark LLMs against defined measures • Tune neural networks / LLMs on custom datasets and apply results to concrete use cases • Build AI/ML models and ensembles in Python or R (library selection, preprocessing, model assessment) • Use deep...