– Evaluate model behavior on relevance, bias, hallucination, and response quality via offline evaluations, shadow experiments, online experiments, and ROI analysis. – Translate research into production-ready solutions and measure their impact through A/B testing and telemetry that address customer needs. Ability to use data to identify gaps in AI quality, uncover insights, and implement PoCs to show proof of concepts.
Responsibilities
Build collaborative relationships with product and business groups to deliver AI-driven impact Research and implement state-of-the-art using foundation models, prompt engineering, RAG, graphs, multi-agent architectures, as well as classical machine learning techniques. Fine-tune foundation models using domain-specific datasets. Build rapid AI solution prototypes, contribute to production deployment of these solutions, debug production code, and support MLOps/AIOps. Contribute to papers, patents, and conference presentations.
Required Qualifications
Bachelor's degree in computer science, Statistics, Electrical/Computer Engineering, Physics, Mathematics or related field AND 2+ years of experience in AI/ML, predictive analytics, or research - OR Master's degree AND 2+ years of experience 1+ years of experience with generative AI OR LLM/ML algorithms
Original Posting
This role is sourced from Microsoft. Apply on Microsoft careers page