Architect and productionize AI systems that power risk scoring, classifier-level reasoning, explainability narratives, and intelligent recommendations across multi-tenant SaaS environments. Own model evaluation and guardrails, defining offline/online metrics (precision, recall, risk calibration, hallucination control), building evaluation harnesses, and implementing responsible AI safeguards.
Responsibilities
Design and build GenAI pipelines (RAG + agentic orchestration) including indexing, embedding strategies, retrieval optimization, prompt frameworks, tool integration, and memory/control flows tailored for security use cases. Optimize model trade-offs (latency, cost, accuracy, safety) and deploy scalable inference systems with monitoring, drift detection, and feedback loops from customer signals. Partner with Product and Engineering to translate ambiguous security requirements into reliable AI-native workflows that are simple, trustworthy, and adoption-ready for SMB/SMC and Enterprise customers.
Required Qualifications
8+ years of experience building and deploying machine learning systems in production environments. Strong hands-on experience with LLMs, RAG architectures, and applied Generative AI systems, including prompt design and grounding techniques. Proven expertise in designing end-to-end ML pipelines (data ingestion → feature engineering → training → evaluation → serving). Experience defining and operationalizing offline and online evaluation frameworks (precision/recall, calibration, drift detection, A/B testing) and implementing guardrails for reliability and safety. Strong programming skills in Python, with experience in modern ML frameworks (e.g., PyTorch/TensorFlow) and cloud-based ML infrastructure; experience building multi-tenant SaaS AI systems with attention to scalability, latency, and cost optimization. Experience fine-tuning or adapting foundation models (e.g., LoRA/PEFT) and building agentic orchestration systems is preferred; knowledge of data security, compliance, or risk-scoring domains will be an additional advantage.
Original Posting
This role is sourced from Microsoft. Apply on Microsoft careers page