‘* Design, implement, monitor, and optimize large-scale, robust data pipelines and architectures that support products data analytics initiatives. Data Governance & Trust: Enforce best practices for data quality, lineage, security, and compliance. Cross-functional Collaboration: Work closely with product managers, software engineers, AI researchers, and business stakeholders to build data solutions that accomplish business goals. Design, architect, and implement backend, and service components t…
Responsibilities
Develop scalable ETL/ELT workflows, ensure reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources with different schemas. Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring analytics are accurate and auditable. Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information. Translate ambitious vision into actionable roadmaps and measurable outcomes.
Required Qualifications
7+ years of experience in Software Development. 2+ years of experience designing, developing, deploying, and monitoring cloud services/RESTful service/Distributed system. Exposure to AI/LLM integration, function calling, or semantic retrieval systems is highly desirable. Ability to write clean, working code using core algorithms, data structures, and analytics oriented problem solving. Extensive experience in implementing and optimizing data pipelines and distributed data systems (e.g., Azure Data Lake, Spark, Synapse, SQL databases). Understanding of data governance, privacy, lineage, and security best practices, especially within highly regulated or enterprise environments. Excellent communication skills to convey complex technical concepts to both technical and non-technical audiences. Expertise with modern data engineering languages and frameworks (e.g., Azure Data Explorer, PySpark, SQL, etc). Experience collaborating in cross-functional teams and building consensus among stakeholders with diverse backgrounds (engineering, analytics, product, business). Track record of driving innovation in data engineering, including experience leading technical projects and mentoring others. MSC IDC This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. *
Original Posting
This role is sourced from Microsoft. Apply on Microsoft careers page