Senior Data Engineer

Development Hands-on, sleeves-up design, modeling, development, and delivery are expected as a matter of course. Strong working knowledge of Azure cloud services and components, and the ability to stitch together various components to build a scalable, reliable, and sustainable data analytics solution. Production experience working with CI/CD pipelines across Azure products. Ability to debug and support production issues working with cross-functional teams. Key knowledge of architecture and deployment patterns across code and infrastructure development. Work closely with the Product Owner and business stakeholders to implement solutions as per the identified requirements Delivery Ensure project goals are achieved with quality and on time in alignment with the stakeholders expectations. Ability to work on complex projects and in a distributed environment. Identify issues/roadblocks and escalate when necessary and promptly Work in close collaboration with other team members and actively participate in Scrum ceremonies to ensure successful Agile ways of working of the team Individuals will work as part of a product-centric delivery team(s) that will deliver value independently while fully embracing integrated DevOps approaches. Take ownership of the delivery/development projects and help steer until completion. Governance Maintain governance that allows projects and stakeholders to manage overall project performance and manage program risks within the global nature of some of the programs. Ensure appropriate product documentation is maintained to comply with ITSM standards. Forward looking Remain flexible towards technological approaches to ensure we are taking advantage of modern technologies. Keep abreast of industry developments in analytics and interpret how these would impact services and present new opportunities. Quality, Risk & Compliance: Ensure all risks, blockers and issues associated with owned tasks are promptly recorded and managed in the appropriate Risk & Issue logs. Technical Architecture Be conversant with technical architecture to contribute to design discussions in partnership with the Delivery/Development Lead and dedicated Analytics & Data Architect. Required Experience & Qualifications (Apply if ) BS degree in Computer Science, Information Technology, Data Science, or equivalent experience, with a preference on experience and proven track record. An ideal candidate would have a hands-on work history in an advanced, recognized, and innovative environment. 5+ year of experience in working in a product-oriented cross-functional squads with a Business Product Owner - specific to developing, owning, and extending data analytics products 3+ years of hands-on experience on Azure data analytics stack: Databricks, Data Factory, SQL DW, Cosmos DB, Power BI, Power Apps, AKS, etc Seasoned coder in the relevant languages: Python, SQL, PySpark etc Fully conversant with big-data processing approaches and "schema-on-read" methodologies. Preference for a deep understanding of Spark, Databricks, and Delta Lake and applying them to solve analytics, data science and machine learning business problems. Experience with Agile delivery frameworks and tools: SAFe, Jira, Confluence, Azure DevOps, etc Ability to work in close partnership with groups across the IT organization (security, compliance, infrastructure, etc) and business stakeholders in the commercial organizations. The ideal candidate possesses excellent communication skills and the ability to communicate inherently complicated technical concepts to non-technical stakeholders of all levels. Nice to have: Experience in developing and maintaining internal data engineering libraries Experience integrating and supporting various enterprise data tools such as Azure Data Factory (ADF), Talend, Collibra, Azure Synapse, Snowflake, etc Experience articulating the business value of analytics projects and progressing solutions from MVP to scaled-up production solutions. Familiar with deploying enterprise analytics solutions at scale with applicable services: administration, qualification, and user access provisioning. Optional experience with data visualization tools such as MS PowerBI, Tableau, ThoughtSpot etc Any Data Engineering/Software certifications such as Azure Data Engineer, Databricks Lakehouse Data Engineer Associate/Professional etc