Lead Azure Data Engineer

The Offer

• A role that offers a breadth of learning opportunities
• Flexible working options

The Job

You will be responsible for :

• Design, build, and maintain data pipelines using company standard technologies
• Understand and be able to manage cloud-based data technologies and applications
• Assist with renovating the data management infrastructure to drive automation in data integration and management
• work with data architects and data services team members to refine data requirements for various data and analytics initiatives
• Develop data ingestion, preparation, and integration code
• Create algorithms to convert data into actionable, useful information
• Prepare refined data to be used by data scientists
• Create clear and maintainable ETL code
• Investigate ways to increase data reliability, efficiency, and quality
• Enable advanced analytics, AI/machine learning, and statistical methods
• Collaborate well with business process experts, software engineers, QAs, delivery leads, product owners, and other relevant stakeholders
• Work with the Data Services team to follow and maintain company practices and security requirements in the data space

The Profile

Experience/Skills

• Experience in data engineering or a related field
• Advanced analytical skills and attention to detail
• Able and willing to collaborate in a team environment and exercise independent judgment
• Excellent verbal and written communication skills
• Knowledge of analytic technologies including machine learning, AI and integration technologies
• Good knowledge of Azure capabilities (Data Factory, Databricks, Data Lake, Azure Functions, etc.), SQL, Python, relational and non-relational Data Stores
• Familiarity with data virtualization technologies
• SAP experience helpful
• Knowledge and experience using Azure DevOps or comparable tools for code and release management
• Strong problem-solving skills and using innovation to find solutions
• Experience in integrating complex processes and information strategies, and/or designing strategic metrics and scorecards.
• Agricultural industry experience is desirable, but not required.

Education: A bachelor’s degree in computer science, data science, information science or related field, or equivalent work experience.

The Employer

Our client provides full-service solutions for mid-market and enterprise organizations.