Responsibilities:
We are looking for an experienced Senior Data Engineers for our Information Technology (IT) division who can play a pivotal role in supporting the company's global operations across various sectors.
In this role, you will be responsible for the application management of a B2C application to meet the agreed Service Level Agreements (SLAs) and fulfil customer expectations.
We are seeking hands-on Senior Data Engineers with strong experience in Azure (ADF + ADO) + Databricks + Python.
Responsibilities:
- You need to build, test, debug, integrate and sustainably deploy data pipelines/ETL logic using ADF, Databricks, and Azure DevOps
- You should have hands-on experience with Azure DevOps, including managing repositories, performing push and pull requests, creating and reviewing pull requests, working CI/CD pipelines.
- You should be proficient in debugging build and release issues, troubleshooting data pipelines (ADF) and managing dependencies by importing and configuring the correct libraires
- Responsible for developing, maintaining and optimizing data structures in a data lake platform (data preparation, data ingestion, resource development, data quality)
- You need to conduct data integration across on-prem, cloud and hybrid infrastructure based on architectural decisions.
- You need to derive data model and architecture for the application.
- You will be responsible for implement security and privacy guidelines based on client’s standards
- Need to work on coding and development standards.
Requirements:
- Education and Experience: A bachelor’s or master’s degree in a relevant field, with a minimum of 5+ years of professional experience or equivalent work experience.
- Excellent English Communication, presentation, and interpersonal skills, with the ability to engage and collaborate with stakeholders.
- • Strong knowledge for skill sets given below. Certifications in these skills are added advantage.
Azure Data Factory and Azure Devops
Databricks
Python
Years of Experience
5+ experience
Notice Period – Immediate