Experience: 0 – 2 years
Expected CTC: 6 LPA – 10 LPA
Cencora is hiring for the role of Data Engineer I!
Responsibilities of the Candidate:
- Designing, developing, testing, deploying, and maintaining data processing systems.
- Building scalable data pipelines using Azure Data Factory to extract, transform, and load structured as well as unstructured data.
- Implementing secure storage and access controls for sensitive data using Azure Key Vaults.
- Leveraging Azure Databricks for advanced analytics tasks including ETL jobs and machine learning workflows.
- Utilizing Spark fundamentals to optimize the performance of big data processing tasks.
- Collaborating with cross-functional teams to understand business requirements and translate them into technical solutions.
- Ensuring data quality by implementing appropriate validation checks and error-handling mechanisms.
- Working closely with DevOps teams to integrate data engineering processes into CI/CD pipelines.
- Monitoring the performance of data pipelines and troubleshooting any issues that arise.
- Documenting technical specifications, processes, and best practices.
Requirements:
- Bachelor’s degree in Computer Science or related field (or equivalent work experience)
- Proven experience as a Data Engineer or similar role working on large-scale projects
- Expertise in Azure services such as Data Factory, Key Vaults, and Databricks (Auto Loader, Unity Catalog, Workflows)
- Proficiency in Spark fundamentals for efficient big data processing
- Solid knowledge of version control systems like Git/ADO for managing codebase changes
- Strong understanding of SQL for querying relational databases efficiently
- Experience with Python programming language for scripting ETL processes and automating tasks
- Familiarity with CI/CD concepts and practices in the context of data engineering workflows
- Familiarity with legacy ETL tools such as SSIS, and Informatica
- Excellent problem-solving skills with attention to detail
