Duration:
4 months to start
Position Overview
We are seeking a highly skilled Azure Databricks Developer to join our data engineering team. The ideal candidate will have hands-on experience designing, building, and optimizing scalable data pipelines and analytics solutions on Azure. You will work closely with data engineers, architects, and business stakeholders to enable advanced analytics and reporting capabilities.
Key Responsibilities
- Design, develop, and optimize data pipelines and ETL/ELT processes using Azure Databricks and PySpark.
- Integrate and orchestrate data workflows using Azure Data Factory (ADF).
- Implement data modeling and analytics solutions with Azure Synapse Analytics.
- Collaborate with data architects and analysts to ensure alignment with business requirements.
- Optimize performance of Spark jobs and data pipelines for large-scale data processing.
- Ensure best practices for data governance, security, and compliance within the Azure ecosystem.
- Troubleshoot and resolve issues related to data ingestion, transformation, and integration
Required Skills & Qualifications
- 8+ years of Proven hands-on experience with Azure Databricks and PySpark for big data processing.
- 5+ years of experience of Azure Data Factory (ADF) for pipeline orchestration and integration.
- 3+ years of Experience with Azure Synapse Analytics for data warehousing and advanced analytics.
- 5+ years of experience in Python and SQL for data manipulation and transformation.
- 8+ years of exposure to data modeling, ETL processes, and performance tuning.
- 3+ years of experience working with CI/CD, Git, and DevOps practices in a data engineering context.
- 5+ years of experience in problem-solving, communication, and collaboration skills.
- Experience with Snowflake for cloud-based data warehousing.
- Knowledge of data lakehouse architectures.
- Exposure to other cloud platforms (AWS, GCP) is a plus.
- Bachelor’s or Master’s degree in Computer Science, Information Systems, Data Engineering, or related field.
- 8+ years of relevant experience in data engineering, with at least 5+ years working with Azure Databricks.
#LI-Remote
