Senior Databricks Data Engineer.
This mandate is run by SYMPHONI HR, a Mumbai-based executive search firm, est. 2003. Applications are email-verified and reach the search team running the role — confidentially, always.
About the organisation.
Our client is a leading global computer software organization known for delivering innovative digital solutions and data-driven insights. They operate at a significant scale, fostering a culture of technical excellence and continuous learning. The company is committed to leveraging cutting-edge cloud technologies to solve complex business challenges for a diverse international clientele.
About the role.
We are looking for a highly skilled Databricks Data Engineer to join our client's team in a hybrid capacity. You will be responsible for designing, developing, and optimizing scalable data solutions, including enterprise-grade data pipelines and Lakehouse architectures. This role is pivotal in supporting advanced analytics and AI/ML initiatives by ensuring high-performance data processing and robust governance.
What you will do.
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.
- Build and optimize data ingestion frameworks for both batch and real-time data processing.
- Implement and manage Delta Lake architectures and modern Lakehouse solutions.
- Collaborate with Data Architects, Data Scientists, and DevOps teams to deliver high-performance data solutions.
- Optimize Spark jobs, cluster configurations, and overall query performance.
- Ensure data quality, consistency, governance, and security across all data platforms.
- Automate data workflows using orchestration tools such as Airflow or Azure Data Factory.
- Mentor junior data engineers and drive engineering best practices across the team.
What you bring.
- 9-12 years of overall IT experience with a minimum of 4+ years of hands-on experience in Databricks.
- 5+ years of deep expertise in Spark and PySpark development.
- Strong proficiency in Delta Lake, Unity Catalog, and Databricks Workflows.
- Solid experience with cloud platforms such as Azure, AWS, or GCP.
- Expertise in data modeling, warehousing concepts, and real-time data processing.
- Proficiency in Python, SQL, and Shell Scripting.
- Experience with CI/CD tools like Azure DevOps, Jenkins, or Terraform.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Other open roles.
Lead System V&V Engineer — Pune · Hybrid
Lead System Engineer — Pune · Hybrid
Senior QA Data Engineer — London · Hybrid