Lead Databricks Data Engineer.
This mandate is run by SYMPHONI HR, a Mumbai-based executive search firm, est. 2003. Applications are email-verified and reach the search team running the role — confidentially, always.
About the organisation.
Our client is a leading global computer software organization known for delivering innovative data-driven solutions. They operate at a significant scale, supporting complex enterprise ecosystems for a diverse range of international clients. The company fosters a culture of technical excellence, continuous learning, and collaborative problem-solving.
About the role.
We are seeking a highly experienced Lead Databricks Data Engineer to spearhead the design, development, and modernization of enterprise-scale data platforms. You will leverage the Databricks Lakehouse architecture to build scalable, cloud-native data ecosystems that empower advanced analytics and AI/ML initiatives. This role combines hands-on technical architecture with strategic leadership, requiring you to mentor teams and define engineering standards across the organization.
What you will do.
- Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
- Architect and develop scalable ETL/ELT data pipelines for both batch and real-time processing.
- Lead the implementation of Delta Lake, Unity Catalog, and robust data governance frameworks.
- Establish engineering best practices, coding standards, and architecture guidelines for the data team.
- Drive cloud data platform modernization and migration initiatives across Azure, AWS, or GCP.
- Mentor and guide Data Engineers and technical leads to foster a culture of high performance.
- Partner with business stakeholders to translate strategic requirements into scalable technical solutions.
- Ensure data quality, security, and compliance through rigorous monitoring and observability practices.
What you bring.
- 12-15 years of overall IT experience with a minimum of 6+ years of hands-on Databricks experience.
- 7+ years of experience in Spark/PySpark-based data engineering.
- Proven expertise in designing enterprise-scale Data Lake and Lakehouse solutions.
- Strong proficiency in Python, SQL, and cloud-native data services (Azure, AWS, or GCP).
- Deep understanding of data warehousing concepts, dimensional modeling, and data governance.
- Experience leading large-scale data transformation and modernization programs.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Strong communication skills with the ability to present architectural decisions to leadership.
Other open roles.
Delivery Manager — Pune · Hybrid
Senior Databricks Data Engineer — Bengaluru · Hybrid
Lead System V&V Engineer — Pune · Hybrid