Senior Databricks Data Engineer
Employer · Hiflylabs
Software developer
Database administratorSystems analystFlexibleFull-timeBudapest
Hiflylabs is looking for a Senior Databricks Data Engineer to join their Budapest-based team. You will be responsible for designing, developing, and implementing complex, scalable Lakehouse solutions on the Databricks platform across major cloud environments.
Tasks
- Design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform.
- Design, build, and optimize modular data pipelines using Delta Lake.
- Implement data governance and secure data access layers utilizing Databricks Unity Catalog.
- Write clean, efficient, and maintainable SQL and Python code within Databricks Notebooks and IDEs.
- Develop automation scripts leveraging the Databricks CLI and REST APIs.
- Establish, maintain, and optimize CI/CD pipelines.
- Automate and orchestrate data pipeline processes using Databricks Workflows or Spark Declarative Pipelines.
- Deliver solutions centered on the Databricks ecosystem, integrating seamlessly with cloud-native storage and security services.
- Design and implement modern data modeling and data warehousing solutions using Databricks SQL Warehouses.
- Own and manage the technical aspects of deliveries.
- Participate in project planning, task estimation, testing, and liaising with business stakeholders.
- Create comprehensive technical documentation.
Conditions & benefits
Diverse projectsIn each assignment, there is always something new, either on the technical or the business side, that helps you grow.EmpowermentTrust is a cornerstone of our culture. We'll hold your hand if you need it, but give you space if you'd like to push your limits.Flexible ways of workingWe love our location on Bartók Béla RoadStreet which is not only an office but also a community space. However, we respect our people to do their work when and how they work best.Balanced lifeWe love what we do and aim to work together with others who do their work with love. Forget about pointless meetings and unnecessary administration.Mentoring from your first dayContinuous support is not just a set of fancy words; your mentor follows you throughout your career path.Learning & Development opportunitiesIf you want to keep learning and improving, we are on to a great track to help you unlock your potential.Supportive corporate cultureSocial cohesion based on comradery, mutual support, and respect.
Requirements
- Must have proficiency in both SQL and Python, emphasizing clean, efficient, and maintainable code.
- Hands-on experience utilizing AI coding tools and agents.
- Experience with API integration and scripting for platform automation.
- Hands-on experience using Declarative Automation Bundles (DABs).
- Solid understanding of standard CI/CD tools and version control.
- 3-5 years of hands-on experience in data engineering, with a strong focus on Databricks Lakehouse architecture.
- Proven track record of delivering at least one complex, scalable data solution utilizing core Databricks features.
- Strong experience operating Databricks within at least one major cloud environment (AWS, Azure, or GCP).
- Native Hungarian and excellent written and verbal communication skills in English.