Senior Databricks Data Engineer
Employer · Hiflylabs
Database administrator
Software developerSystems analystFlexibleFull-timeBudapest
Hiflylabs is a Budapest-based company with 250 employees. They are looking for a Senior Databricks Data Engineer to design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across major cloud environments (Azure, AWS, or GCP).
Tasks
- Design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across major cloud environments (Azure, AWS, or GCP).
- Design, build, and optimize modular data pipelines using Delta Lake to ensure data efficiency, reliability, and quality.
- Implement data governance and secure data access layers utilizing Databricks Unity Catalog.
- Write clean, efficient, and maintainable SQL and Python code within Databricks Notebooks and IDEs.
- Establish, maintain, and optimize CI/CD pipelines leveraging Declarative Automation Bundles (DABs).
- Automate and orchestrate data pipeline processes using Databricks Workflows or Spark Declarative Pipelines.
- Own and manage the technical aspects of deliveries (at least at component level).
- Participate in project planning, task estimation, testing, and liaising with business stakeholders.
Conditions & benefits
Diverse projectsIn each assignment, there is always something new, either on the technical or the business side, that helps you grow.EmpowermentTrust is a cornerstone of our culture. We'll hold your hand if you need it, but give you space if you'd like to push your limits.Flexible ways of workingWe love our location on Bartók Béla Road which is not only an office but also a community space. However, we respect our people to do their work when and how they work best.Balanced lifeWe love what we do and aim to work together with others who do their work with love.Mentoring from your first dayContinuous support is not just a set of fancy words; your mentor follows you throughout your career path.Learning & Development opportunitiesIf you want to keep learning and improving, we are on to a great track!Supportive corporate cultureIn addition to our professional success, we are proud of the social cohesion that is based on comradery, mutual support, and respect.
Requirements
- Must have proficiency in both SQL and Python, emphasizing clean, efficient, and maintainable code optimized for cloud data platforms.
- Hands-on experience utilizing AI coding tools and agents.
- Hands-on experience using Declarative Automation Bundles (DABs) to manage, bundle, and deploy Databricks resources as code.
- Solid understanding of standard CI/CD tools and version control.
- A 3-5 years of hands-on experience in data engineering, with a strong focus on Databricks Lakehouse architecture.
- Strong experience operating Databricks within at least one major cloud environment (AWS, Azure, or GCP).
- Native Hungarian and excellent written and verbal communication skills in English.