Senior Data Engineer
Employer · DSS Consulting Zrt.
Software developer
Database administratorSystems analystPest
We are looking for an experienced Senior Data Engineer to join our partner's team, someone who would enjoy developing modern cloud-based data platforms and building enterprise data infrastructure. In this role, you will have the opportunity to design, develop, and optimize complex data processing pipelines, primarily in an AWS-based Data Lakehouse environment.
Tasks
- Design, development, and maintenance of scalable and reliable ETL/ELT data pipelines using AWS services (Glue, Lambda, Step Functions, EMR).
- Building and supporting Data Lake, Data Warehouse, and streaming data processing solutions (S3, Redshift, Kinesis, Athena).
- Optimizing data processing pipelines for performance, stability, and cost-efficiency.
- Enforcing data security, access management, encryption, and compliance requirements.
- Ensuring data quality by applying validation, testing, and monitoring solutions.
- Professional support and mentoring of Junior Data Engineer colleagues.
- Leading code reviews and technical discussions, establishing and applying development best practices.
- Supporting the implementation of modern data processing tools, frameworks, and automation solutions.
- Collaborating with Data Science, BI, Analytics, and development teams to serve business data needs.
- Supporting business intelligence solutions by providing efficient data integration and access options.
Requirements
- At least 5 years of experience in Data Engineering, with a minimum of 3 years working with AWS-based, cloud-native data solutions.
- Confident, advanced-level knowledge of SQL and Python for data processing and transformation tasks.
- Practical experience with the following AWS services: S3, Glue, Lambda, Redshift, Athena, Kinesis, Step Functions, EMR, CloudWatch.
- Knowledge of data modeling solutions, partitioning techniques, and performance optimization methods.
- Experience in scheduling data processing pipelines and using orchestration tools.
- Knowledge of data security, Data Governance, and data protection regulations.
- Higher education or relevant professional experience in a similar role.
- Independent, proactive working style and quick learning ability.
- Structured thinking, good problem-solving skills.
- Effective management of multiple parallel tasks.
- Excellent written and verbal communication in Hungarian.
- Confident command of English required for the job.
- Collaborative attitude and openness to sharing professional knowledge.