Data Engineer-Enterprise Data Product
Employer · ALDI International IT Services (Hungary)
Software developer
Database administratorSystems analyst2 shiftsWeekendFlexibleFull-timePécs
We are looking for a Data Engineer to join ALDI International IT Services (Hungary) in Pécs. You will be responsible for maintaining, developing, and optimizing the global datalake environment, designing high-performance data processing pipelines, and managing scalable data integration solutions.
Tasks
- Maintain, develop, and optimize the global datalake environment, ensuring high data quality, reliability, and overall performance
- Design and implement high-performance data processing pipelines and workflows utilizing Python, Spark, and Databricks
- Manage scalable and efficient data integration and processing solutions using Azure Data Factory, Databricks, and Event Hub
- Establish robust data management processes and execute advanced data querying and quality control with SQL and big data technologies
- Automate operational tasks and support infrastructure maintenance by leveraging shell scripting and foundational UNIX knowledge
- Support data modeling initiatives for coherent structure design and document all technical processes to ensure operational continuity