Expert Developer – Data Analytics & Data Engineering - REF5086I
Employer · Deutsche Telekom IT Solutions
Budapest
At BDA_CDI HUB, we provide comprehensive IT solutions for T-Systems in the areas of data management, analytics, visualization, and process automation. Our expertise spans from self-service analytics platforms to enterprise-wide data warehouse and analytics solutions. We are evolving our traditional data warehouse landscape into a centralized T-Systems Lakehouse architecture to optimize and enhance efficiency.
Tasks
- Design IT platforms, processes, and organizational structures for our evolving Lakehouse on Azure, leveraging Databricks, Data Factory, Data Lake Storage, Event Hub, and other cutting-edge technologies.
- Develop sustainable architectures, prototype solutions, and evaluate new technologies to drive innovation.
- Support engineering teams in platform architecture development and coach them toward independent solution design.
- Ensure data protection and security when handling business-critical and personal data.
- Collaborate with the team to enhance platform architecture, establish principles, patterns, and best practices.
Requirements
- Degree in (Business) Informatics, Business Administration, or equivalent practical experience.
- At least 5 years of experience in data engineering architecture.
- Minimum 5 years of hands-on experience with Databricks & Delta Lake on Azure services.
- Proven expertise in migrating from traditional data warehouse solutions to modern data platforms like Lakehouse & Delta Lake.
- Strong experience in modern data platform and data warehousing architectures.
- Deep knowledge of data lake storage organization and architecture.
- Solid understanding of relational and multidimensional database systems.
- Proficiency in data warehouse modeling methods (Kimball, Inmon, Data Vault).
- Experience with data pipelines using Spark Structured Streaming and Delta Lake.
- Strong programming skills in SQL, Python, and Spark.