43148
Schwarz IT takes care of the entire digital infrastructure and all software solutions of the companies of Schwarz Group. As a result, it is responsible for the selection, provision, operation and continuing development of IT infrastructure, IT platforms and business applications. In order to provide IT solutions that optimally support the departments’ business processes, Schwarz IT addresses the departments’ requirements in consultations and works with them to develop professional and effective IT solutions.
Your tasks
-
Develop and operate data products and data flows in the central data lakehouse for reports, analyses and machine learning and ensure their quality and future viability
- Optimise the performance of data engineering solutions, guarantee their scalability and further develop the data lakehouse architecture
- Utilise your software development skills and set new standards for development and deployment
- Ensure data quality and consistency through data validation and cleansing
- Monitor and rectify errors in the data infrastructure to minimise downtime
- Implement data security and data protection measures
- Work in interdisciplinary agile teams with data engineers, product owners and specialist departments
Your profile
-
Several years of experience in the areas of data engineering, ETL development, software engineering or big data
- Very good knowledge of the software development cycle and its best practices (e.g. CI/CD, DevOps, testing)
- Very good knowledge of Spark and Python
- Enthusiasm for the topic of data engineering and software development
- Great interest in concepts such as data mesh and data lakehouses
- Experience in cloud, containerisation, big data and streaming, ideally with MS Azure, Kubernetes, Spark and Kafka
- Analytical skills, agile mindset, independence and hands-on mentality
- Very good knowledge of English, preferably good knowledge of German
- Completed studies in computer science or talented lateral entrant
Senior Data Engineer (m/f/d)