47989
Schwarz Digits creates the technological foundation for digital sovereignty in Europe. As the IT and digital division of the Schwarz Group, we develop and manage the IT infrastructures for the retail divisions Lidl and Kaufland, as well as Schwarz Production and PreZero. At the same time, we operate as an independent provider in the external market to support companies across Europe in their digital transformation. We bundle our core services in the areas of Cloud, Cyber Security, Data & AI, Communication, and Workspace.
Join us and contribute to digital sovereignty in Europe. With us, you will work at the intersection of agility and security: You will benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group.
Join us and contribute to digital sovereignty in Europe. With us, you will work at the intersection of agility and security: You will benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group.
Your Tasks
- Design and develop a solution that processes millions of data entries daily for the new Vulnerability Management Platform.
- Build and maintain scalable data pipelines (batch and real-time) to ingest high volumes of data into the data lake.
- Perform data modeling to optimize datasets and ease data consumption for stakeholders.
- Bring data analytics to production at scale, participating in architecture design.
- Collaborate with Backend and Frontend teams to implement and improve the product.
- Ensure data availability and integrity for business stakeholders.
Your Profile
- 5+ years of experience in Software Development and Big Data Frameworks.
- Strong proficiency in Python (must have) and advanced knowledge in PySpark.
- Experience building data processing pipelines (ELT) using tools such as Airflow, dbt, or Airbyte.
- Proficiency with Cloud data warehousing solutions (preferably STACKIT or AWS)
- Experience with relational (SQL) and non-relational databases (MongoDB, Redis); Neo4j is a plus
- Experience working in Agile environments
- Strong English communication skills and ability to work in a collaborative, international environment.
- Nice to Have: Cybersecurity and Vulnerability Management knowledge or experience.
- Nice to Have: Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines (Azure DevOps, Jira).
- Nice to Have:Familiarity with monitoring and visualization tools like Azure Monitoring, Grafana, and PowerBI.
- Nice to Have: Contribution to open-source projects and a passion for learning new tools.
Vulnerability & Exposure Management Data Engineer (m/f/d)