Application with Xing
Application with LinkedIn
47989
Join Schwarz IT Barcelona - IT Hub of Europe's Largest Retail Group.
At Schwarz IT Barcelona, we provide high value IT services for the entire Schwarz Group, which includes Lidl, Kaufland, Schwarz Produktion, PreZero, Schwarz Digits, STACKIT, and XMCyber.
As part of a top 5 global retail company, we serve 6 billion customers through 13,700 stores in 32 countries, supported by over 575,000 employees.
We are looking for open-minded colleagues with passion for technology, who are willing to find diverse and exciting career opportunities in a dynamic work environment that stands for development and progress.
Elevate your career with us, where development and progress are at the heart of everything we do.
At Schwarz IT Barcelona, we provide high value IT services for the entire Schwarz Group, which includes Lidl, Kaufland, Schwarz Produktion, PreZero, Schwarz Digits, STACKIT, and XMCyber.
As part of a top 5 global retail company, we serve 6 billion customers through 13,700 stores in 32 countries, supported by over 575,000 employees.
We are looking for open-minded colleagues with passion for technology, who are willing to find diverse and exciting career opportunities in a dynamic work environment that stands for development and progress.
Elevate your career with us, where development and progress are at the heart of everything we do.
Your Tasks
- Design and develop a solution that processes millions of data entries daily for the new Vulnerability Management Platform.
- Build and maintain scalable data pipelines (batch and real-time) to ingest high volumes of data into the data lake.
- Perform data modeling to optimize datasets and ease data consumption for stakeholders.
- Bring data analytics to production at scale, participating in architecture design.
- Collaborate with Backend and Frontend teams to implement and improve the product.
- Ensure data availability and integrity for business stakeholders.
Your Profile
- 5+ years of experience in Software Development and Big Data Frameworks.
- Strong proficiency in Python (must have) and advanced knowledge in PySpark.
- Experience building data processing pipelines (ELT) using tools such as Airflow, dbt, or Airbyte.
- Proficiency with Cloud data warehousing solutions (preferably STACKIT or AWS)
- Experience with relational (SQL) and non-relational databases (MongoDB, Redis); Neo4j is a plus
- Experience working in Agile environments
- Strong English communication skills and ability to work in a collaborative, international environment.
- Nice to Have: Cybersecurity and Vulnerability Management knowledge or experience.
- Nice to Have: Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines (Azure DevOps, Jira).
- Nice to Have:Familiarity with monitoring and visualization tools like Azure Monitoring, Grafana, and PowerBI.
- Nice to Have: Contribution to open-source projects and a passion for learning new tools.
Data Engineer (m/f/d)