Apply Now »
Schwarz IT KG is the central IT service provider and is responsible for the selection, provision, operation, and continuing development of IT infrastructure, IT platforms, and business applications. Schwarz IT provides IT services to Kaufland and Lidl, as well as to Schwarz Dienstleistung KG. In order to provide IT solutions that optimally support the departments’ business processes, Schwarz IT addresses the departments’ requirements in consultations and works with them to develop professional and effective IT solutions.

Your tasks

  • Company Environment. You are part of the Shopping Platform Data Integration Team and will be responsible for activating and modelling large datasets (100+ TB)
  • Work together. Data ingestion, CRM analytics and Business Intelligence teams. With your technical expertise you will drive best data practices across the organization and develop pipelines (real time + batch) to get the most from our data. You will also have exposition and have the change to contribute to solutions developed with machine learning technologies
  • Technologies. You work in a multi-cloud environment (GCP and Azure) with data transformation tools for the entire value chain: Data Lakes, Streams, Databricks, Functions, Orchestrators, Relational databases, etc.

Your profile

  • Educational background. You have completed your Bachelor or Master studies in Computer Sciences, Software Development or in a similar field
  • Professional background. 4+ Experience in software development, 2+ experience in big data frameworks (Spark, Kafka, Kubernetes, Hive). Contribution in open-source projects is a plus
  • Development. You have experience in Python (required), Scala (preferred) and SQL. Also, .NET or Java are appreciated. Experience in agile software development and software development life cycle is also valued
  • DevOps. You have experiences in CI/CD flows & tools. Azure DevOps is appreciated.
  • Data bases. relational and non-relational (e.g., MongoDB, ELK, Cassandra)
  • Curious mindset. You are interested in making sense of (un)structured datasets, basic ETL processes are in your toolbox. We will value your experience in machine learning tools as well (scikit-learn, pandas, spark ML, mlflow…)

What You'll receive

  • Team. Work in a motivated and collaborative international team.
  • We. You will experience an appreciative and interactive atmosphere with a culture of open doors
  • Further training. You can expect individual offers for personal and professional development
  • Security. You will benefit from a secure job in a dynamic retail company
  • Flexibility. With the possibility to work 100% from home, you can choose what works best for you

Data Engineer Ingestion & Devops (m/w/d)

IT - Business & Artificial Intelligence
Neckarsulm (hybrid)
Full-time / Part-time
4_VI

Apply Now »