
Die Schwarz IT KG ist als zentraler IT-Dienstleister für Auswahl, Bereitstellung und Betrieb sowie Weiterentwicklung von IT-Infrastrukturen, IT-Plattformen und Business-Anwendungen zuständig. Damit erbringt die Schwarz IT sowohl für Kaufland und Lidl als auch für die Schwarz Dienstleistung KG IT-Dienstleistungen. Um die Fachbereiche durch IT-Lösungen optimal bei deren Geschäftsprozessen zu unterstützen, nimmt die Schwarz IT Anforderungen der Fachbereiche in Beratungsgesprächen auf und erarbeitet gemeinsam mit diesen professionelle und leistungsfähige IT-Lösungen.
Your tasks
- Company Environment. You are part of the Shopping Platform Data Integration Team and will be responsible for activating and modelling large datasets (100+ TB)
- Work together. Data ingestion, CRM analytics and Business Intelligence teams. With your technical expertise you will drive best data practices across the organization and develop pipelines (real time + batch) to get the most from our data. You will also have exposition and have the change to contribute to solutions developed with machine learning technologies
- Technologies. You work in a multi-cloud environment (GCP and Azure) with data transformation tools for the entire value chain: Data Lakes, Streams, Databricks, Functions, Orchestrators, Relational databases, etc.
Your profile
- Educational background. You have completed your Bachelor or Master studies in Computer Sciences, Software Development or in a similar field
- Professional background. 4+ Experience in software development, 2+ experience in big data frameworks (Spark, Kafka, Kubernetes, Hive). Contribution in open-source projects is a plus
- Development. You have experience in Python (required), Scala (preferred) and SQL. Also, .NET or Java are appreciated. Experience in agile software development and software development life cycle is also valued
- DevOps. You have experiences in CI/CD flows & tools. Azure DevOps is appreciated.
- Data bases. relational and non-relational (e.g., MongoDB, ELK, Cassandra)
- Curious mindset. You are interested in making sense of (un)structured datasets, basic ETL processes are in your toolbox. We will value your experience in machine learning tools as well (scikit-learn, pandas, spark ML, mlflow…)
What You'll receive
- Team. Work in a motivated and collaborative international team.
- We. You will experience an appreciative and interactive atmosphere with a culture of open doors
- Further training. You can expect individual offers for personal and professional development
- Security. You will benefit from a secure job in a dynamic retail company
- Flexibility. With the possibility to work 100% from home, you can choose what works best for you
Data Engineer Ingestion & Devops (m/w/d)
IT - Business & Artificial Intelligence
Neckarsulm (hybrid)
Vollzeit / Teilzeit
4_VI