At the Schwarz IT Hub in Barcelona we offer high value IT services for the entire companies of Schwarz Group, which includes Lidl, Kaufland, Schwarz Produktion and PreZero. We develop and implement smart and efficient IT solutions to deliver the best experience for companies of Schwarz Group’s global day-to-day business. As a central IT service provider, Schwarz IT is responsible for the selection and provision of IT infrastructure, IT platforms and business applications. By continuously taking into account current technological developments, Schwarz IT identifies innovative options for action. In close cooperation with the departments, Schwarz IT develops professional and efficient IT solutions.

Take advantage of the opportunities to progress your career at the Barcelona location.


Big Data Engineer (m/f/d)


Primary mission:


As a Big Data Engineer, you will contribute to bring data analytics to production at scale in LIDL. Taking part on data teams building data platforms or data products together with data science and data management teams.


Core activities:


  • Data Operations (Exploring, Provisioning, Cleaning, and Testing).
  • Deployment of data infrastructure.
  • Integration and implementation of data solutions in our current Platform.
  • Leading PoC for evaluating new data products.
  • Providing support to other teams in the Data Domain (enable the data integration).


Technical stack:


  • Required:
    • Languages: Python and SQL
    • Big Data Frameworks: Databricks, Spark
    • Data Base: relational (SQL Server)
    • CI/CD flows & tools: Azure DevOps


  • Appreciated
    • Languages: Java or Scala, Golang.
    • Big Data Frameworks: Azure Data Stack.
    • Deployment of applications in Kubernetes (not the administration).
    • Data Base: non-relational (MongoDB, ELK, Cassandra…).
    • IaC: Terraform.
    • Monitoring and alerting tools: Azure Monitoring, Grafana
    • Experience in Agile methodology.


Soft skills and competencies:


  • Passion for learning new tools, languages and frameworks
  • Ability to be creative and innovation-minded, self-motivated and proactive.
  • Fast adaptation to changing requirements and strong problem-solving skills.
  • To work in a collaborative model, side by side with the business
  • Fluency in English to work in a multi-cultural environment




  • MS’s degree in Computer Science, Engineering, or related field
  • 4+ years’ experience in Big Data environments.
  • 2+ years’ experience in definition of Big Data solutions.
  • As a bonus, contribution to open-source projects

Big Data Engineer (m/f/d)

IT - BI, AI & Data

Apply Now »