Data Engineer – Contract – Dublin City Location: Dublin City (Hybrid) Type: Day Rate Contract Duration: 6 Months Initially Start: ASAP Sector: Data Innovation / IoT
We are partnering with a global innovation group in search of an experienced Data Engineer to join their dynamic data team on a 6-month contract (with strong potential to extend). This organisation is at the forefront of leveraging data across IoT, infrastructure, telecommunications, and mobility domains to build transformative digital products. As part of a growing data science and engineering team, you will be instrumental in shaping scalable data pipelines, implementing best-in-class DevOps practices, and working with large, diverse datasets – particularly IoT-related sources. Key Responsibilities:
Collaborate with data scientists and engineers to design, build, and maintain high-quality data pipelines using Spark and Databricks.
Implement DevOps principles using Git, automated testing, and CI/CD pipelines.
Contribute ideas for new product development and data-driven innovation across various business verticals.
Build and optimise ETL/ELT processes for structured and unstructured data.
Required Experience:
3+ years working with Databricks or similar platforms.
3+ years of experience building pipelines with Spark and developing in Python.
Strong SQL and data modelling expertise, including complex queries and warehouse design.
Solid understanding of cloud infrastructure and data warehousing.
Demonstrated experience working with IoT datasets (2–3 years minimum).
Nice to Have:
Experience with Azure Data Factory, Azure Storage, or Azure DevOps.
Familiarity with Delta Lake, Databricks Unity Catalog, or Workflows.
Exposure to unstructured data formats such as free text, images, or video.
Background in data visualisation tools like Tableau or Power BI.
Knowledge of machine learning concepts and collaboration with data science teams.