Job Title: Data Engineer Location: Dublin Contract Duration: 6 months (Strong possibility of extension)
About the Role We are hiring an experienced Data Engineer to join a leading AI software on a contract basis. This role will focus on building robust end-to-end data pipelines and developing a solution to translate SCADA and sensor data into a job prioritisation tool. You will work closely with cross-functional teams to deliver production-grade systems that support operational decision-making in real time.
Key Responsibilities
Design, build, and maintain end-to-end data pipelines across varied datasets.
Work with IoT, sensor, and SCADA system data to deliver production-ready solutions.
Collaborate with data science teams to implement AI systems in production.
Translate raw data and alerts into actionable outputs to support job prioritisation for utility operations.
Ensure code quality, testing, and deployment through modern DevOps practices (CI/CD, Git, automated testing).
Communicate clearly with stakeholders to translate technical solutions into business value.
Requirements
4–5 years’ experience in data engineering.
Proven track record independently delivering production-grade pipelines.
Minimum of 2 years’ experience with Databricks.
Strong knowledge of IoT, sensor, and/or SCADA data integration.
Solid experience in Python, Spark, SQL, and ETL/ELT processes.
Familiarity with cloud infrastructure and data warehousing.
Excellent communication and stakeholder management skills.
Nice to Have
Experience with Azure ecosystem (ADF, Storage, Containers).
Knowledge of delta lake, Unity Catalog, and Databricks Workflows.
Exposure to BI/visualisation tools (e.g., PowerBI, Tableau).