Data Engineer

Job Title: Data Engineer
Location: Dublin
Contract Duration: 6 months (Strong possibility of extension)

About the Role
We are hiring an experienced Data Engineer to join a leading AI software on a contract basis. This role will focus on building robust end-to-end data pipelines and developing a solution to translate SCADA and sensor data into a job prioritisation tool. You will work closely with cross-functional teams to deliver production-grade systems that support operational decision-making in real time.

Key Responsibilities

• Design, build, and maintain end-to-end data pipelines across varied datasets.
• Work with IoT, sensor, and SCADA system data to deliver production-ready solutions.
• Collaborate with data science teams to implement AI systems in production.
• Translate raw data and alerts into actionable outputs to support job prioritisation for utility operations.
• Ensure code quality, testing, and deployment through modern DevOps practices (CI/CD, Git, automated testing).
• Communicate clearly with stakeholders to translate technical solutions into business value.

Requirements

• 4–5 years’ experience in data engineering.
• Proven track record independently delivering production-grade pipelines.
• Minimum of 2 years’ experience with Databricks.
• Strong knowledge of IoT, sensor, and/or SCADA data integration.
• Solid experience in Python, Spark, SQL, and ETL/ELT processes.
• Familiarity with cloud infrastructure and data warehousing.
• Excellent communication and stakeholder management skills.

Nice to Have

• Experience with Azure ecosystem (ADF, Storage, Containers).
• Knowledge of delta lake, Unity Catalog, and Databricks Workflows.
• Exposure to BI/visualisation tools (e.g., PowerBI, Tableau).
• Understanding of ML and data science workflows.