Senior Data Engineer ? Dublin
Hybrid ? 3 days onsite in Dublin
We?re looking for a Senior Data Engineer with7+ years of end-to-end data engineering experienceand4+ years working extensively with Snowflaketo help advance a next-generation platform that empowers global financial institutions to assess crypto activity, monitor transaction flows, and understand AML exposure. You?ll work hands-on with Snowflake, and cloud-native tooling to build resilient data pipelines while also owning automated testing and quality assurance practices.
What You?ll Do
Data Engineering & Platform Architecture
- Lead the design and development of scalable pipelines usingSnowflake as a core data platform, complemented by Spark, Hadoop, NiFi, and related technologies.
- Architect high-performance workflows and storage patterns for large, sensitive financial datasets.
- Deliver clean, maintainable Python and SQL code that adheres to modern engineering best practices.
- Embed data governance, lineage tracking, and metadata management into all pipeline solutions.
Data Quality Engineering & Automated Testing
- Build and maintain automated frameworks to validate ETL/ELT processes and transformation logic.
- Define and execute data quality checks, reconciliation routines, regression testing, and schema validations.
- Conduct unit, integration, and full end-to-end testing for new and existing pipelines.
- Use tools such as dbt tests and Python-based utilities to implement robust validation mechanisms.
Cross-Team Collaboration & Agile Execution
- Partner with engineering, product, and data science teams to ensure quality is integrated throughout the development lifecycle.
- Participate in agile ceremonies, helping the team prioritize work that improves reliability and delivery speed.
- Support production systems by rapidly diagnosing data inconsistencies and contributing to root-cause analysis.
Innovation & Continuous Improvement
- Stay up to date on the latest advancements in data engineering, Snowflake capabilities, and automated testing frameworks.
- Mentor junior engineers, promote best practices, and elevate the overall engineering quality within the team.
- Influence improvements to CI/CD, data observability, and automation strategies.
Experience
Core Technical Capabilities
- 4+ years of hands-on Snowflake experience, including performance tuning, data modeling, and advanced SQL.
- 7+ years as a Data Engineerworking with large-scale distributed data systems.
- Strong proficiency with Spark, Hadoop, Databricks, Kafka, and modern cloud data architectures.
- Solid Python development skills for both pipeline engineering and automation.
- Experience with orchestration and workflow tools.
Testing & Quality Expertise
- Demonstrated success implementing data testing strategies for ETL/ELT pipelines.
- Familiarity with data profiling, anomaly detection, and statistical validation.
- Experience integrating automated tests into CI/CD processes.
