Data Engineer

at Merkle
Location Columbia
Date Posted August 5, 2022
Category Engineering
Job Type Not Specified

Description

Job Description

Role Purpose

We are seeking a Data Engineer who is passionate about data, embraces infrastructure as code, supports CI/CD, and enjoys collaborating to produce high performing, maintainable solutions. As a Data Engineer, you will be responsible for the successful release and run time of revenue generating big data solutions and will focus on continuously improving, optimizing, and eliminating toil through automation. In addition to automating operations and managing infrastructure through code, you will work collaboratively with the product team, developers, and IT personnel to build, evolve, and scale our solutions to meet our growing business.

Key Responsibilities

Develop onboarding process to receive and process information related to onboarding a new subscriber

Convert Snowflake Stored Procedures to Python Scripts directly in Airflow

Develop metadata driven solutions for managing data processing and cadence

End to end automation development and testing

Building and maintaining stored procedures and scripts in Snowflake Data Cloud

Building and maintaining complex SQL queries for ETL/ELT processing

Develop Dashboard for data processed for audit and governance needs

Follow Agile methodologies to deliver iterative feature sets rapidly

Maintain codebase using source control methodologies, Git

Collaborate with business analysts, data analysts, and other developers to deliver powerful new features

Coordinate with teams as part of a larger data-sharing system

Contribute to a collaborative, positive, and enjoyable environment for your operations team

Performing quality assurance and testing

Writing user and technical documentation such as runbooks

Drop files here browse files ...