Data Engineer (Level 2)

Title: Data Engineer 2

Max Pay Rate: $78/hr

Job Duration: contract with an estimated end date on 12/02/2022

Location: San Jose, Boston, or Seattle. (Remote til further notice, but should expect to go into office 2 days minimum when offices re-open) Hours: 40 hours

Duties:

• Architect, build, and maintain scalable, automated, and reliable data pipelines from the ground up. Be an expert at maintaining data quality while stitching data from many different data sources

• Work with our client’s data ingestion, data platform, product, and machine learning teams to deeply understand and validate instrumentation, data flow, and processes

• Utilize solid software engineering principles and tools for the pipelines you create, own the data engineering lifecycle end to end, develop new features and improve integrations for data sources

• Support regular ad-hoc data querying and analysis to diagnose issues, understand customer behavior, and support maintenance

Skills:

• Bachelor’s degree in Computer Science, Information Systems or a related field is required, master’s preferred

• 3-6 years of experience building and maintaining data pipelines at scale utilizing technologies like Apache Hadoop, Apache Kafka, SQL, Hive, and Presto/Trino

• Strong proficiency with software engineering tools like Git, Docker, Jenkins or Apache Airflow

• Programming experience in Python or a similar language

• Strong capacity to manage numerous simultaneous projects with a geographically distributed team

• Passion for creating intelligent, fault-tolerant, and redundant data pipelines at scale

• Solid attention to detail, be a self-starter, able to diagnose and resolve problems with production grade systems at scale

Education: 3 - 6 YOE