Data Engineer

Role Overview

iVoyant is an emerging digital platform engineering and development services firm based in Atlanta. At iVoyant, we are helping our customers solve complex challenges, support their growth & transformation agenda, leveraging technology to make a difference.

iVoyant is looking for multiple Data Engineers to join our client Digital Team. The Data Engineers will work on the state-of-the-art data ETL pipelines provisioning data acquisition, transformation, integrity and consistency on a high volume manufacturing sensor data. The engineers will be responsible for expanding the present data pipeline architecture, and optimizing the data flow according the business requirements and service consuming stakeholders.

In addition, they will also assist in aggregating variety of operational and enterprise data sources into a digestible format consumed by both data scientists and manufacturing plant stakeholders.

Responsibilities

• Optimize data ETL operations and aggregate multiple data sources ranging from machine operational data to manufacturing SAP data.
• Understanding the data requirements from Data Science team and provide the data as required.
• Combine large volumes of disparate data, perform data quality checks and validations to ensure continuous service of sanitized data for data science team and other stakeholders.
• Perform data validation of sensor readings on IBA and ensure the sanctity of derived formulae.
• Support maintenance, bug fixing and perform operational analysis along data pipeline.
• Build modules for error handling, exception management and data quality routines to expose the anomalies in the data

Qualifications

• 3+ years in Python programming experience is required.
• Must have hands on experience handling data sources like parquet, csv using pandas, spark sql and spark dataframes.
• Experience with Informatica (DEI/BDM) is preferred but not required.
• 3+ years of working in data analysis using SQL and any data visualization tool.
• Experience in working on time-series/historians data such as IBA, National Instruments is a huge plus.
• Proven passion for data analysis and data insight story-telling is a must.
• Bachelor's Degree in Computer Science, Engineering, and/or background in Mathematic and Statistics; Master's or other advanced degree a plus

Recommended Skills

• Apache Spark
• Architecture
• Business Requirements
• Data Analysis
• Data Collection
• Data Pipeline