Sr. Azure Data Engineer/Azure Data Factory (ADF) Expert
Job Description
Position: Sr. Azure Data Engineer/Azure Data Factory (ADF) Expert
Location: White Plains, NY. (100% onsite from day 1. Client does not allow remote working for first 6 months as this is a brand new project starting up and they want all the developers to be onsite and working with each other.) Prefer local candidates in tristate area.
Visa Type: Any
Rate: Open
Interview Type: Phone + Video
Start: Immediate
Duration: Long Term
About the Job
This is an immediate opening to join our growing team as a Microsoft Azure Data Engineer. The person in this role will be a key member of the team, working on a complex and challenging project within the Financial Services/Capital Markets industry. A strong candidate will be an experienced Data Engineer who is proficient in orchestrating sophisticated, robust Data Pipelines in Azure Data Factory (ADF). The primary focus of the selected candidate would be on building resilient, reusable Data Pipelines to extract, load, and transform raw data into a relational data model.
Responsibilities:
Serve as the team's Azure Data Factory (ADF) technical expert
Responsible for day-to-day collection & ingestion of raw data into corporate data assets
Work with the team to formalize data flows and data standards
Supervise all data ingestion & integration processes from source to target including the data warehouse, data lake, etc
Performance tune and optimize all data ingestion and data integration processes
Required Skills and Experience:
Bachelor's degree in Computer Science or a similar field
3+ years of hands-on, production experience building data pipelines in ADF
Experience as a Data Engineer in large scale Data Lake/Cloud Data Platform implementation projects
Experience in SQL, T-SQL, Python or R programming
Experienced building event driven Azure Function based pipeline solutions
Experience managing pipelines into a heterogenous data architecture/technology ecosystem
Comfortable setting up and overseeing batch and API based data pipelines
Familiarity with Trifacta or Matillion ETL a plus
Microsoft certification a plus for this role
Recommended Skills
- Api
- Capital Markets
- Cloud Computing
- Computer Programming
- Data Integration
- Data Lake