Los Angeles, CA
Senior Data Platform Engineer - Remote
Job Description
The data platform team is responsible for architecting and engineering the core platform that s used for ingestion, cleansing, standardization, and storing all data received from the client s customers. The platform is built from the ground up to be massively scalable with cloud-native technologies, methodologies, and processes. The Senior Data Platform Engineer is a key engineering leader tasked with building and extending the platform by building " Bricks" that can be used by data analysts to solve business problems.
Senior Data Platform EngineerResponsibilities
Job Number: JN -082021-65226
The data platform team is responsible for architecting and engineering the core platform that s used for ingestion, cleansing, standardization, and storing all data received from the client s customers. The platform is built from the ground up to be massively scalable with cloud-native technologies, methodologies, and processes. The Senior Data Platform Engineer is a key engineering leader tasked with building and extending the platform by building " Bricks" that can be used by data analysts to solve business problems.
Senior Data Platform EngineerResponsibilities
- Architects robust and automated transformation pipelines to ingest and process structured and unstructured data from source systems into analytical platforms leveraging cloud-native toolsets
- Designs custom applications using Apache Spark and Azure Services (e.G., Function Apps, Logic Apps, Data Factory)
- Designs solutions using data structures such as Apache Parquet, SQL Delta, and NoSQL based data stores
- Closely collaborates with other scrum team members in both platform and API/UI to estimate and deliver work inside of a sprint
- Strong knowledge of Spark Framework and Architecture
- Experience developing applications using Scala in Azure Databricks
- Working knowledge of .Net and C#
- Experience using Azure Data Factory to build orchestration pipelines, in a DevOps and CI/CD environment
- Bachelor s Degree in Computer Science or Computer Information Systems focus or related field
- Health Care Insurance or Revenue Cycle experience strongly preferred
- Salary: $155K plus bonus
- Health, Dental, and Vision Insurance
- 401k with Safe Harbor match
- Generous PTO
Job Number: JN -082021-65226
Recommended Skills
- .Net Framework
- Api
- Apache Spark
- Architecture
- Azure Data Factory
- C Sharp (Programming Language)
Browse other jobs