Springfield, MA

Data Engineer



Job Description

Full-Time/Remote

Summary

DataLink is looking for a Data Engineer for a Full-Time with Benefits (Remote Option) role. Reporting to the Manager of Data Engineering, the Data Engineer is someone who enjoys challenging work in a fast-paced environment and solving complex business problems with data and analytics, enabling our customers in their pursuit of better healthcare outcomes for their members. You will experience the unique opportunity to migrate from traditional onprem data and technologies to cloud-based big data technologies in a multi-cloud data platform.

Essential Functions

  • Build, automate and enhance data pipelines using batch processing and real-time streaming technologies and patterns
  • Design and implement onprem-to-cloud hybrid ETL solutions to Ingest, validate, transform, and publish both real-time stream data and batch data
  • Create, modify, and optimize SSIS packages and SQL execution to improve performance
  • Orchestrate data from multiple sources and sinks using Airflow and Azure Data Factory
  • Design, develop and implement ETL solutions using cloud and non-cloud-based technologies for parallel processing using Spark and Databricks
  • Define and implement data models with various database technologies like MongoDB, CosmosDB, Neo4j, MariaDB and SQL Server
  • Build, maintain and optimize data warehouse tables and databases
  • Ensures data integrity throughout the ETL process and appropriately handle errors
  • Migration of data and functionality from the onprem data platform and technologies to the cloud data platform and technologies
  • Ingest and publish data from sources and to destinations via an API

Qualifications

  • Bachelor’s degree in Computer Science, Management Information Systems or related discipline
  • 5+ years of experience designing, developing, validating, and automating ETL processes
  • 3+ years of experience traditional ETL tools such as Visual Studio, SQL Server Management Studio, SSIS, SSAS and SSRS
  • 2+ years of experience with cloud technologies and platforms, such as: Kubernetes, Spark, Kafka, Azure Data Factory, Snowflake, ML Flow, Databricks, Airflow or similar
  • Must have experience with designing and implementing data access layers
  • Must be an expert with SQL/T-SQL and Python
  • Exposure to ETL/ELT with using Kafka or Azure Event Hubs with Spark or Databricks is a plus
  • Exposure to healthcare technologies and integrations for FHIR API, HL7 or other HIE protocols is a plus

*We are interested in qualified candidates, however, we do not provide sponsorship at this time

DataLink is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.

About DataLink

DataLink is a certified Top Workplace that was founded in 2001 to offer healthcare professionals with the tools needed to provide proactive, optimized care to their patients.

DataLink has created a one-stop-shop solution that can be used by doctor’s offices as well as healthcare insurance companies to easily access actionable insights that help in improving patient outcomes. Additionally, interoperability solutions help healthcare organizations manage large amounts of data from different sources to ensure the right information is gathered to achieve a 360-degree view of all patients.

Benefits:

  • Remote Work Option
  • Healthcare (Dental, Medical, Vision, Short-Term, Long-Term disability)
  • Life Insurance
  • 401K matching
  • Professional Development reimbursement
  • Time Off (PTO, Paid Holidays, and Floating Holidays
  • Tampa Employees: Free access to office fitness center

#LI-Remote

Recommended Skills

  • Api
  • Apache Kafka
  • Apache Spark
  • Automation
  • Azure Data Factory
  • Big Data
Browse other jobs