100% Remote Data Engineer
Data Engineer
Permanent, Full Time
100% Remote
$140k - $175k Salary
Duties and Responsibilities
Design and develop Systems including operational requirements and infrastructure setup in an Agile software development paradigm
Quickly learn new technologies and produce proof of concepts, specially using AWS, Big Data and Open-Source technologies
Work on high priority production support issues, troubleshoot and formulate solutions for those issues in a time sensitive manner
Develop processes to make Operations more manageable and robust, including code refactoring and tuning performance. Analyze existing systems and create technical documentation
Qualifications & Requirements
5+ years of solid hands-on software development experience with focus on backend technologies and large volume distributed data processing including production support
Bachelor's Degree in computer science or similar discipline
Expertise in building backend systems using AWS Redshift, AWS EMR, SQL Server, PostgreSQL
Expertise in AWS development. AWS Developer Certified is preferred
Experience in building systems using programming language like SQL, Python and Scala
Knowledge of Tableau, Time series databases, Data Lakes, Docker, AWS EKS (Kubernetes), Airflow will be pluses, but not required
Must be knowledgeable in Data Warehousing, Big Data Analytics and Distributed data processing
Databases - AWS Redshift, PostgreSQL, MS SQL Server; Familiarity with Timescale, Elastic Search/MongoDB
Programming Languages - SQL, Python; exposure to JAVA
Exposure to Tools - AWS - EMR, Lambda, EKS; Apache - Spark, Scala, Airflow; Talend, Tableau
Strong System analysis, design, and development skills in an Agile environment
Recommended Skills
- Agile Methodology
- Airflow
- Amazon Elastic Mapreduce (Emr)
- Amazon Redshift
- Amazon Web Services
- Apache Http Server