Mid Data Engineer
Zipdev, Colombia
Job Description
We seek a junior to mid-level Data Engineer to join our dynamic data engineering team. This role involves building and optimizing ETL workflows, rewriting data science notebooks for production environments, and repricing parcel carrier data according to various discount terms. The successful candidate will be immediately involved in feature development for our core product, handling EDI and CSV formatted data across different parcel shipping schemas.
This person should be familiar with PySpark, Python, and Databricks in the AWS ecosystem. Experience working with SQL (e.g. PostgreSQL) is also preferred.
This role is fairly autonomous. A successful applicant should be comfortable using their skill, intuition, and creativity to accomplish a task without detailed direction on how it should be accomplished. While the ideal candidate should be capable and independent, they will be part of a supportive and friendly team dedicated to mutual success. This person should be comfortable working in 2-week sprint cycles.
Key Responsibilities:
- Develop and maintain efficient ETL workflows using Databricks within AWS.
- Optimize data science notebooks for a robust production environment.
- Implement repricing logic for parcel carrier data based on various discount agreements.
- Parse and process data in various formats, including EDI and CSV, across multiple shipping schemas.
- Collaborate actively in a team setting within 2-week sprint cycles, contributing to the team's success while working autonomously on assigned tasks.
Requirements
- Bachelor’s degree in Computer Science or a related field, or equivalent experience.
- Databricks
- PySpark
- SQL (Databricks SQL or Spark SQL preferred)
- Git
- Python
Bonus if familiar with:
- EDI, CSV, and JSON data feeds
- Parcel shipping data
- Parcel audit
Benefits
- Work remotely Monday - Friday, 40 hours a week (no weekends)
- Vacation: 10 business days a year
- Holidays: 5 National Holidays a year
- Company Holidays: 5 Company Holidays a year (Christmas Eve, Christmas Day, New Year's Eve, New Year's Day, Zipdev Day)
- Parental Leave
- Health Care Reimbursement
- Active Lifestyle Reimbursement
- Quarterly Home Office Reimbursement
- Payroll Deduction Purchase Plans
- Longevity Bonus
- Continuous Learning Bonus
- Access to Training and Professional Development Platforms
- Did we mention it's REMOTE?!!