Job Description
This is a remote position and we are hiring candidates from the whole country.
AgileEngine is one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch.
We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions.
If you like a challenging environment where you're working with the best and are encouraged to learn and experiment every day, there's no better place - guaranteed! : )
What you will do
- Create ingestion and transformation pipelines from raw data;
- Work with BE and FE integration teams to ensure the data is accessible with all the requirements to ensure the fastest,
more efficient and safe transformation and data moving;
- Create layers of data from the least used raw formats to transactional data;
Develop and implement strategic testing approaches for data handling and ETL transactions.
Must haves
- 5+ years of experience in Data Engineering;
- 5+ years of development experience in Python;
- 3+ years of development experience in AWS;
- 3+ years of development experience in SQL;
- 3+ years of experience on Glue / Iceberg combo over S3;
- 3+ years of experience on MongoDB or Cassandra;
- Strong problem-solving skills to identify and resolve minor bugs related to missing data;
- Creating pipelines from scratch and working with data architect to provide the best data solution;
- Ability to develop and implement strategic testing approaches for data handling and ETL transactions;
- Expertise in ensuring data integrity and accuracy through comprehensive quality checks;
- Proficiency in improving data handling processes to make them more robust and error-proof;
- Experience in monitoring and evaluating the effectiveness of implemented strategies and making necessary adjustments;
- Excellent collaboration skills to work closely with cross-functional teams;
Upper-intermediate English level.
Nice to haves
Worked with geographically referenced data and imagery (normalization, orthorectification, band combination, point cloud conversion);
Experience with API development (python or Node.JS).
The benefits of joining us
Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
Flextime
Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office whatever makes you the happiest and most productive.
Requirements
- 5+ years of experience in Data Engineering; 5+ years of development experience in Python; 3+ years of development experience in AWS;
- 3+ years of development experience in SQL; 3+ years of experience on Glue / Iceberg combo over S3; 3+ years of experience on MongoDB or Cassandra;
- Strong problem-solving skills to identify and resolve minor bugs related to missing data; Creating pipelines from scratch and working with data architect to provide the best data solution;
- Ability to develop and implement strategic testing approaches for data handling and ETL transactions; Expertise in ensuring data integrity and accuracy through comprehensive quality checks;
- Proficiency in improving data handling processes to make them more robust and error-proof; Experience in monitoring and evaluating the effectiveness of implemented strategies and making necessary adjustments;
Excellent collaboration skills to work closely with cross-functional teams; Upper-intermediate English level.
