Job Description
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, particularly with AWS cloud services, Snowflake, DBT, Python, and SQL.
As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data architecture, ensuring data quality, and optimizing data pipelines for maximum efficiency
Qualifications
- Minimum of 5-7 years of experience in data engineering or a related field.- Proven experience with AWS cloud services.
- Extensive experience with Snowflake data warehousing.- Proficiency in dbt for transforming data within the data warehouse.
- Strong programming skills in Python.- Advanced SQL knowledge for complex queries and data manipulation.
Responsibilities
- Design, implement, and maintain scalable data architectures and data pipelines using AWS services.- Develop and enforce data modeling and design standards to ensure data quality and consistency.
- Integrate data from various sources, ensuring data is clean, reliable, and available for analysis.- Develop and manage ETL processes using tools like dbt, ensuring efficient data extraction, transformation, and loading.
- Optimize database performance, query performance, and overall system efficiency within Snowflake.- Monitor and troubleshoot data pipelines, ensuring minimal downtime and maximum reliability.
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.- Communicate complex technical concepts and solutions effectively to non-technical stakeholders.
- Implement and enforce data governance policies to ensure data privacy and security.- Ensure compliance with relevant data protection regulations and standards.
- Mentor junior data engineers and provide technical guidance.- Stay updated with emerging technologies and industry trends, recommending improvements and innovations.
- Maintain comprehensive documentation of data systems, processes, and protocols.- Generate reports and dashboards to provide insights into system performance and data quality.
Working Conditions
- USD Monthly Payment- 100% remote opportunity- 10 business days of paid vacation per year (can be taken after 6 months in CT)- Up to 10 national holidays (either US or country of residence)- 5 days personal days off (can be taken after 3 months in CT)- Travel expenses covered when applicable- Referral program- Paid certification program- Personalized personal development plan (PDP)- Language platform