As a Senior Data Engineer, you will be instrumental in designing and building scalable data pipelines, transforming complex datasets, and ensuring the reliability of the data infrastructure.
Working closely with data scientists and analysts, you'll provide critical insights that shape strategic decisions.If you're passionate about data engineering and thrive in a fast-paced, collaborative environment, this role offers you the opportunity to contribute to cutting-edge projects and help shape the future of data architecture.Company overview:This pioneering financial services company offers homeowners a unique way to access their home equity without taking on additional debt.
Through a shared equity model, the company partners with homeowners, allowing them to unlock equity in exchange for a share in future property appreciation or depreciation, providing financial flexibility and long-term stability.Responsibilities:? Must understand distributed computing in a horizontally scaled environment and what challenges it brings.? Describe transactional scenarios across multiple microservices with a good level of detail.? Will need to learn and understand the business model and establish a solid relationship of trust with the client.? Produce high-quality code matching our coding standards and best practices.? Highly collaborative, excellent interpersonal skills, and able to work with diverse personality types.? Ability to influence at all levels of the company, and communicate with managers and engineers alike.Requirements:Technical skills:? 5+ Python development experience desired.? Node.js development experience is a plus.? Experience working with AWS.? Familiarity Big Data on AWS (e.g.
Dynamo, Batch, AWS Glue, S3, EMR, Athena, Redshift) & distributed computing engine such as Spark.? In-depth Knowledge of both relational and non-relational Databases & data modeling.? Experience setting up a code pipeline.
Ex: CloudFormation, Terraform.? Experience coding ETL pipelines in the OLAP and Data Warehouse environments.? Experience with orchestration tools such as Airflow.? Understanding of Serverless architectures.? Understanding of fundamental design principles behind a scalable application.? Proficient understanding of code versioning tools such as Git.? The role is heavier on engineering and scripting than it is on analysis.? If you like playing with the latest technology from Amazon for moving and transforming large sets of data then you will like this job.? Experience with cloud-based technologies such as AWS or Azure is desirable.? Familiarity with DevOps and continuous integration/continuous delivery (CI/CD) is desirable.? Experience in the banking/fintech industry is desirable.Soft skills:? A strong sense of ownership.? Excellent written and verbal communication and interpersonal skills.? Able to effectively collaborate with technical and business partners.? Can take on full projects from beginning to end.? Problem solver.? Team Player.? Advanced English level.