Description:
We are looking for a Senior Data Engineer to join our team!
Our client is a growing startup focused to unleash the power of augmented intelligence to optimize claim outcomes.
The selected person will work together with the client on a backlog of tasks, which include the following highlights:
Design and develop ETL pipelines to extract data from various sources, transform it, and load it into data warehouses.Optimize data processing workflows for scalability and performance, ensuring efficient data movement and transformation.Collaborate with data analysts and data scientists to understand data needs and ensure data quality, consistency, and accessibility.Maintain and monitor data pipelines, ensuring that they run smoothly, addressing any errors or failures that occur. Requirements: 5+ years of hands-on experience working on Informatica as an ETL tool.5+ years of experience working in the AWS ecosystem.3+ hands-on experience developing ETL solutions using RDS and warehouse solutions using AWS services- S3, IAM, Lambda, RDS, Redshift.High degree of proficiency in at least one programming language required (Proficiency with Python preferred).High proficiency in SQL programming with relational databases. Experience writing complex SQL queries is a must.Experience working with distributed computing tools (Spark, Hive, etc.).Experience with data pipeline (using Hive, Spark, Spark SQL etc. is preferred), DAG orchestration and workflow management tools: Airflow, AWS step functions etc.Experience with Software engineering best-practices, including but not limited to version control (Git, TFS, Subversion, etc.), CI/CD (Jenkins, Maven, Gradle, etc.), automated unit testing, Dev Ops.Experience with containers (Docker, Kubernetes) is a plus.Experience in a fast-paced agile development environment. Job Responsibilities: Design, develop, maintain, and enhance highly scalable data engineering solutions using Informatica ICDM platform (Data Integration, Monitoring, Administration services).Design, build, document, and implement scalable pipelines with a clear focus on data quality and reliability leveraging informatica data profiling and governing services.Ingest and transform structured, semi-structured and unstructured data from multiple sources. Build an enterprise level ETL/ELT solution.Innovate and build proprietary algorithms to tackle complex problems involving interesting data challenges.Execute and continually optimize new customer data ingestion and model implementation processes.Integrating business knowledge with technical functionalities.Often work collaboratively with application engineers, data scientists, product managers, and product delivery teams.Develop solutions at the intersection of data and ML.Ability to contribute in an agile, collaborative and fast paced environment.Monitor workflow performance, reliability, and ensure SLA targets are met.Automate existing code and processes using scripting, CI/CD, infrastructure-as-code and configuration management tools.An excellent troubleshooter, and problem solver, who likes to think outside of the box to solve common problems.Ability to mentor for more junior staff members.AI is at the heart of everything we do, and if you desire to be closer to the AI scene, we have opportunities to work on problems like NLP, image analysis and featurization, and OCR labeling. What We Offer Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to work on market-defining products using the latest technologies.
Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment - or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules. We offer you the best quality of work life so that you exceed the expectations of our clients, while achieving your professional and personal ambitions.
Professional Development: Our dedicated Learning & Development team regularly organizes English classes, professional certifications, and technical and soft skill trainings. We also offer the chance to travel internationally.
Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, extended paternity leave, annual performance bonuses, and referral bonuses.
About GlobalLogic
GlobalLogic is a leader in digital engineering. We help brands across the globe design and build innovative products, platforms, and digital experiences for the modern world.
By integrating experience design, complex engineering, and data expertise, we help our clients imagine what's possible, and accelerate their transition into tomorrow's digital businesses.
Headquartered in Silicon Valley, GlobalLogic operates design studios and engineering centers around the world, extending our deep expertise to customers in the automotive, communications, financial services, healthcare and life sciences, manufacturing, media and entertainment, semiconductor, and technology industries.
GlobalLogic is a Hitachi Group Company operating under Hitachi, Ltd. (TSE: 6501) which contributes to a sustainable society with a higher quality of life by driving innovation through data and technology as the Social Innovation Business.
#J-18808-Ljbffr