Senior Data Engineer

Detalles de la oferta

We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will be proficient in PySpark, Azure Data Bricks, Azure Data Factory, and SQL. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives.
Responsibilities: Develop and maintain data pipelines using PySpark to ingest, process, and transform large volumes of data.Design and implement ETL processes using Azure Data Factory to move data between various data sources and destinations.Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.Optimize and tune data pipelines for performance and scalability.Ensure data quality and reliability by implementing data validation and monitoring processes.Troubleshoot and resolve issues related to data pipelines and infrastructure.Develop and maintain documentation for data pipelines, workflows, and data sources.Stay up-to-date with emerging technologies and best practices in data engineering and cloud computing.Qualifications: Bachelor's degree in Computer Science, Engineering, or related field.Strong programming skills in Python and experience with PySpark for big data processing.Proficiency in SQL for querying and manipulating data in relational databases.Hands-on experience with cloud platforms such as Azure, particularly Azure Data Bricks and Azure Data Factory.Experience designing and building scalable and reliable data pipelines.Familiarity with data modeling concepts and techniques.Excellent problem-solving and troubleshooting skills.Strong communication and collaboration skills, with the ability to work effectively in a team environment.Preferred Qualifications: Experience with other big data technologies such as Hadoop, Kafka, or Apache Spark.Knowledge of containerization and orchestration tools such as Docker and Kubernetes.Experience with version control systems such as Git.Familiarity with machine learning concepts and frameworks.Certification in cloud computing or big data technologies is a plus.If you're passionate about leveraging data to drive insights and decision-making, and you thrive in a fast-paced, collaborative environment, we encourage you to apply for this exciting opportunity!

#J-18808-Ljbffr


Fuente: Jobleads

Requisitos

Analista Técnico

Buscamos un arquitecto, ingeniero civil o profesional de carreras afines que tenga un perfil dinámico, proactivo, con capacidad de análisis, negociación y or...


Desde Neo-Biz Consultores - Santa Fe

Publicado 11 days ago

Especialista En Alarmas Dsc

¡Asorum RRHH selecciona: Técnico en Seguridad Electrónica! Estamos buscando a un Técnico en Seguridad Electrónica altamente competente y motivado para unirs...


Desde Asorum - Santa Fe

Publicado 11 days ago

Actualización Tecnológica En Riesgos

Objetivo del Proyecto: - Analizar todos los procesos del área de Riesgos Agropecuarios y Forestales, detectando la necesidad de incorporar la tecnología a...


Desde La Segunda Seguros S.A. - Santa Fe

Publicado 11 days ago

Implementación Proyecto Red De Ambulancias

Objetivo del Proyecto: Con el fin de encontrar soluciones para hacer frente a los cambios del entorno y generar un salto de calidad en la contratación y as...


Desde La Segunda Seguros S.A. - Santa Fe

Publicado 11 days ago

Built at: 2024-11-01T11:02:39.348Z