Volver a la página principal

Openbank MX - Big Data Engineer - Data Lake

Descripción

Cliente Openbank MX

Ubicación del perfil híbrido


Mission and responsibilities:

The main tasks of this position will be the following:

• Design and implement production big data environments using modern technologies.

• Build, validate, and optimize large-scale, big data solutions in heterogeneous data environments.

•Develop and manage ETLs in batch (Spark and Scala), and streaming (Apache Flink).

Requisitos mínimos

To be successful in the role you must have

• 4-5+ years of experience working with Scala, Spark, software design patterns, and TDD.

• Experience with different database structures, including SQL (Postgres, MySQL), and NOSQL (DynamoDB, DocumentDB, Redis, Elasticsearch).

• Experience and expertise across data integration and data management with high data volumes.

• Experience with Cloud ecosystems is a must, would be a great plus if it’s with AWS ecosystem (EMR, EC2, IAM, GLUE, ATHENA, S3, CloudFormation, LakeFormation, Redshift, DynamoDB, RDS, ECS & ECR).

• Experience working in agile continuous integration/DevOps paradigm and tool set (Git, Jenkins, Sonar, Nexus, Jira, and Splunk).

• Bachelor’s Degree in Computer Science, Information Systems, Mathematics, or other STEM, and related fields, or equivalent work experience.

Professional working proficiency in English.

Nice to have

• Experience with data warehousing, apache iceberg, and visualisation tools.

• Experience with NRT applications: Apache Flink, spark streaming.