Data Specialist

We are working on a Data Specialist position for a highly innovative fintech specializing in cloud payment solutions. Currently, this company operates in several countries and is expanding its Technology team while experiencing exponential growth. Their clients are launching next-generation solutions while migrating their legacy systems onto the most advanced platform in the market. Are you ready for a new challenge?

The Data Lake team is focused on using data engineering fundamentals to build and optimize data lake, creating robust and efficient solutions that facilitate access and delivery of information to Pismo's internal and external customers in a componentized and self-contained manner.

Responsibilities:

• Develop and improve data pipelines using big data technologies and implement solutions to evolve data platform architecture.
• Seek technological evolutions that improve the data processing platform.
• Be accountable for the operation and monitoring of the production of file and event systems.
• Ensure that the systems meet the established SLAs.
• Participate in the design and implementation of high-complexity features.
• Collaborate with other internal and external teams and customers to ensure efficient delivery and needs files and events.
• Acting in the demands of system operation (RUN/Oncall), respecting customer slas, and proposing improvements to improve the service level.
• Be a guardian of the processes, following them rigorously and ensuring that data stakeholders also follow them.
• Support in production management processes: performing root cause analyzes and contributing to their problem solving skills.

Qualifications:

• Experience with AWS Services (eg DMS, Glue, EMR, S3);
• Python proficiency; Pyspark and SparkSQL; Airflow;
• Architectural design; Data Ingestion; Data Lake Architecture;
• Ability to design and implement scalable solutions that can deal with large volumes of data;
• Experience with distributed Data Processing: Spark, Kafka, Kinesis, Flink;
• SQL Adhoc Consultations with Trino, Clickhouse, and Suffiset and ability to create simple views and dashboards for different audiences with target audiences;
• Catalog / Data Lineage: Glue Catalog, Open Metadata.
• Relational databases (such as PostgreSQL, MySQL)
• Advanced English

If you are interested, please apply now!