Summary
Overview
Work History
Education
Skills
Timeline
Generic

Luiz Cesa

Data Engineer
Sideropolis, Santa Catarina

Summary

Data Engineer with experience in Data Acquisition, ETL, Data Ops, Data Warehouse, Data Lake, Lakehouse, Data Architecture. Experienced with technologies like Docker, Kubernetes, Kafka, Trino, Spark. Voracious learner, extremely goal oriented and committed to results.

Overview

6
6
years of professional experience

Work History

Senior Data Engineer

Loadsmart
06.2021 - Current
  • Deployment and maintenance of tools that make up the company's data platform, such as Airflow, Airbyte, Trino, JupyterHub, Superset, Dremio and others.
  • Management and maintenance of Data Warehouse.
  • Conception and implementation of a data architecture based on Lakehouse.
  • Development of internal tools for data acquisition from specific sources.
  • Building Python libraries to simplify internal tasks, such as data integrations and reports.
  • Improvement of cost efficiency and performance of AWS S3 through optimization and parquet aggregation routines, snapshot control, and more.
  • Improvement of cost efficiency and processing performance through automatic resource scalability based on time and usage.
  • Generated detailed studies on potential third-party data handling solutions, verifying compliance with internal needs and stakeholder requirements.
  • Designed robust database architecture that supported seamless integration of new datasets and facilitated rapid analysis capabilities.
  • Reduced operational costs by automating manual processes and improving overall data management efficiency.
  • Developed custom algorithms for efficient data processing, enabling faster insights and decisionmaking.
  • Contributed significantly towards setting up an automated monitoring mechanism using state-of-the-art technologies and tools, which led to proactive issue identification and resolution.
  • Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.

Data Engineer

Highdata
12.2020 - 10.2023
  • Data acquisition and ETL processes.
  • Creation of automations and data assets for data analysis and Data Science.
  • Integration of Databricks reports with data visualization tools like Tableau.
  • Architect and implement Data Pipelines focused on optimizing data flow for Artificial Intelligence projects
  • Compiled, cleaned and manipulated data for proper handling.
  • Prepared documentation and analytic reports, delivering summarized results, analysis and conclusions to stakeholders.
  • Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
  • Participated in strategic planning sessions with stakeholders to assess business needs related to data engineering initiatives.

Data Engineer

Bradesco Bank
07.2018 - 10.2020
  • Automation of various previously manual data acquisition and transformation steps.
  • Designed data models for complex analysis needs.
  • Collaborated with cross-functional teams for seamless integration of data sources into the company''s data ecosystem.
  • Design and implementation of Data Marts for the bank's key products.
  • Manage and maintenance of Data Warehouse
  • Conducted extensive troubleshooting to identify root causes of issues and implement effective resolutions in a timely manner.
  • Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
  • Implementation of Data Quality processes to ensure data integrity and quality.
  • Implementation of monitoring and alert systems in data pipelines.

Education

Bachelor of Science - System Development And Analysis

Universidade Federal Do Paraná
Curitiba, Parana, Brazil
05.2001 -

Skills

  • Amazon Redshift

  • SQL and Databases

  • Analytical Thinking

  • Data Quality Assurance

  • ETL development

  • SQL Programming

  • Team Collaboration

  • Performance Tuning

  • Python Programming

  • Data Acquisitions

  • Data Warehousing

  • Data Modeling

  • Data Lakehouse

  • Kafka

  • Spark

  • Trino

  • Docker

  • Kubernetes

  • Terraform

  • Apache Iceberg

  • Delta Lake

  • AWS Cloud

Timeline

Senior Data Engineer

Loadsmart
06.2021 - Current

Data Engineer

Highdata
12.2020 - 10.2023

Data Engineer

Bradesco Bank
07.2018 - 10.2020

Bachelor of Science - System Development And Analysis

Universidade Federal Do Paraná
05.2001 -

Similar Profiles

CREATE PROFILE
Luiz CesaData Engineer