Luis Farias - DataOps / MLOps

I am a DataOps/MLOps with hands-on experience in constructing and optimizing ETL flows and building robust data pipelines on AWS and Azure. Fluent in English, I have worked with companies in the USA and am proficient in Python, AWS (S3, lambda, Glue, Kinesis, SNS, EKS), Azure (Databricks, Storage Account, Synapses Analytics and Data Factor) Snowflake, Docker, Kubernetes, Terraform, Trino, Iceberg, Delta, Airflow, and dbt. I am eager to contribute my skills and expertise as a dedicated team member.

Github Data Projects

Data Pipelines created by Luis Farias with different technologies

Go to Project

GenAI - Azure

Guide to deploy the Activate GenAI with Azure Accelerator for your customer

Go to Project

Azure Synapses Analytics Project

Azure Synapse Analytics is a limitless analytics service that brings together data integration, enterprise data warehousing and big data analytics.

Go to Project

Modern Data Stack - Data Open Source tools

The main objective is to create a data environment in Kubernetes using the most famous open source data market products (Terraform, Argo, MinIO, Iceberg, Trino, dbt, Airflow and Metabase).

Go to Project

Airflow and dbt - Cosmos Pipeline

Airflow Project with dbt to create scheduled data transformation jobs.

Go to Project

Medallion Pipeline

Data Engineer Pipelines using Medallion architecture to move data into Snowflake Data Warehouse

Go to Project

Kubernetes - Voting App

Kubernetes Project creating an UI to link with a voting. Project involving deployments and services concepts

Go to Project

Made with Carrd