My Portfolio

Data Engineers design, build, and maintain systems that enable organizations to collect, store, and analyze large volumes of data. They ensure data pipelines are efficient, scalable, and reliable, empowering data-driven decision-making.

Nguyen
Duc An

My Projects

Building the future, one pipeline at a time 🚀

Data Lakehouse Platform with Conversational AI

Data Lakehouse LLM NLP Python AI

A modern data lakehouse platform with conversational AI interface for querying data using natural language. Users can interact with complex data queries through an intuitive chat interface, enabling data discovery and insights without requiring SQL knowledge.

🎯 Role: Platform architecture, AI integration, data query interface development

🛠️ Tech: Data Lakehouse, LLM, Natural Language Processing, Python

Real-time Streaming Pipeline

Flink Kafka Delta Lake MongoDB

Real-time data pipeline for IoT using Apache Flink, Kafka, Delta Lake, and Apache Iceberg. Handles CDC streams from MongoDB for analytics and downstream consumption.

ETL Pipeline with Spark & Airflow

Spark Airflow HDFS Docker

Automated ETL pipeline with Apache Spark, Airflow, and HDFS. Data is processed, transformed, and stored for large-scale analytics with orchestrated workflows.

Data Warehouse Medallion Architecture

SQL Server T-SQL Power BI

Modern data warehouse using Medallion architecture (Bronze, Silver, Gold). Focus on ETL, data modeling, normalization, and analytics reporting with SQL Server.

Tech Stack & Skills

💾 Data Engineering

🗄️ Databases

🤖 AI & Analytics

🛠️ DevOps

My Projects

Data Lakehouse Platform with Conversational AI

Real-time Streaming Pipeline

ETL Pipeline with Spark & Airflow

Data Warehouse Medallion Architecture

Contact Me