Skip to content
View juliuschaesar-dev's full-sized avatar
2 followers · 0 following

Block or report juliuschaesar-dev

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
juliuschaesar-dev/README.md
Julius Chaesar — Data Engineer

LinkedIn Email

I've spent the past 9+ years turning messy data into something teams can actually rely on — from ETL/ELT pipelines and data warehouses to streaming systems and cloud platforms. These days I'm also exploring how AI/LLMs fit into that world, building data-driven solutions on top of it.

What I work on

Pipelines
Batch & streaming ETL/ELT, CDC with Debezium and Kafka, orchestration in Airflow, Dagster, Prefect and NiFi. 		Modeling
Data Vault 2.0 and Kimball warehouses, medallion lakehouses on Iceberg and Delta, transformations in dbt and SQLMesh. 		Platforms & BI
GCP, AWS, Azure, Alibaba Cloud · Databricks, Fabric, Snowflake · Power BI, Tableau, Superset, Metabase.

Selected projects

Project Focus Flow
kafka-cdc-flink Streaming CDC Postgres → Debezium → Kafka → Flink → ClickHouse
kafka-cdc-jdbc-sink Streaming CDC Postgres → Debezium → Kafka Connect → ClickHouse (Avro + Schema Registry)
kafka-spark-metabase Streaming Kafka → Spark Structured Streaming → Postgres → Metabase
dagster-iceberg-panel Lakehouse REST API → S3 → Iceberg → Trino → Panel, orchestrated by Dagster
databricks-spark-medallion Lakehouse Medallion layers with Spark SQL, Delta Lake and Unity Catalog
prefect-seaweedfs-duckdb Lakehouse Open-Meteo → Prefect → SeaweedFS → DuckDB → Streamlit
datavault-dbt Warehouse Data Vault 2.0 in three layers with dbt-core on Postgres
ksei-holding-pipeline Warehouse Monthly KSEI ownership ETL: Airflow → ClickHouse → dbt → Superset
trino-mongodb-metabase Analytics CSV → MongoDB → Trino → Metabase
airflow-duckdb-dash Analytics Crypto market data: Airflow → DuckDB → Plotly Dash

Learning & mentoring — dbt-postgres-story · sql-story-postgresql · kafka-hands-on-basic · docker-hands-on-basic

Toolbox

Data Engineering
Apache Airflow Apache Kafka Apache Spark Apache Flink Apache NiFi Dagster Apache Iceberg dbt Talend Pentaho Airbyte SQLMesh

Databases and Warehousing
PostgreSQL Oracle MySQL SQL Server MongoDB ClickHouse DuckDB BigQuery Amazon Redshift OpenSearch SeaweedFS Trino

Cloud and Data Platforms
Google Cloud AWS Microsoft Azure Alibaba Cloud Databricks Microsoft Fabric

Analytics and Programming
Python Power BI Tableau IBM Cognos Metabase Grafana Plotly Dash Superset

Tools and Observability
Docker Podman Prometheus Jira Confluence

Full stack by layer
Layer Tech Stack
Orchestration Apache Airflow, Dagster, Prefect, Apache NiFi
Language Python, SQL
Processing Apache Spark, Apache Flink
Streaming Apache Kafka
Ingestion Airbyte, Debezium, Talend, Pentaho, IBM DataStage, SSIS
Cloud Computing AWS, GCP, Azure, Alibaba Cloud
Lakehouse Apache Iceberg, Amazon S3, Google Cloud Storage, SeaweedFS
Data Platform Databricks, Microsoft Fabric, Snowflake
Transformation dbt, SQLMesh
Warehouse and Query BigQuery, Redshift, ClickHouse, DuckDB, PostgreSQL, SQL Server, Oracle, Trino
Search and Enrichment OpenSearch, MongoDB
Monitoring Grafana, Prometheus
BI and Visualization Power BI, Tableau, IBM Cognos, Metabase, Plotly Dash, Superset
DevOps and Containerization Docker, Podman
Collaboration Jira, Confluence
AI/LLM Data Processing LLM-driven data workflows

Happy to talk data platforms, pipelines and analytics — LinkedIn · j.chaesar94@gmail.com

Pinned Loading

  1. airflow-duckdb-dash airflow-duckdb-dash Public

    Crypto market data pipeline orchestrated with Apache Airflow, stored in DuckDB, and visualized with Plotly Dash.

    Python

  2. dagster-iceberg-panel dagster-iceberg-panel Public

    End-to-end lakehouse pipeline: REST Countries API → Garage (S3) → Iceberg (Lakekeeper) → Trino → Panel, orchestrated by Dagster.

    Python

  3. databricks-spark-medallion databricks-spark-medallion Public

    Medallion Architecture pipeline on Databricks using Spark SQL, Delta Lake, and Unity Catalog.

    Python

  4. datavault-dbt datavault-dbt Public

    Three-layer medallion warehouse for superstore dataset: dbt-core on PostgreSQL, with Data Vault 2.0 Modelling.

    Dockerfile

  5. kafka-cdc-flink kafka-cdc-flink Public

    Streaming CDC demo: Postgres → Debezium → Kafka → Flink → ClickHouse → Dashboard with Flask end-to-end

    HTML

  6. prefect-seaweedfs-duckdb prefect-seaweedfs-duckdb Public

    End-to-end weather analytics pipeline: Open-Meteo API → Prefect (orchestration) → SeaweedFS (lakehouse) → DuckDB (query engine) → Streamlit (dashboard).

    Python