AzureDatabricksPower BIPython

• Joined the project as a hands-on Senior Data Engineer, contributing directly to feature development and data workflows before stepping into the Technical Lead role.
• Refactored and standardized helper modules across the codebase — improving readability, maintainability, and engineering consistency — while extracting reusable vendor-specific logic into shared libraries to reduce duplication.
• Designed and implemented a metadata-driven master DAG architecture to replace isolated job orchestration, improving scalability and operational consistency across the platform.
• Collaborated closely with stakeholders to align platform improvements with reporting requirements and delivery timelines for a global automotive client in the Korean market.
• Redesigned Azure DevOps CI/CD pipelines around an incremental deployment strategy, cutting deployment overhead and tightening the delivery cycle across the team.
• Built and optimized Databricks incremental refresh jobs to improve Power BI data freshness without increasing compute cost.
• Supported team members in understanding the metadata-driven architecture and CI/CD approach, helping the team take ownership of the patterns independently.

ElasticLogstashElasticsearchKibana

• Served as Technical Lead and Solution Architect for a large-scale log ingestion and observability platform built for a semiconductor manufacturing environment.
• Architected an on-premise, air-gapped Elastic Stack system handling up to 1TB/day log volume with near real-time processing (30–120s latency).
• Directly configured inter-node networking and cluster communication across distributed Elasticsearch infrastructure — from network binding to transport layer settings.
• Designed and implemented Index Lifecycle Management (ILM) policies, index templates, and rollover rules to govern large-scale log retention, storage tiering (hot/warm/cold), and query performance.
• Tuned indexing strategy, shard allocation, and disk utilization under sustained high-volume workloads to maintain cluster stability and operational efficiency.
• Monitored and optimized Logstash ingestion throughput and pipeline performance, resolving bottlenecks under production load conditions.
• Built resilient ingestion pipelines with Persistent Queue and Dead Letter Queue to ensure zero data loss during interruptions.
• Led security design across the stack — network segmentation, HTTPS enforcement, and role-based access control (RBAC).
• Delivered dashboards, alerting, and anomaly detection capabilities in Kibana for operational teams.

MongoDB AtlasAmazon AuroraPrismaTypeScript

• Led the database team in a cross-functional database migration project, transitioning from MongoDB Atlas to Amazon Aurora.
• Designed and implemented data migration strategies ensuring data consistency, integrity, and minimal downtime.
• Leveraged Prisma ORM with TypeScript to redesign data access layers and optimize query performance.
• Collaborated closely with backend teams to refactor services and align with relational database design principles.
• Identified and resolved schema mismatches between NoSQL and relational models, ensuring seamless migration.

Elastic StackElasticsearchKibana

• Acted as Technical Lead for a critical Proof-of-Concept project to validate a large-scale log management and analytics solution for a semiconductor manufacturing system.
• Led the end-to-end solution design and proposal process, working closely with stakeholders to define system requirements and architecture using Elastic Stack.
• Designed and delivered a production-grade PoC system that was actively used by the client on a daily basis, serving as a foundation for the full-scale implementation.
• Conducted technical presentations, solution demonstrations, and architecture walkthroughs to convince stakeholders and secure project buy-in.
• Played a key role in technical proposal writing, estimation, and solution positioning, contributing directly to business acquisition.
• Led and coordinated the engineering team, ensuring alignment between business requirements and technical implementation.
• Built strong experience in client communication, negotiation, and cross-functional collaboration in a pre-sales / solutioning context.

AzureDatabricksElasticsearchKibanaPython

Embedded in a Kanban team responsible for automated fleet measurement analytics, working alongside Vietnamese and European colleagues in a cross-timezone delivery setup.

• Built data ingestion and processing pipelines on Azure — using Data Factory for orchestration and Databricks for large-scale analysis of terabyte-range datasets from data lakes.
• Designed transformation workflows to handle petabytes of raw data, applying distributed processing principles to maintain throughput and reliability at scale.
• Used Elasticsearch and Kibana for exploratory data analysis and stakeholder-facing visualizations, bridging raw data and operational insight.
• Collaborated across a mixed Vietnamese–European team, contributing to both technical delivery and cross-cultural project alignment.

AWSJavaSQL

• Led a 5-person Vietnamese engineering team delivering a talent management application on AWS, built around a microservice architecture.
• Designed a resilient database layer using DocumentDB with auto-scaling, and architected Spring Boot microservices for high availability under variable load.
• Configured and integrated core AWS services — DocumentDB, S3, EC2 — directly into backend microservices, handling both infrastructure decisions and implementation.
• Implemented AWS Video on Demand for large-scale video streaming and built reusable Spring Boot API modules shared across services.
• Engineered a CI/CD workflow on EKS and GitLab CI that enabled parallel deployment of five microservices with consistent reliability.

GCPBigQueryAirflowScalaPython

• Grew the Vietnamese sub-team from 2 to 8 engineers while coordinating closely with EU counterparts across multiple active delivery tracks.
• Designed and implemented distributed ETL pipelines using Google Cloud Dataflow, Scala, and Scio — ingesting millions of streaming records from Salesforce, Siebel, and enterprise sources into GCS.
• Architected BigQuery data models with star schema design, optimizing complex queries across dozens of dimension tables and high-volume fact tables at terabyte scale.
• Ensured ACID compliance for large transactions and drove a significant architecture migration from wildcard tables to Slowly Changing Dimension (SCD Type 2) implementations in BigQuery.
• Orchestrated ETL workflows and parallel BigQuery jobs using Apache Airflow (Cloud Composer), improving pipeline reliability and scheduling efficiency.
• Mentored engineers on distributed data workflows, Airflow orchestration patterns, and BigQuery modeling — shortening onboarding ramp and raising the team's ability to work independently on complex pipelines.

JavaTypeScriptSQL

• Built Java reactive backend services with Quarkus and frontend features with TypeScript and Angular, working within a Scrum team on a mock testing application.
• Implemented authentication and authorization with Keycloak, integrating security features across backend and Angular components.

JavaSQL

• Optimized an email notification feature to handle 5,000 emails per second using multi-threading and Thymeleaf templates.
• Collaborated on a Spring Boot / Vue.js web application, contributing to backend services and SQL procedures under senior engineering guidance.

JavaTypeScriptMongoDB

• Developed FAQ and barcode scanning features with Angular and Spring Boot for a web and mobile platform serving 30,000 monthly users.
• Integrated RabbitMQ for async microservice communication and accelerated search with MongoDB full-text indexing.