Resume - Daiki Mawatari

Modified

2026-10-09

Daiki Mawatari

Data Science Manager | Data Engineer | MLOps Engineer | Applied AI Engineer | Databricks MVP 2026

Website | LinkedIn | GitHub

Resume (Website, PDF) | Resume (Japanese) (Website, PDF)

1. Professional Summary

I manage the Data Science Team at GENDA.

Drawing on over 10 years of software engineering experience, I work across data engineering and MLOps to help data scientists focus on analysis and model development. I take a hands-on role in designing and building data platforms and development environments, as well as running machine learning systems in production. My responsibilities also include defining requirements with business teams, managing projects, hiring, and leading teams.

At GENDA, I’ve built data pipelines and data marts for group companies and migrated our machine learning platform to Databricks. I also created jupyter-databricks-kernel, an open-source tool that lets data scientists work with Databricks using their preferred editors and AI agents. I share insights from this work through technical articles and talks, and was named a Databricks MVP for 2026. Alongside my role at GENDA, I help improve PIVOT’s data platform as an independent contractor.

2. Core Skills

  • Data platforms: Databricks, Snowflake, BigQuery, dbt Core, dbt platform, Airflow (MWAA)
  • Cloud platforms: AWS, Google Cloud, Azure
  • Infrastructure as code: Terraform, HCP Terraform, CloudFormation
  • MLOps and AI: DataRobot, Snowpark ML, Databricks Notebooks, Jupyter Kernel, MCP, AI coding agent workflow
  • Development tools: Git, GitHub, CI/CD, Dependabot, Renovate, Docker, Nix, mise
  • Programming languages: Python, Go, SQL, C, C++, Shell Script
  • Team leadership: data team management, code review, hiring, 1:1s, technical handoff

3. Professional Experience

3.1. GENDA Inc. | Data Engineer / MLOps Engineer; Data Science Team Manager

Nov 2024 - Present | Full-time

  • Lead data utilization work for group companies, connecting management, sales, and field requirements in an M&A-expanding business to data platforms, data marts, dashboards, and analytics workflows.
  • Became Data Engineering Team Manager in 2026/04; manage progress, code reviews, 1:1s, hiring activity, and technical handoff practices.
  • Became Data Science Team Manager in October 2026, with responsibility for hiring, project management, 1:1s, and engineering work outside data science.
  • For karaoke business data utilization, organized 9 management and sales reports, 13 ingestion DAGs, and 37 dashboards into a roadmap with dependencies and migration priorities.
  • Reduced shop-analysis report generation from roughly 1-2 days to about 20 minutes by improving the generation process.
  • Improved MLOps by introducing CI/CD, Ruff, mise, review-backed deployment, and Databricks-based scoring migration where appropriate.
  • Improved AI-ready notebook and development workflows so data scientists and data engineers can validate business value faster with safer developer experience.

3.2. PIVOT Inc. | Freelance Data Engineer

Jun 2025 - Present | Contract

  • Build and optimize BigQuery and dbt models for KPI reporting, referral analytics, GA4 / ULIZA tracking, and model performance.
  • Reworked OOM-prone window-function-heavy logic into a JOIN-based design and reduced a major model runtime from 51-90 minutes to a few minutes.
  • Implemented incremental all-period user tracking with GA4 identity resolution from anonymous visit through login.
  • Improved BigQuery MERGE efficiency through stable merge keys, partitioning, and clustering.

3.3. hacomono Inc. | Data Engineer

Apr 2024 - Oct 2024 | Full-time

  • Served as solo data engineer owning customer and internal DWH transfer operations, infrastructure / IaC changes, and delivery support across BigQuery, Embulk, AWS, Google Cloud, Terraform, and Terragrunt.
  • Improved batch transfer stability using RDS metrics, transfer logs, and Embulk tuning.
  • Moved BigQuery permissions from manual grants toward Terraform-managed dataset-level access control.
  • Validated RDS MySQL to BigQuery real-time transfer with Google Cloud Datastream and documented failure / recovery behavior.

3.4. CNS HOKKAIDO Co., Ltd. | Data Engineer / MLOps Engineer

Apr 2022 - Mar 2024 | Full-time

  • Migrated 50 customer-behavior prediction workflows from on-premises infrastructure to AWS, Snowflake, and DataRobot.
  • Led dbt Core migration from Snowflake Python API and Jupyter Notebook workflows to improve dependency visibility, readability, and maintainability.
  • Investigated migration from DataRobot to Snowpark ML for cost, performance, and security; led a small validation team.
  • Improved parallel execution for Bayesian retail customer-count prediction across roughly 200 stores, completing processing in about 2 days against a 4-day requirement.

3.5. Shinko Shoji LSI Design Center Co., Ltd. | Embedded Software Engineer

Aug 2018 - Mar 2022 | Full-time

  • Developed automotive and industrial embedded firmware for traction-control updates, sprayer inverter control, and operation controllers across requirements, design, implementation, and testing.
  • Worked with C / assembler, Renesas and GHS embedded toolchains, RH850 / RL78 microcontrollers, QAC, and winAMS.
  • Automated formatting for 30+ test specification documents across 5 engineers; used Python for customer-facing analysis materials and delivered CAN communication lectures.

3.6. Okuma Corporation | Windows Application Engineer

Apr 2016 - Jul 2018 | Full-time

  • Worked on Windows CAD / CAM applications for CNC machine tools, including UI requirements, testing, user inquiries, defect handling, and performance tuning.
  • Built a foundation in quality assurance, domain understanding, and user-facing software maintenance.

4. Education

  • Bachelor of Science in Mathematics, Hokkaido University

5. Certifications

  • Apr 2023: Japan Statistical Society Certificate Grade 2
  • Mar 2015: TOEIC 805

6. Speaking and Writing

6.1. Talks

6.2. Writing

6.3. Awards