local-data-platform
A Go CLI that stands up Hadoop, Hive, and Spark on one machine — profile overlays, typed config generation, and wrapper commands, so pipelines can be validated without waiting on a cloud cluster.
Back in late 2025, I was frequently waiting on cloud clusters to validate data pipelines, which was a significant bottleneck in my workflow.
Local Data Platform was my solution: a Go CLI that sets up Hadoop, Hive, and Spark on a single machine, allowing me to validate pipelines quickly without relying on external infrastructure.
My workflow has since moved toward tools designed for coding agents, but Local Data Platform remains useful for validating pipelines locally.