SparkLabX is a lab of practical open-source projects — data platforms, AI agent kits and developer tools. Every one started as a problem we had to solve for real work, and ships with the docs, tests and guard-rails to run it yourself.
Self-hosted building blocks for Spark and lakehouse teams — the parts between "it runs on my laptop" and "it survives Monday morning".


Self-hosted Spark notebooks with per-user kernels and S3 storage
A Jupyter-style notebook for Apache Spark (PySpark and Scala). Each user gets a private kernel and an S3 prefix enforced by MinIO IAM, with OAuth login. Runs with Docker Compose or a Helm chart on Kubernetes.

Rewrite Iceberg metadata paths after moving data to S3, no JVM
A pure-Python CLI and AWS Lambda that rewrites stale paths (s3a://, hdfs://, local) in Iceberg metadata after a data sync to S3, writes the result to _migrated/ and registers the table in AWS Glue.


One pipeline spec, compiled for the engines you already run
Nodus is a data-platform hub. Pipelines are declared once in a git bundle and compiled at deploy time for Trino or Athena, Spark or DuckDB, Argo, Temporal or Airflow. An agent runs them inside the customer's environment.
Skills, validators and self-checks that turn an agent's first draft into a correct diagram, deck or visual — not just a plausible one.


Agent skill and CLI for valid, consistently styled draw.io diagrams
A stencil catalog, layout rules and an XML validator in one bundled drawio-ai CLI. Agents declare topology and nesting; the engine computes coordinates, validates the result and renders it for a vision self-check.

Themed PowerPoint decks from a declarative spec, built for AI agents
Describe slides as plain objects; buildDeck writes a .pptx on 17 fixed-grid templates. A theme file holds colours, fonts and logos, a validator rejects overflowing slides, and a PDF render lets the agent check its work.

Agent skill for marketing visuals built as re-runnable scripts
Workflow, design rules and Python scripts for social banners, posters and promo posts. Layouts are JSON configs built headlessly into an editable VectorCraft document; each revision is a config edit and a re-run.
Each one exists because we hit the problem ourselves: no root, a locked-down network, a kiosk that has to run offline.

Install Debian/Ubuntu packages under your home directory, no sudo
lapt wraps apt-get download + dpkg -x to install .deb packages under ~/.lapt without root or writes to the dpkg database. Each package gets its own tree with its dependency closure, so removing one can't break another.


Self-service photo booth kiosk: VietQR payment, printing, QR download
Korean-studio-style photo booth software: guests pick a frame, pay by VietQR, shoot with a countdown, choose shots and colour, then print and scan a QR to download. One Go binary with SQLite, runs offline.

macOS: reach internal hosts from outside via an SSH SOCKS tunnel
From outside the office network, jump-proxy sends only internal hosts through an SSH SOCKS tunnel to a machine inside (e.g. over Tailscale); everything else goes direct. One install, no sudo, auto-reconnecting tunnel.

macOS split routing: internal hosts via office LAN, the rest via phone
In a restricted office network, split-route sends internal hosts via the office Wi-Fi or LAN and everything else via an Android phone on USB tethering (TetherKit). A LaunchDaemon re-applies it on network changes.