Julian Wiley

Flink job packaging notes

Quick reference for flink job packaging notes.

Context

Project: RPi Kubernetes

Repository: rpi_kubernetes

This note is a compact reference for a hybrid k3s homelab with an Ubuntu control plane, four Raspberry Pi 5 workers, Cloudflare Tunnel, and a data platform made from Kafka, Flink, Redis Stack, MinIO, DataHub, Airbyte, Polaris, and observability services.

Checklist

  • Use PyFlink for exploration
  • Use Java artifacts for stable TA-Lib jobs
  • Keep job images explicit
  • Record session cluster and savepoint behavior

Commands and inspection

# Start with the project README, then narrow to the subsystem docs.
rg "Flink" .

# For Kubernetes-backed components, inspect the namespace before changing it.
kubectl get pods --all-namespaces

Usage note

Keep this note close to the implementation. If the command, manifest, or API changes, update the reference before writing a narrative post about the change.