Skip to content
Paula Livingstone writing · projects · tools

Projects

Operational Telemetry Capture Pipeline

A frictionless capture-to-lake pipeline that turns field observations, notes, and sensor readings into structured, queryable content the moment they happen.

DjangoPostgreSQLRedisCeleryDigitalOcean SpacesAndroidboto3

The hardest part of any knowledge system is not storage, it is capture. If recording a thought, a reading, or a link is even slightly inconvenient, the lake never fills.

This project builds the ingestion path end to end: a lightweight Android capture app posts to a small, well-defined microblog API; entries are normalised into typed content records; media is offloaded to object storage and thumbnailed on demand; and downstream views render the lake without ever touching the originals.

Design goals were modest and strict: every capture under two seconds, no lost data on flaky connections, and a schema that can grow new content types without migrations becoming archaeology. The result is a backbone the public site reads from, rather than a CMS the author has to feed.