2026 Week 22

Timeseries processing pipeline

VWC calculation finally implemented, only a few more calculations to go!

UI

The FDRI UI has been split into separate internal and public sections. This is to support development and deployment of the public FDRI UI, and will mean that any saved bookmarks will no longer work.

The internal UI (everything FDRI related except for the new timeseries data explorer and the FDRI spatial explorer) can now be found here https://dri-ui.dri.ceh.ac.uk/fdri-internal

The public UI (the new timeseries data explorer and the FDRI spatial explorer) can now be found here https://dri-ui.dri.ceh.ac.uk/fdri

image

Flux

The main news for Flux is removing the hard-coded paths within the time series processor and bringing all the processing in line with the other workflows. Now instead of a special EddyPro command, it’s possible to request a dataset in the normal way and if the metadata service calls for EddyPro processing, that’s all handled through the usual DAG mechanism. Thanks to Richard for putting a sizable PR together to do this!

Once that’s merged, and with the telemetered data now coming in (as mentioned in last week’s update), we’re now almost at the stage where we can start running the pipeline end-to-end in AWS. The next piece of work is to set up the infrastructure to do this, and debug any issues that come up once it’s in place.

AWS Migration

We have now migrated all of the FDRI and Cosmos data to the new accounts, and the processors are running and processing live data! This means we can now start to switch some services off in the old account.

image

Geospatial API and UI

Work has started adding the logic to the API and UI to be able to fetch geospatial data directly from the metadata api and represent it nicely in the FDRI spatial explorer

image