2026 Week 26

Ecolog 1000

image

Update on the ecolog is the data, is passing a bit further through our infra. Updated this diagram to be colour coded a bit better, green is done, orange is in progress and red is coming soon!

Flux

Missing data bug

image

We had a bug reported from WP1, that randomly some gaps of 2 minutes were showing in the ui (see the vertical lines on the chart showing data gaps). We looked into this and since 18th June, one of the devices started sending us data encoded in CP1252 instead of UTF-8, the invalid payloads were causing batches of messages to fail together. This bug has now been fixed and we have recoved the missing data.

Spatial Explorer

We have started adding layers to the staging version of the UI. At the moment there are still a few issues to be ironed out, but we are hoping to be able to properly visualise data soon.

image

Public UI

Work on the public UI has been concentrating on quality of life improvements. These include:

Network Monitoring Dashboard

In addtion to the on-going heatmap work shown in last week’s weeknotes, there have been two main peices of work on the Network Monitoring Dashboard. Firstly, we have started using the new timeseries charts built for public UI within the Dashboard. Each site will have a set of charts that show data for the sensors found at that site. We are stripping it down to just the charts without the controls to add more plots and variables since its purpose is to just provide a set of standard charts (you may remember something similar for COSMOS on the older UI). The work is on-going, this is how it currently looks:

Screenshot 2026-06-29 104941

Secondly, we have tidied the navigation in the Dashboard to be Network specific. This removes duplication of some buttons and provides functionality relevant to each Network and Site. Here’s how it now looks:

FDRI and COSMOS

Screenshot 2026-06-29 084630

NRFA

Screenshot 2026-06-29 085141

Service monitoring and logging

We now have some structured JSON logs accross our ingesters, viewable via an UI. Next up is to add the same to our APIs and processing pipelines.

image

Metadata

We are starting to put some metadata for our EA and SEPA ingesters into the metadata store via the ingester tool. We can then delpoy them in our new AWS accounts.