Week 20 - Product release: Live data pipeline

This week’s weeknotes is a special edition, as we announce the next release of Weave!

In September we released a prototype - or alpha - of Weave. We de-scoped that version of the dataset to only contain data for February 2024, so we could build and learn quickly. Since then we’ve been gathering feedback and working on a live data pipeline.

From today, our beta-version is available to use. There are two key improvements:

1. The dataset now covers 2024 to date and most importantly,
2. It's now a live data pipeline that updates as and when new data is published.

You can check it out here: https://weave.energy/beta

This new data set covers the SSEN region only (hence it being a beta and not the full release!). Over the coming weeks we will be adding the other DNOs that are currently publishing data (UKPN, NGED and NPG) and with time we will also include ENWL and SPEN, as and when they start publishing.

We debated whether to hold-off on the release and wait until we had data for all DNOs, but we decided to stay true to building in the open, and get it out there. The dataset offers a much longer time horizon (Jan 2024 to present), which should enable much more interesting forms of analysis.?

The simplicity of the solution masks the incredible work by Steve to get the data pipeline functioning and accessible to anyone. Although it seems like we’re just releasing a new dataset, we’ve actually taken a huge leap forward in terms of reliability and longevity.

With this release, comes a new way to contribute to the project. We’ve been amazed by the response to Weave since our initial launch, and believe the future of the project will be community-led. If that sounds interesting to you, check out our github page on how to get involved.