Data sources
Every number in TradingSurv comes from an official European market feed, and every panel names the feed that answered for it. This page lists them, what each serves, and — because it matters more — what each does not.
The feeds
| Source | Status | Cadence | Access |
|---|---|---|---|
| Nord Pool Data Portal (bid curves + GB auctions) | Collecting | daily — curve slots 14:00-20:00 UTC, GB auction slots 22:00-23:35 UTC | Public |
| ENTSO-E Transparency Platform | Collecting | daily — core tick 14:00 UTC, hourly sweep otherwise | Credentialed |
| Elexon BMRS Insights (GB) | Collecting | daily 14:00 UTC | Public |
| Energy-Charts (Fraunhofer ISE) | Dormant | — | Public |
| EPEX SPOT market results | Collecting | hourly (continuous only) | Public |
| EPEX SPOT (archived Python scraper import) | Archive | once | Public |
| Elia Open Data (BE) | Planned | — | Public |
| RTE ODRE (FR) | Planned | — | Public |
| Energi Data Service (DK) | Planned | — | Public |
| Fingrid Open Data (FI) | Planned | — | Credentialed |
| SMARD (DE) | Planned | — | Public |
| JAO cross-zonal capacity | Planned | — | Public |
- Collecting
- An adapter exists and the scheduler has streams expected from it.
- Dormant
- An adapter exists but nothing is currently scheduled against it.
- Archive
- Rows came from a one-time import. There is nothing to schedule, so its age is not staleness.
- Planned
- Registered so the work has a landing place. No adapter yet.
What each one is for
- ENTSO-E Transparency Platform — the regulatory publication point for the EU. Zone-level day-ahead prices, actual and forecast load, generation by production type, installed capacity and outages. It is the backbone of the reconstruction, because it is the feed that carries fundamentals rather than just outcomes.
- Nord Pool Data Portal — aggregated supply and demand curves across 13 clusters and four auctions, plus the GB auctions N2EX and the half-hourly day-ahead product. The curves are the only public view of an order book anywhere in this system.
- Elexon BMRS — Great Britain, which ENTSO-E no longer covers. Imbalance pricing, generation, demand and settlement data at half-hourly resolution.
- EPEX SPOT — continuous intraday (SIDC) trading across 23 market areas. Nothing else in the system reports continuous trading at all.
- Energy-Charts (Fraunhofer ISE) — prices, generation mix, load, forecasts and cross-border flows, used as a cross-check.
- European Central Bank — daily EUR/GBP reference rates, so a GB price and a Continental price can be compared on the delivery day’s own rate rather than today’s.
Why the raw payload is kept
Every upstream response is written to object storage before anything parses it. Parsers change, upstream formats change, and a bug found six months from now is only fixable if the bytes that produced the bad row still exist.
It also matters for a dispute. A finding that cannot be traced back to the exact document the market published is a finding that cannot be defended, and an archive that is written only after parsing succeeds is an archive missing precisely the days that went wrong.
What happens when a feed fails
The panel says so and degrades. It does not show yesterday’s number formatted to look like today’s.
The distinction the system insists on is between kinds of empty: data that was never published, data still being collected, data that is genuinely missing, a window that has expired, a source that is unavailable right now, and a stream that was retired. Those are six different situations and only one of them is a fault. Collapsing them into a blank cell is how a pipeline stops collecting for weeks without anyone noticing.