Methodology
How every number on the site is sourced, computed and labelled. The decisions behind it are recorded as architecture decision records (ADRs) in the public repository.
Principles
- Official, free sources only (EIA, GIE, ENTSOG, SMARD, RTE, Elexon, CFTC, the European Commission, the ECB, Open-Meteo…). Exchange and price-reporting data that is licensed is never redistributed.
- Nothing is invented, interpolated or filled. A missing value is shown as missing; a value outside a plausible physical range is rejected and counted, never corrected.
- Values are stored in their source unit and converted only in one audited module (exact factors such as 42 gallons per barrel). The site may rescale prefixes for display (kb → mb, MW → GW, €/1000 L → €/L).
- Price types are never mixed in one spread: spot with spot, day-ahead auction with day-ahead auction, futures with futures. The GB market index (Elexon MID) is never put in a spread with continental auction prices.
- Unofficial data is labelled: futures settlements from Yahoo Finance appear only as derived indicators (spreads) and single front-month KPIs, always marked “unofficial, delayed, research only” (ADR 0003).
- Every chart states its source, unit, last date and how it is computed (the ⓘ button); every series is listed with its licence and freshness in the data catalogue.
Seasonal norms
“Against the five-year range” compares a value with the same point of the five previous years; the current year is always excluded from its own norm.
- Daily series (storage, power prices): same month and day. 29 February is left out, since it has no five-year norm.
- Weekly series (US stocks, pump prices): same ISO week of the five previous ISO years. Week 53, which only some years have, is compared with week 52, keeping the later value, so every value shown is a stored one.
- The band is the minimum to maximum of those years and the dashed line their mean; the number of years available is shown when it is fewer than five.
Derived series
- Spreads (Brent − WTI, DE-LU − France) are computed only on dates both series have.
- Crack spreads: US Gulf Coast 3-2-1 = (2 × gasoline + 1 × ULSD) ÷ 3, converted from $/gal at 42 gal/bbl, minus WTI; NY Harbor diesel crack = ULSD − Brent. All EIA spot prices of the same date.
- Daily power: consumption and generation are the average power over complete local delivery days only (23 or 25 hours on clock-change days); an incomplete day is a gap. The GB base price is computed from the complete set of half-hours.
- Futures curves: generic months M1, M2… are rebuilt from individual contracts with each exchange's expiry rule; a date where the rule's front contract is missing has no value (ADR 0007).
- Positioning: net position = long − short of each CFTC trader category; managed money is also shown as a share of open interest.
- Pump prices: taxes = price with taxes − price before taxes, both from the same weekly bulletin.
Freshness, gaps and rejected values
- Each series has a normal publication delay (e.g. one day for GIE storage, about a week for EIA spot prices). A series is delayed or stale only beyond that delay; the badge on each chart says which.
- A gap is an interval between observations longer than normal for the series (a missing day for daily power, more than five days for business-day prices).
- Every ingestion run records rows written and rejected, with reasons (outside a plausible range, timestamp in the future, duplicate). Runs with problems are listed on the data page.
Home map and Today in energy
The map compares different series on one colour scale using unit-free measures of each series' latest observation (ADR 0008):
- vs 5-year average: distance from the mean of the same day or ISO week, in % of that mean (at least three prior years).
- Latest move: the latest change divided by the standard deviation of the changes over the year before it (a z-score).
- 5-year percentile: the share of the past five years' values at or below the latest one.
“Today in energy” sentences come from fixed rules: EU storage against its norm, moves of at least two standard deviations, values beyond the 95th or 5th percentile of five years, and the storage country furthest from its norm. Marker positions come from Natural Earth (public domain) and are approximate.
Forecasts
- Every live forecast is stored when it is made, with the real time, and can never be changed or deleted; a live forecast of an outcome already published is refused (ADR 0009).
- Each forecast carries its two baselines' forecasts (naive and seasonal) for the same target. A model is said to beat its baselines only with at least 30 scored forecasts and a mean absolute error at least 5% lower than each.
- Backtests are walk-forward: each past forecast uses only the data published on its issue date. They use today's revised data, and the French demand backtest uses the observed weather, so backtest errors are optimistic; live and backtest results are always shown separately.
- 90% intervals are the 5th–95th percentiles of earlier errors at the same horizon (at least 50 of them).
Lab
- Rules are built from a form of allowed choices and bounded numbers; nothing typed is run as code. Everything is computed in the browser (ADR 0010).
- A decision taken at the close of a day is executed at the next close, never at the price that produced it; costs are subtracted per round trip and shown at 0–4× the stated cost.
- Results are split into a tuning period (first 70%) and a control period (last 30%); the Sharpe ratio is marked as not meaningful below 20 trades. For spot spreads, the P&L measures a signal, not something one can hold.
- The simulator replays blocks of the series' own daily changes (full history, crisis or calm periods) with a fixed seed: it cannot produce moves larger than those in its sample.
Freight and chokepoints
- Transits come from IMF PortWatch, which counts ships crossing each chokepoint from AIS vessel signals (a crossing spanning several days counts once). Tanker cargo is an IMF model estimate (estimated payload times deadweight tonnage), labelled as such. PortWatch publishes about five days behind (ADR 0013).
- Daily counts are read as 7-day means over consecutive days; a window with a missing day gives no mean. The norm is the mean of the same calendar days in the five previous years.
- Disruption events (e.g. HORMUZ-26) are shown as PortWatch publishes them: name, dates and alert level, with no interpretation added.
- Distances are computed, not observed: shortest sea paths on the Eurostat maritime network (searoute) between Natural Earth ports, checked to cross the passage each variant names. Days at sea assume 13 knots for crude tankers and 17 for LNG carriers, with no port time or weather margin. Freight rates and bunker prices are licensed and not shown.
Data licensing
Exchange prices (CME, ICE, EEX, EPEX SPOT) and price assessments (Platts, Argus) are licensed and are not redistributed here. The site shows instead official spot prices and fundamentals, day-ahead auction results published under open licences, and derived indicators from unofficial futures data, labelled as such. ICE Commitments of Traders cannot be republished under ICE's terms, so European positioning is a declared gap.
Every source used, with its licence and required attribution (from the series catalogue):
Known limits
What the site deliberately does not cover, and why:
- Daily European hub gas prices (TTF, NBP, THE, PEG). Exchange prices (ICE Endex, EEX) are licensed and not redistributed. Europe is covered by the IMF monthly benchmark, and daily TTF indicators come from the unofficial NYMEX Dutch TTF contract (front month and M1–M2 spread, labelled). NBP, THE and PEG have no free daily price.
- UK gas storage and UK LNG terminals. GIE AGSI+ and ALSI have published no UK data since Brexit.
- Norwegian pipeline flows into Germany (Emden, Dornum). ENTSOG reports these points under several operators with overlapping values. Adding them up would double count, so they are not shown until a reliable reconciliation exists. Norwegian flows into France and Belgium are shown.
- European gas positioning (TTF Commitments of Traders). ICE publishes it, but its terms forbid republication without written permission. The CFTC does not cover TTF.
- ICE Brent and ICE gasoil futures prices. Licensed exchange data. Brent and diesel prices come from EIA spot assessments; curve structure comes from unofficial NYMEX contracts (WTI, the Brent Last Day look-alike, NY Harbor ULSD, RBOB), shown as spreads only.
- Dated Brent, Dubai, Oman and Urals assessments. Physical crude assessments (Platts, Argus) are licensed. Brent is shown with the EIA spot price; Middle East and Russian grades are not covered.
- IEA and OPEC monthly oil market reports. The IEA Oil Market Report is paid, and OPEC's secondary-source production tables cannot be republished. The world balance and OPEC capacity shown are EIA's STEO estimates (public domain).
- Crude and product stocks outside the US (OECD, ARA, Fujairah, Singapore, China). Weekly ARA stocks (Insights Global) and Fujairah data are licensed or not redistributable; OECD and Chinese stocks are monthly or unofficial. Only US weekly stocks (EIA) are shown.
- Brent and ICE gasoil positioning (Commitments of Traders). ICE publishes it, but its terms forbid republication without written permission. CFTC positioning is shown for NYMEX WTI, RBOB and NY Harbor ULSD.
- North-West Europe cracks and wholesale product prices. NWE diesel, gasoline and jet cargo prices (Platts, Argus) and ICE gasoil are licensed. European refining margins are therefore not shown; EU pump prices (with and without taxes) come from the Commission's Weekly Oil Bulletin.
- LNG prices (JKM, delivered North-West Europe). Delivered LNG prices are licensed assessments; no free redistributable source exists.
- LNG cargoes by origin. Cargo-level data comes from licensed ship-tracking services. Terminal send-out into the grid is shown instead.
- Power forward curves and intraday auctions. Power futures (EEX, ICE Endex) and exchange intraday data (EPEX SPOT) are licensed. Day-ahead auction prices (DE-LU, France) and the GB market index are shown instead.
- GB day-ahead auction price. The N2EX and EPEX GB day-ahead auction results are licensed. Great Britain is shown with the Elexon market index (MID), an index of short-term trades, labelled as such and never put in a spread with continental auction prices.
- GB embedded solar and wind. Elexon reports transmission-connected generation only. Most British solar is connected to distribution networks, so it is missing from the GB generation mix, and GB demand (INDO) excludes demand met by it.
- Clean spark and dark spreads. They need a daily gas price and a carbon price of the same kind as the power price. The only daily gas price available is a futures contract (unofficial), and no free EUA price is confirmed, so mixing them with spot power would break the like-for-like rule.
- EUA carbon price. No free, redistributable daily source confirmed yet.
- Tanker and LNG carrier freight rates. Route assessments (Baltic Exchange TD and TC routes, Worldscale flat rates, Clarksons time-charter rates) are licensed and not redistributed. The freight page shows what is free: transits through the chokepoints (IMF PortWatch) and computed distances and days at sea.
- Bunker fuel prices. Marine fuel prices (VLSFO, HSFO, LNG bunkers at Singapore, Rotterdam, Fujairah) are licensed price assessments. Without them, voyage costs are not computed: only distances and days at sea are shown.
- Vessel-level tracking (cargo origin, destination, ship names). Raw AIS positions and cargo-level trade flows come from licensed ship-tracking services. PortWatch publishes daily counts per chokepoint, derived from AIS, which is what the freight page shows.