FEEDING HUNGRY DATA MODELS: HOW TO ENSURE ACCURATE & CONSISTENT DATA FOR YOUR DATA MODELS
Power traders and Generation Managers rely on accurate generation & transmission flow data to make decisions. With the increasing use & reliance on automation & modeling it is ever more important to ensure the data is clean, accurate & consistent. Here is a quick overview of how our users can rely on & utilize Live Power Generation & Transmission data to make decisions and feed their models.
STEP 1: START WITH ACCURATE DATA
Live Power, Yes Energy’s data partner, monitors, calibrates and delivers real-time generation & transmission flow data at 60 second intervals. This data is closely observed and calibrated against other generation data sources. This attention to accuracy means that their real-time data closely matches sources like SCED & CEMS data (see video 1)
Video 1. Time Series Chart showing Live Power Generation along with SCED, & CEMS data for the same power plant - Rio Nogales in ERCOT. CEMS
STEP 2: ENSURE A CONSISTENT FLOW OF DATA
In addition to the data Yes Energy collects & maintains, we integrate data from our partners, helping traders see a full picture. Real-time Generation & Transmission data is only available in Yes Energy products through a subscription to Live Power data & Planned Generation Outage intelligence is provided through a subscription to IIR Energy. SCED & CEMS generation data is available as part of Yes Energy tools but for both there is a 45- 60 day reporting lag. Blending the real-time & historical generation data sources provides multiple benefits:
Provides users with a consistent flow of data from which to base their analysis - even if SCED or CEMS reports aren’t yet published (see video 2).
Video 2. SCED & CEMS Data does not have anything published past October 5th. Live Power real-time generation data (blue) continues and indicates that this plant has come offline. IIR Energy (black line) has reported an outage for this plant. The real-time generation confirms that the plant does indeed go offline - and actually turns off a bit early and comes back on a bit late. Real-time LMP for HB_HOUSTON indicates some volatility during this time and generation appears to be a fundamental driving the market. Access to the Live Power Real-time Generation data & IIR Energy’s plant status provides this insight.
Allows users to set a priority level for each of these data series - setting the order in which each data source is used (see figure 1).
Figure 1. Use the NVL function with the three data sources for generation data in ERCOT - SCED, CEMS and Live Power. This function creates a data series that displays the available data sources in order of priority, ensuring that when one data series has a null value, other sources fill in the gaps.
Provides a complete data set with which to feed models
STEP 3: FEED SOFTWARE WITH THE ACCURATE CONSISTENT DATA FROM YES ENERGY.
Video 3. Use the Data Table View in the Time Series Analysis module to export the data to Excel. This will pull all of your data series including the blended data series ensuring that your models are not fed null values.
Video 4. DataSignals users can build queries using these generation & transmission flow data series. To address null values, users can use Yes Energy’s “Best Generation Data Series”, create a coalesce statement in their modeling software or configure the data so it is customized for each generator. Then use this latest & greatest generation & transmission data to feed your power flow modeling or any other data model downstream.