Skip to main content

Integrations

Sources​

There are many different sources that are integrated in the data platform. This page categorizes each source by functional domain and explains when new/existing data is being ingested/refreshed.

Charging Data​

We ingest charging data in order to monitor performance of HyperFast chargers. This data includes names of charging destinations, charger EVSE numbers, and charging session details. We currently integrate charging sessions from 2 sources: E-Flux and MobilityPlus. From MobilityPlus, we ingest both the CPO sessions and MSP sessions.

Curtailment Data​

Curtailment data is collected from Elindus and Spectral. These curtailment volumes allow us to make the analysis on when curtailment has been done, for what volume, and what the theoretical production would have been if curtailment didn't take place.

Device Data​

Sim data is stored in and collected from KPN for devices in The Netherlands. This includes details such as the usage of the device, the device name, IP address, and so on. In this way we can easily monitor data usage and take the necessary actions where needed.

Sim data for devices in Belgium is stored in Proximus. This integration needs to be added to the data platform.

Forecasting Data​

On the file server of Meteologica, forecasting results are stored 3 times a day for a couple of assets, including Sellingen. These files only remain on the SFTP for 2 weeks. Therefore, an integration with this server is made, to systematically copy all files before being removed.

Market Data​

Data concerning the energy market is collected from a variety of sources for different purposes.

Elia data is ingested to extract market information related to the Belgian energy market. It includes information such as the production profiles, monitored capacity and the day ahead forecast (11h).

For market information in The Netherlands, we use Nationaal Energie Dashboard (NED) as the source of truth. This contains similar information as Elia, however without a day ahead forecast.

We also consult data from ENTSO-E. This source is used for extracting day ahead and imbalance prices (both long and short) for the market in Belgium and The Netherlands. Besides ENTSO-E, imbalance prices are also extracted from 2 more sources. Both Elia and TenneT, for Belgium and The Netherlands respectively, are also used to compare imbalance prices with ENTSO-E. In this way, we want to ensure that there is always an imbalance price available for a given quarter-hour, even though one or more sources don't provide an accurate value at that moment.

Master Data​

Asset metadata is currently stored in Solarbase. We ingest data such as asset details, transformers, meter (ean) details, and so on. Once all asset metadata is migrated to Sitemark, we will use these APIs to act as the single source of truth for all asset and meter master data.

Measurement Data​

Measurement data for a variety of assets is collected through several different integrations. Most sources are related to PV assets, but also WIND and BESS assets are collected.

These are the metering companies that are currently used to extract measurement data in The Netherlands:

  • Anexo
  • Fudura
  • Het Meetbedrijf
  • Innax
  • Joulz
  • Kenter

These are the metering companies that are currently used to extract measurement data in Belgium:

  • Elia Traxes
  • Fluvius
  • Ores (TO BE INTEGRATED)
  • Resa (TO BE INTEGRATED)

Trading Data​

For BESS Harmignies, an integration is made with the Yuso SFTP to extract trading results. On this file server, CSV files are uploaded daily with information regarding to various trading metrics.

Ingestion and Refresh​

All of the above data is ingested and processed each morning at 04:00 on a daily basis to keep track of recent progress. However, to ensure correct volumes are being registered by the metering companies, and to ensure we have collected all data without gaps, measurement data of the previous month is ingested at the start of each new month. This will approximately take place at the 5th of each month, so it can be processed and delivered to the production report in Tagetik.

For the charging sessions of HyperFast, 2 more ingestions take place: one at 12:00 and one at 15:30. In this way we can closely monitor charger performance and notify issues in an early stage.

New Integrations​

Once a new integration is added to the platform, it will be documented on this page. If you would like additional data to be centrally available and integrated into the data platform, please contact it@energysolutionsgroup.be.