Data format & validation
Last updated
Last updated
Fuel Switch supports both CSV and XLSX file extensions for manual energy data uploads through our user interface. However, we suggest using CSV files when uploading energy data directly to our API, since the formatting of XLSX files can be bit tricky.
The sections below describe the data formats that we support, i.e. the content of the energy data uploads. Please inquire if you would like us to integrate your data format.
In its most basic form, an energy reading is just an amount (kWh generated) and a timestamp (date and time of generation). We call this our Raw format, which we use internally in our data processing pipelines. Fuel Switch users can also upload their energy data in this format.
Our Raw format consists of an ISO 8601 timestamp and an energy reading in kWh (comma delimited), as shown in the example below:
Fuel Switch enables limited support for energy data from PNPSCADA meters.
As mentioned before, every reading is associated with a specific meter of a specific project. Readings must also be valid and trustworthy. For example, solar PV data must only contain data generated by the panels, not data from grid, if measured on the inverter.
Internally, we do several validation checks. If the energy data fails to comply, our system will reject the attempted upload. For data to be accepted, energy data must at least comply to the following criteria:
Format: File and data must comply to one of the supported formats, described above.
The energy reading must be a valid number
The timestamp must be a valid ISO 8601 timestamp
Chronological: Order matters for timestamps.
Energy data entries must appear sequentially, sorted by timestamp from oldest to latest reading. In other words, today's readings must appear after yesterday's readings, for the energy data to be valid, if you are uploading a single file for both days.
Upload older energy data files first. For example, if you try to upload yesterday's data after you uploaded today's data, you might get an error.
Resolution: The time interval between energy readings can't be less than 1 second.
Limited Production Rate: The max number of RECs that can be produced in a second is one hundred. In other words, energy readings can't exceed 100MW per second.
No Future Timestamps: Energy readings with a timestamp in the future (relative to the time when uploading), will be rejected.
Zero Readings are Rejected: We filter out all energy readings with a value of zero.
Unique: Energy data uploads must not contain any duplicate values.
Commission Date Matters: Energy readings older than the commission date of a project will be rejected.
Incremental: Fuel Switch expects incremental energy readings, as opposed to cumulative readings. This means that each data point must define the amount of energy produced within a given timeframe, not the amount of energy produced to date.
