Options for AEMO data delivery to ez2view (as at August 2023)

[this information is accurate at the time of posting – Tue 29th August 2023]

Our client base for ez2view continues to grow – particularly with respect to new entrants to the NEM (owners and/or operators of Wind and/or Solar and/or Battery assets).

Some of these clients (and prospects) have asked about the options available.

 

(A)  Options for AEMO data

On the ‘ez2view Help’ site, there’s this page that has been created to highlight these four different types of options.

Scrolling down that page there is this image that highlights four different options for AEMO data access inside of ez2view (noting that other, non-AEMO, data is available differently):

With respect to these four options:

 

Option 1 = do you have Private Data?

If you have private data (i.e. data for your assets that you view in real time but the rest of the market sees as ‘next day public’),  then there is added value in having ez2view point to this data source.  Within this option there are two permutations:

Option 1A = ‘bring your own’ Private Data

If you have your Private Data stored in a database platform that is fully supported by the AEMO, we will ensure that ez2view works with reference to that data source.

The ‘fully supported’ AEMO options are currently Microsoft SQL Server and Oracle … though we understand some participants (and third parties) might consider using other platforms as discussed below.

Option 1B = we’ll help you with a Hosted MMS with Private Data

For an increasing number of clients, we are acting as an outsourced service provider in establishment and management of their own Private MMS.

We do this in Microsoft SQL Server.

 

Option 2 = no have Private Data?

If you have no assets, it’s most likely you also have no access to Private Data – as such the options you have

Option 2A = default GR Cloud Data Source

This is the default way that ez2view is set up to work, as shown here:

You need to de-select this default Option 2A to choose Option 1A or Option 1B ... or potentially also Option 2B.

Option 2B = other Public MMS

It would be technically possible to point ez2view through to some other EMMS (which only contained Public Data) … however we’re not aware of any client who does this (or what the reason would be why they would do this).

 

(B)  What are the AEMO-supported database platforms?

In this table, we’ve highlighted the four main database platforms we are aware of, with comments about the extent to which they are officially supported by the AEMO, and hence how they have been addressed in ez2view.

 

EMMS
Database Platform
Certified,
and supported by AEMO?
Compatible with ez2view?

Microsoft SQL Server

YES, the AEMO supports the EMMS on various versions of the MS SQL Server database platform (see below for details).

This is our preferred platform, and the one we work most often with.

YES, ez2view is supported on this database platform.

See the installation guide from the relevant ez2view version (accessible here) to gain reference of the specific platform versions for MS SQL Server that ez2view is supported on.

Oracle

YES, the AEMO supports the EMMS on various versions of the Oracle database platform (see below for details).

YES, ez2view is supported on this database platform.

See the installation guide from the relevant ez2view version (accessible here) to gain reference of the specific platform versions for MS SQL Server that ez2view is supported on.

PostgreSQL

It is our current understanding (see below) that NO, PostgreSQL is not currently supported by the AEMO for the EMMS.

Our position with ez2view partially stems from this….

NO, ez2view is not currently supported on this database platform.

—-

In 2022 we had a client request that we invest time to make ez2view compatible with PostGres.  The client was planning to migrate their EMMS from Oracle to PostgreSQL

GR Case 00006026, for our records

Following this request, development effort was undertaken – but before this could be completed (and tested) the client cancelled their database migration process.

As such these code changes remain untested and may be removed in the future.

My SQL

It is our current understanding (see below) that NO, My SQL is not currently supported by the AEMO for the EMMS.

Our position with ez2view partially stems from this….

NO, ez2view is not currently supported on this database platform.

 

For more context, what follows is some further AEMO documentation.

(B1)  from March 2020

In March 2020 the AEMO published its ‘Data Interchange Frameworks and Glossary (v2.01).

On p19/36 in the PDF they describe the database management systems supported – which has been copied here, with highlighting for ease of reference:

(B2)  Coincident with EMMS v5.1 (from Oct 2021)

The AEMO released EMMS v5.1 in October 2021 to support the establishment of the Wholesale Demand Response Mechanism (WDRM).   To support this, they released the EMMS Release Schedule and Technical Specification.

On page 104/121 there are answers that AEMO provided at the time with respect to other database platforms (beyond MS SQL and Oracle) that they support.  These pages are copied below (with highlights), for ease of reference:

(B3)  Coincident with EMMS v5.2 (May 2023)

The AEMO released EMMS v5.2 in May 2023 to support a number of market changes scheduled for later in 2023 and into 2024 … with the first being the enablement of MaxAvail in the bid for Semi-Scheduled units (on Monday 7th Aug 2023).

To support this, they released the EMMS Technical Specification.  On p21/104 in the PDF they highlight that MS SQL Server and Oracle remain two only fully supported (and certified) database management systems:

As such, we continue to focus our attention on supporting ez2view when pointed to copies of the EMMS on any of these platforms.

 

Please give us a call (+61 7 3368 4064) or send us an email if you have questions on any of this?