Pre-Integration Testing (PIT)


PIT Guidance Documentation & Templates

Pre-Integration Testing (PIT) is a requirement for all users of the new Market-wide Half-Hourly settlement arrangements, including software providers to participants. 

PIT will be performed by all users of the new settlement arrangements to validate every system or service that is included in the MHHS end-to-end (E2E) Design for compliance with its functional and technical requirements. This includes back-office systems if affected. The system/service may have several components and PIT refers to the testing conducted when those components have all been internally integrated. 

PIT is the responsibility of each Programme participant, using their own systems, test environments, test data, test artefacts (scenarios and test cases), test processes, test tools, test management tool and defect management process. 

If you have any questions on PIT, please email [email protected]

1:30 time

data.jpg

PIT Guidance Documentation & Templates

The latest Pre-Integration Testing (PIT) Guidance document sets out what is expected of Programme participants regarding their own PIT testing, whether the Programme participant chooses to go through the Systems Integration Testing (SIT) or non-SIT route.  

The Programme held a PIT Guidance session on Thursday 4 April, to walk participants through the updates and the approach to PIT. You can view the slides, recording and Q&A below:

PIT Guidance Walkthrough slides

PIT Guidance Walkthrough recording

PIT Guidance Walkthrough Q&A

Since then, the Programme has uplifted the PIT Guidance document to version 2.5 which now also includes an overview of Non-Functional Test delivery expected within PIT.

The updated PIT Guidance includes the following: 

  • An overview of Non-Functional Test (NFT) delivery expected within PIT including:
    • A test to be carried out at volume against Programme Non-Functional Requirements (NFRs).
    • Full suite of performance testing to be carried out.
    • Component Resilience and Data Loss Testing at volume, where Resilience Components are defined as layers within the stack e.g., adaptor, web and application server and Design Build (DB).
    • Migration at expected volumes alongside daily use.
    • Infrastructure and Results to include the Data Integration Platform (DIP) Adaptor and scaled, production sized during PIT. There is no DIP Simulator available.
    • Evidence of Observability being in place to assure results.
  • The document has been aligned to the latest Programme position regarding Interim Release (IR) versions to be used during Component Integration Testing (CIT) - IR2 and SIT Functional Test execution - IR5.
  • Increased clarity on the availability of supporting DIP Simulators for Programme participants PIT activities.
  • Amendments to references of DBT2 as DBT2 testing evidence is no longer a requirement for MHHS Qualification based on the following position, stated by the Code Delivery Bodies:
    • The scope of Qualification under the Balancing & Settlement Code (BSC) and Retail Energy Code (REC) is defined by the relevant Code Delivery Bodies’ vires that are limited to the requirements within the respective Code.
    • The Code Delivery Bodies have not yet identified any code requirements that are outside the scope of the MHHS design that Programme participants will be required to cover as part of their PIT evidence for Qualification.

On Thursday 18 July 2024, the Programme published clean and red-lined versions of PIT Guidance v2.6 which includes guidance for Operational Testing for both SIT and Non-SIT Programme participants. You can view these versions below.

You should read the PIT Guidance document in conjunction with the E2E Testing & Integration Strategy document.

The PIT Guidance document includes splitting of Design, Build and Test 1 (DBT1) PIT across multiple tranches of PIT for SIT participants only. For SIT Programme participants it also includes DBT1 PIT timelines for deliverables for entry into all SIT stages. The PIT Guidance additionally includes further details about the scope and test coverage of PIT, test evidence, test assurance scope and Programme participant’s adopting the Placing Reliance policy for PIT.  

The Programme has provided templates as a guidance for PIT test deliverables. SIT participants will be required to use the Programme’s Requirements to Test Traceability Matrix (RTTM) template.  

For all other templates, SIT participants can choose to use the MHHS templates or use their own, provided that all the required information specified in the MHHS templates is included. You can find the MHHS PIT Templates below. 

For non-SIT Programme participants, please refer to the Qualification Approach and Plan for further information about the templates. 

The MHHS PIT Guidance document and the Templates are below: 

PIT Guidance Document v2.6 (clean)

PIT Guidance Document v2.6 (red-lined)

PIT Approach & Plan Template

PIT Requirements To Test Traceability Matrix Template

PIT Test Scenarios Template

PIT Test Completion Report Template

PIT Test Readiness Report Template 

PIT Test Execution Progress Report Template

If you have any questions on PIT, please email [email protected]