The EnerNex Guide to ADMS Testing: From Concept to Deployment

May 3, 2024 | Blog

As electric utilities strive to modernize and handle increasing complexities within their operational frameworks, the role of Advanced Distribution Management Systems (ADMS) becomes critical. These three stages delve into the multifaceted process of ADMS testing, beginning with initial considerations, progressing through the meticulous execution of test cases, and culminating in the final validation before deployment.

Stage 1: Understanding the Need for Rigorous ADMS Testing

At this initial stage, we spotlight the crucial testing phase of ADMS. Ensuring that ADMS meets its business, technical, and functional requirements is a multifaceted process, encompassing various stages that stretch from its inception to the final deployment and commissioning at the customer’s site. This phase is essential for laying the groundwork for a successful ADMS implementation, tailored to navigate the unique challenges electric utilities face today.

EnerNex specializes in guiding utilities through this critical testing phase, equipped with the expertise and insight to ensure that every requirement is met, setting the stage for seamless deployment and integration.

Stage 2: Delving into the Testing Phases

As mentioned in stage 1, rigorous ADMS testing is a comprehensive and ongoing process that extends from initial development through to final deployment and commissioning at the utility’s site. This involves several testing phases tailored to the ADMS’s complexity and its integration challenges within the existing utility systems:

  • Functional / Unit Testing
    • Specific to ADMS product build.
    • Internal to ADMS provider, rarely shared with customer.
    • Performed during DMS development on Product Development System (PDS).
    • Critical if ADMS required extensive customization and/or enhancements not available in base product.
  • Pre-Factory Acceptance Testing (Pre-FAT)
    • Performed by ADMS provider on PDS using internal templates/data (Fantasy Island). Alternatively, testing is conducted using customer’s converted DB and displays, if available.
    • Validates functional requirements and test cases for upcoming FAT.
    • Often covers comprehensive test cases limited to scope of DMAS product delivery.
    • Encountered defects as often logged and prioritized for fixes by ADMS provider, not shared with customer.
  • Factory Acceptance Testing
    • Performed by customer with assistance from ADMS provider on PDS, often on ADMS provider’s site and with customer’s data/network model.
    • Validates that contractual requirements are met by the delivered ADMS product.
    • May include various FAT cycles if ADMS product delivery happens in multiple official releases.
    • Resultant higher severity/criticality defects 9Level 1&2) must be resolved prior to upcoming SAT.

  • Pre-Site Acceptance Testing (Pre-SAT)
    • Performed by customer with supervision by ADMS provider, often on the Quality Assurance System (QAS) with customer’s data / network model and converted DB and displays, once shipped to customer’s site.
    • May include: Smoke testing (checks/confirms eh stability of ADMS product build and connectivity of the critical functionalities; Regression Testing (retests defects fixes from FAT)
  • Site Acceptance Testing (SAT)
    • Performed by customer with ADMS support from ADMS provider, often on the Production System (PRD_ with customer’s live data and operational network model, on customer’s site.
    • Often validates end-to-end To-Be business process workflows.
    • May include field verification, with point to point testing of RTUs and supervisory controls.
    • Make sure that all ADMS components, data flows, interfaces and communication paths function as designed/required.
    • Resultant higher severity/criticality defects (level 1&2) must be resolved prior to official end and sign-off on SAT.
    • Customer & ADMS provider to reach a consensus on prevailing lower severity/criticality defects (level 3&4).
  • Site Integration Testing (SIT)
    • Performed by customer with support by ADMS provider as needed, on PRD with customer’s live data and operational network model, on customer’s site.
    • Tests ADMS’ interfaces to other operational and enterprise systems based on related requirements: 1) Data quality, Transformation, Flow, Messaging, Scheduling, and Timing. 2) Event triggers.
    • Often uses other manually initiated or automatic script-based tools that validate the interfaces
  • User Acceptance Testing (UAT)
    • Performed by customer with support by ADMS provided as needed, on PRD with customer’s live data and operational network model, on customer’s site.
    • Performed by end/business users to validate the final ADMS product meets the business requirements.
    • Validates end-to-end data quality for end-to-end business processes.
    • Occurs after all major integration tests are complete and all related business functions and business events have been integrated and tested.
  • Performance Testing
    • Performed by customer with support by ADMS provider as needed, on PRD with customer’s live data and operational network model, on customer’s site.
    • Most often, the ADMS provider drafts and shared the performance test strategy and procedures with customer.
    • Confirms that ADMS performance meets or exceeds pre-determined/required acceptable levels: ADMS application outputs, processing speed, data transfer velocity, network bandwidth usage, maximum concurrent users, memory utilization, workload efficiency, command response times, etc.
  • Availability Testing:
    • Performed by customer with support by ADMS provider as needed, on PRD with customer’s live data and operational network model, on customer’s site.
    • Ensures availability of ADMS critical functions for specified times, such as: 1) System uptime > 98% 2) Each ADMS server/device uptime > 98%
    • Duration of Availability Testing – often at customer’s discretion, for instance test could be conducted for the period of 1000 hours.
  • Other Testing:
    • Regression Testing: validates correct operation after software is modified.
    • Loading Testing: could be part of Performance Test, to validate ADMS’ adequate performance under prescribed loading requirements specific to customer’s operating conditions, such as Storm vs. Sunny-Day modes.
    • Security Testing: identify security vulnerabilities and validate CIP compliance to NERC Information Security Policies.
    • Operation Readiness Testing: validates the readiness of ADMS to move into production environment, e.g., testing of local and geographic fail-over, system, OS and application monitoring, and operational support processes.

Stage 3: Test Case Setup and Execution Lifecycle

In any of the ADMS testing phases covered so far, designing, and setting up meticulous test cases is crucial and often complex. Each test case is crafted to validate a specific ADMS functionality or feature, aligning with either a business or a technical requirement. From simple functionality checks to comprehensive end-to-end process evaluations, test cases are the backbone of ensuring ADMS systems meet operational demands. Conceptually, an ADMS test case would have the following components:

  • Title and General Information: Includes IDs, timing, priority, software version, and other relevant details.
  • Description and Setup: Outlines the purpose, expected outcomes, and setup requirements for the test.
  • Entry and Exit Criteria: Defines what triggers the test and the conditions for its completion.
  • Dataset and Steps: Details the data involved and the step-by-step procedure for execution and verification.
  • Result Status (as seen below): Outcomes are categorized as Passes, Passed with Minor Errors, Failed, In Progress, Did Not Run, or Blocked, each requiring specific follow-up actions.
  • Clean Up: Describes actions necessary to return the system to its normal state post-testing.

A typical execution cycle for an ADMS test case is depicted in the following illustration, assuming that the ADMS has a Program Development (PDS) and a Quality Assurance (QAS) components of systems:

CONCLUSION

As we wrap up our exploration of ADMS testing, it’s clear that each phase of the process is not just a step toward implementation, but a stride toward transformative change in utility management.

We have demonstrated the depth of expertise and attention to detail involved in ADMS testing, from initial setup to final validation. As your partner in energy solutions, EnerNex is dedicated to advancing the filed of innovations that not only meet today’s challenges but also anticipate tomorrow’ opportunities.

For expert insights and guidance on ADMS implementation, connect with Aniss Fradi, Principal Consultant.

Follow up on LinkedIn and Twitter to stay updated with our latest news.

 

 

 

 

 

Smart Metering (SM) and Advanced Metering Infrastructure (AMI)

Smart Metering and AMI is a transformational process addressing multiple business and technical needs of the utility enterprise. This is more than just smart meters and communications networks; it includes all of the back end applications that can leverage the meter assets, such as outage notification, demand response, call center optimization, disputed billing process handling, pre-payment opportunities, and service connection management methods and procedures, to name a few.

Implementing SM and AMI faces the same business, engineering, and operational challenges as any other across-the-utility information technology endeavors – most notably risk associated with embracing proprietary technology, missing functionality and early obsolescence. Effective SM and AMI development, implementation, and operation relies on a marriage of electric power engineering with information technology expertise: a key component of EnerNex’s expertise and experience.

EnerNex provides an array of engineering and consulting services geared towards intelligent and effective implementation of SM and AMI. This covers all phases of project development, starting with capturing system requirements where our experts leverage a “Use Case” centric view of activities needed to be accomplished and their interaction with systems and other users. Subsequent project steps typically examine other critical areas, such as: modeling of business cases, building inter-department consensus, assembling and assessing system functional requirements and non-functional requirements, developing a system design, hardware and software specifications and standards, complete procurement services including RFI and RFQ process support, supplier rating system, response evaluation methodology, deployment management, and training of office and field personnel.

Demand Response (DR)

Demand response can be as simple as load interruption directed by the energy supplier in response to severe demand requirements, to complex customer defined load management in response to price signals. DR is one of the components of a “Non-Wires Alternative” that many utilities are effectively using to avoid expensive distribution fortification or upgrade.

 

Often the success and/or failure of demand response programs can be linked to program implementation challenges such as rate/tariff design rate structures communication (e.g. price signals) or ineffective incentives used by utilities to encourage customers to accept operational change. The issues of program design, rate structure and customer impact have a tremendous influence on the success or failure of load management initiatives. Demand response has traditionally been used as a tool of the energy industry to ensure system stability. However, the introduction of microelectronics, communications, home automation and the Internet of Things (IoT) has led to the development of cost effective solutions that have the capability to allow the consumer to take control of managing their energy load and ultimately, the price they pay for energy.

EnerNex has the experience and skills to turn your DR program into a successful operational asset and customer engagement process that can deliver value to all parties.

Energy Assurance Planning

Natural and man-made disasters cause an estimated $57B in average annual costs for all parties; large single events have resulted in losses of $100B or more. Events, such as the World Trade Center disaster, Hurricane Katrina, and most recently Hurricane Helene, have demonstrated an acute need to revisit, revise and implement an effective energy assurance plan. Energy assurance plans assess the functionality and interdependencies of buildings and infrastructure systems and the role they play in sustaining service and rapidly restoring critical services to a community following a hazard event.

 

EnerNex assists our clients in developing comprehensive energy assurance plans that mitigate and minimize the impact of energy disruptions. Our experts assess critical infrastructure risks and evaluate appropriate mitigation strategies and can help in developing an effective business continuity/disaster recovery (BC/DR) plan for utilities and your customers.

Microgrid Development

As the electric grid becomes more distributed and interactive, microgrids are playing an increasingly important role in our energy future. Decision makers at military bases, corporate and institutional campuses, residential communities and critical facilities across the world are exploring and implementing microgrids to meet economic, resiliency and environmental goals. Utility-grade microgrids are being deployed to meet transmission constraints, reliability requirements and safe-havens in the event of a significant storm event.

Microgrid_development Graphic steps to support grid modernization

Bringing together a portfolio of distributed energy resources into a controllable, islandable microgrid comes with its own set of challenges. The key to solving these challenges is in architecting a system to support information exchanges between components across well-defined points of interoperability (interfaces) in a technology independent manner. This interoperability ensures that the system is resilient to technology change. Modern systems engineering techniques must be employed to ensure that individual sub‐systems are clearly identified, their functions enumerated, their data requirements known, and the points of interoperability clearly specified, along with the commensurate monitoring, command and control that is needed to ensure grid stability. With such architecture, we can apply best of breed technology available today to support those information exchanges at interface boundaries but be free to upgrade / change the implementation technology later without causing a ripple effect throughout the system.

Enterprise Architecture

Enterprise Architecture focuses on aligning an organization’s business strategies with its anticipated, desired and planned technology enhancements. Enterprise Architecture provides a framework to cost-effectively transition from a current “as-is” technology to future enterprise-wide technological solutions. An effective Enterprise Architecture program aligns business investments with long-term business strategies while minimizing risk and providing superior technological solutions. EnerNex’s key asset is its highly skilled and experienced staff who are closely connected to both the smart grid and EA standards and practices. We provide clients with the insight necessary to operate a fully functioning smart grid, which is flexible, scalable, and vendor independent.

Grid Modernization Roadmap

Utility companies across the globe are continually modernizing their grid. Each company often has different rationales, objectives and priorities. Frequently, smart grid plans are developed for individual, incremental initiatives, rather than as a part of a whole, intelligent and interoperable infrastructure. Planning may be developed around technology choices rather than business and technical requirements. The result of incremental and flawed planning leads to increased cost and risk, lost opportunities, disconnected expectations and dead ends.

 

EnerNex’s approach to grid modernization roadmap development follows a proven, industry-standard approach to grid modernization planning by collaboratively working with the utility to develop a set of prioritized and time-phased grid modernization initiatives unique to its business strategy and objectives. The roadmap developed is holistic, requirements-based, business value driven and actionable. It often builds on and leverages existing applications and infrastructure, and incorporates industry standards to ensure interoperability, flexibility and reduced cost and risk.

Utility Communications

Utility communication and control systems are increasingly interconnected to each other and to public networks and as a result, they are becoming increasingly more susceptible to disruptions and cyber attacks. EnerNex has experience with the various issues relating to development, implementation and optimization including feasibility analysis, design, software development and customization, project management and acceptance. Our expertise extends from being involved in the development of the fundamental standards that support utility communication and automation, through deployment and securing of those resources. EnerNex personnel were heavily involved in development of such standards and protocols as IEC 61850, IEC 60870-5 and DNp3. Our staff played a key role in the EPRI Utility Communication Architecture (UCA) project and the IntelliGrid Architecture effort.

Related Articles

Related

Grid Modernization & Grid Architecture

Helping our clients implement and integrate grid modernization technologies and processes that are aligned with tomorrow’s utility. A Grid Modernization program frequently includes many complex utility engineering and operational topics, many times the scope of these...

read more

Grid Modernization with Artificial Intelligence

_______________________________________________________________________________________________________________________ Introduction The electric power industry is undergoing a transformative era, driven by digitalization, renewable energy integration, and increasing...

read more
X