Skip to main content
Skip table of contents

20230303 - 10.2 Rollout Status Report

Current progress of 10.2.0 testing and development with target of 2/28 completion. Clients being tested against are VEF, Terra, and GME.

Current Status

  1. Internal deadline for completing regression testing was 3/1 and we have now passed that date.

  2. Tie-outs in progress

    1. GME asset level completed

    2. Terra Production and Revenue Allocated results have difference with issues logged

      1. Terra Revenue Value results have additional records but no value difference

    3. Both GME and Terra Apply DO have differences with issue logged

      1. Blocking downstream Revenue Company process testing

    4. JIB issues have been logged but we have not loaded the specific JIB tie-out databases because we are stuck on Revenue tie-out

  3. Testing is over 89% complete with High Risk ~99% complete.

  4. Tickets completed - 33 stories for 68 points (double the effort from previous week)

  5. Turnaround on tickets has increased across all teams.

  6. Open tickets - 51 tickets (18 - “To Do”, 15 - “In Progress”, 18 - “In Review”)

  7. Stress testing performed 3/2/23, Vipul addressing performance

Focus for Next Week

  1. Final functional testing - @a user & @a user coordinating

  2. Continued tie-Outs for GME and Terra - @a user coordinating

  3. Focus on dev completion of issues across Scrum Teams - @a user coordinating

  4. OpenInvoice testing with fake server - @a user coordinating

RISKS

  1. Updated compare tool being used to compare large datasets for company level processes.

  2. We have no performance metrics and yet clients have expectations of improved performance with v10.

  3. Many stories closed were closed because there was no code related bug. The reasons fall into 3 major categories: environmental issues (resources and configs), incorrect in-app setup, lack of functional knowledge by tester.

    1. This is across QA and CX Services SMEs.

    2. Only 18 of 35 stories completed with code changes(2/17)

    3. Only 16 of 22 stories completed with code changes(2/24)

    4. Only 14 of 33 stories completed with code changes(3/3)

  4. OpenInvoice testing will have to be done with Fake Server internally.

  5. No GIS testing capabilities at this time.

Future Process Improvements

  1. Build RACI matrix for future efforts for transparency of responsibilities across teams.

  2. Add automation for the “easy” wins like UI testing to eliminate almost 30% of the testing effort.

  3. Continue to build out test cases for regression testing across the application.

    1. Add expected results to compare against for testers with limited functional knowledge.

  4. Have defined performance testing with PROD comparable environments to provide better expectations to clients when taking code.

  5. Add code test coverage to eliminate lost functionality with future merges or code changes.

    1. During current round of testing multiple issues have re-emerged after originally fixed.

In the 20 weeks since Flywheel went live with v10, this is the bug count for clients whose code is in v10.2.0

Client

Number of Bugs

Flywheel

4

*after 3 weeks of stabilizing release

GME

11

IKAV

21

Laredo

10

Surge

15

Terra

14

Notes

  1. SMEs from the CX team are assisting in functional testing with @a user updating the tracker based on their testing.

  2. We have a dedicated v10 team with 4 engineers.

  3. Additional resources are coming from other sprint teams who lack priority stories.

    1. Upstream, DO/Land, and Regulatory team are taking stories as capacity allows.

Important Links

Full details around testing provided here - Testing Tracker - v10.2 Test Metrics

Release 10.2.0 Dashboard - https://wenergysoftware.atlassian.net/jira/dashboards/10077

** High Risk Functional Tests are being done for eac client uniquely. This count represents triplicate of the number of tests. One set per client.

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.