20230503 - 10.2 Rollout Status Report
Current progress of 10.2.0 testing, development, and deployment. Current clients targeted are Terra, GME, IKAV, Vital, Flywheel.
RISKS
Terra reporting no noticeable improvement across DO functionality.
Met to review performance and monitor. Plan to optimize has not been defined yet.
IKAV testing on Azure has experienced multiple issues that cannot be reproduced internally on functionality already passed internally and at other client UAT.
We are not able to identify the cause of issues yet whether environmental or data set driven.
Code freeze is currently planned for EOW or 5/8 but have 25 that are currently In Progress or In Review that will need to be fully completed before then.
4 critical for GME go-live
2 critical for Terra go-live
Clients using EAG to test cause additional WES resource burden to validate issues.
Initial regression testing on Flywheel and Laredo have found multiple JIB issues that were previously thought resolved (could be dataset related but unknown at this time).
Establish upgrade procedures and version controls for live clients on a single code version.
Need agreement by all internal teams so that client communication is aligned.
Needs to be clearly communicate to clients so they understand the future process.
Need to confirm any risk associated with testing on one type of environment and going live on another.
Current Status
Significant backlog of items to test for code freeze.
IKAV Tie-out testing
Revenue company processes delayed due to environmental constraints. Will be done in parallel with IKAV UAT testing.
Functional regression
IKAV - 54 Untested, 2 Failed
Flywheel - 52 Pass, 2 Failed, 106 Untested (High Risk Test Suite)
Vital - 62 Pass, 3 Failed, 885 Untested (Full Test Suite)
IKAV UAT
51% complete testing - 193 Pass, 13 Fails, 186 To Do
Client logged ticket count - 65 total
GME - 7 code change, 3 complete, 1 awaiting feedback, 6 in review, 19 closed no action (36)
Terra - 6 code change, 8 complete, 5 support review, 10 close no action (29)
Focus for Next Week
Continue Vital & Flywheel regression testing - TBD QA resource & @a user coordinating
IKAV OpenInvoice invoice sync testing with fake server - @a user coordinating
Focus on dev completion of issues across Scrum Teams - @a user coordinating
Monitor client UAT testing - @a user and CSMs coordinating
Finalize dates for Pilot Clients for future Unity Releases - @a user and @a user coordinating
Future Process Improvements
Build RACI matrix for future efforts for transparency of responsibilities across teams.
Add automation for the “easy” wins like UI testing to eliminate almost 30% of the testing effort.
Continue to build out test cases for regression testing across the application.
Add expected results to compare against for testers with limited functional knowledge.
Have defined performance testing with PROD comparable environments to provide better expectations to clients when taking code.
Add code test coverage to eliminate lost functionality with future merges or code changes.
During current round of testing multiple issues have re-emerged after originally fixed.
Notes |
|
|---|---|
Important Links | Regression testing dashboard - https://wenergysoftware.atlassian.net/jira/dashboards/10080 Release 10.2.0 Dashboard - https://wenergysoftware.atlassian.net/jira/dashboards/10077 |
