20230426 - 10.2 Rollout Status Report
Current progress of 10.2.0 testing, development, and deployment. Current clients targeted are Terra, GME, and IKAV.
RISKS
Terra reporting no noticeable improvement across DO functionality.
Coordinating meeting to monitor environment for further investigation.
Production Accounting tie-out complete for Terra. Analysis for IKAV still in progress.
Client reported issues that are data dependent require db refreshes to internal environments.
Currently this can take a full day or more for Terra and GME.
Resources on COLO are strained and cannot support additional instances of large clients.
Establish upgrade procedures and version controls for live clients on a single code version.
Need agreement by all internal teams so that client communication is aligned.
Needs to be clearly communicate to clients so they understand the future process.
Need to confirm any risk associated with testing on one type of environment and going live on another.
Current Status
Significant uptick in issues logged by Terra and GME over last week when relatively few were logged over the prior 3 weeks of testing.
IKAV regression testing proceeding well for 4/24 deadline.
Tie-out testing
Production asset tie out in progress with final analysis in progress
Revenue company processes delayed due to environmental constraints. Will be done in parallel with IKAV UAT testing.
Functional regression
144 Pass, 1 Fail on High Risk(Resolved)
64 Pass, 2 Remaining tests on Low Risk
218 pass, 71 Remaining tests on Regular functional cases
330 pass, 3 Fails, 4 Remaining UI test
OpenInvoice AP Invoice with fake server in progress. Validating invoices created with interface.
IKAV UAT
51 Pass, 7 Fails(4 from DO)
Client logged ticket count - 53 total
GME - 6 code change, 3 complete, 4 awaiting feedback, 4 in review, 12 closed no action
Terra - 5 code change, 9 complete, 2 awaiting feedback, 3 support review, 5 close no action
Terra’s JIB/AP team completed major processes with overall good feedback and positive performance experience
Performance fixes complete. Using Datadog to find new performance constraints and resolve them as found.
Aligned UAT environments with PROD specs (verified with DevOps)
Moved IKAV regression box from COLO to OpenMetal.
Various hiccups with Azure instance at the beginning of IKAV testing where environment was not properly configured and resourced prior to kickoff.
Focus for Next Week
Finalizing IKAV regression testing - @a user & @a user coordinating
Complete IKAV tie-out - @a user coordinating
IKAV OpenInvoice invoice sync testing with fake server - @a user coordinating
Focus on dev completion of issues across Scrum Teams - @a user coordinating
Monitor client UAT testing - @a user and CSMs coordinating
Future Process Improvements
Build RACI matrix for future efforts for transparency of responsibilities across teams.
Add automation for the “easy” wins like UI testing to eliminate almost 30% of the testing effort.
Continue to build out test cases for regression testing across the application.
Add expected results to compare against for testers with limited functional knowledge.
Have defined performance testing with PROD comparable environments to provide better expectations to clients when taking code.
Add code test coverage to eliminate lost functionality with future merges or code changes.
During current round of testing multiple issues have re-emerged after originally fixed.
Notes |
|
|---|---|
Important Links | IKAV regression testing dashboard - https://wenergysoftware.atlassian.net/jira/dashboards/10080 Release 10.2.0 Dashboard - https://wenergysoftware.atlassian.net/jira/dashboards/10077 |
