The list of what has been tested: * For intermediary releases (Milestones, RC1) will be the newly added features and will be available in "Test Report" section of the RN. The "Tested Browsers" and "Tested Databases" will also be specified for everything that was manually tested. * For final releases, given we plan to test everything, from the RN we will add a link to a different page which contains the list of Test/Pass results and the tested environments. Regards, Sorin B. On Thu, Aug 9, 2012 at 12:14 PM, Vincent Massol <[email protected]> wrote:
On Aug 9, 2012, at 11:10 AM, Sorin Burjan wrote:
Hi Vincent,
The MTR Template has been corrected so it won't be misleading since 4.1.1. You can check it at http://www.xwiki.org/xwiki/bin/view/TestReports/ManualTestReportTemplate As you can see we're not misleading anymore, since they are all marked as "Not Tested" by default.
The MTR is executed right after we release RC1. For Milestones, I only test the newly added features from the Release Notes.
The point of this vote is to not instantiate a MTR for Milestones and RC1 (unlike we did until now), because if we instantiate one for each, it would have all the items as "Not Tested", which is useless IMO. I was proposing to drop creating a blank MTR for Milestones and RC1, but have one for each Final version. (which will be filled with Pass/Fail between RC1 and Final).
Now about what we put in the intermediary releases notes, if there is no MTR testing, we can put which features have been tested manually from the Release Notes (as Silvia suggested), or put the browser and the database on which we run our UI-tests (as Marius suggested)
WDYT ?
My proposal is to remove the notion of MTR at all. We don't need it and nobody cares about it. The only thing important is the list of what has been tested, in which version and in which environment.
Thanks -Vincent
Regards, Sorin B.
On Thu, Aug 9, 2012 at 11:01 AM, Vincent Massol <[email protected]> wrote:
Hi Sorin,
On Aug 6, 2012, at 12:58 PM, Sorin Burjan wrote:
Hello devs,
I want to cast a vote regarding the following proposal:
Remove the section about manual testing and the link to the MTR's from M1, M2 and RC1 Release Notes, since we test against MTR only after we release RC1. This means that we will have a MTR only for final releases, which will be linked from the RN page of the final version. After releasing each M1, M2 and RC1, only the newly added features are tested. The rationale behind this is that ATM we point a link to a MTR (for every minor release) but the MTR will be empty ("Not Tested"), so this renders it useless for minor releases.
Waiting for your votes/opinions
IMO we should keep the current rule which is currently: * Add the list of the browsers and DBs that have been tested for the RN corresponding to the version. For ex, if you test on FF X for version 4.2M1 then you should put that in the RN for 4.2M1. Of course if nothing has been tested you don't put something empty, you just keep the section but add a one line saying that no manual tests have been performed for this version.
What needs to be improved is the accuracy of the MTR which currently is misleading since all items are marked as tested whereas only a few are really tested at a given point in time.
So what the user need to see is the exact list of what has been tested, and on which browser and which DB.
Thanks -Vincent
_______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
_______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs