On 11/09/2010 01:58 PM, Vincent Massol wrote:
On Nov 9, 2010, at 7:44 PM, Caleb James DeLisle wrote:
On 11/09/2010 02:17 AM, Vincent Massol wrote:
Hi Caleb,
Nice start. Some questions/feedback:
* Is this replacing the standard hudson emails or does it come as an additional report? When is it sent? I imagined it being sent periodically (maybe once a day). Since it uses commons-configuration, a different configuration profile could be set up to send a different type of mail for broken builds.
* I'd like to see an email whenever someone commits something that makes one of the modules fail to build and in that mail the title should be short and explicit about whom has made the build fail + the mail should contain the log of the failure (in order to understand why it fails directly from the email).
IMO in general we need: * less emails from hudson (only mails when builds are failing IMO, not needed when they're not) * separate flickering from non flickering I tried to do that, no flickers were detected though.
Yes but what I meant is to send less emails than currently. With yours that means more emails since we now have all the standard ones + yours.
This should be able to replace the vast majority of mail, excluding maybe the "build failed" messages. I still think there should be a period of overlap because we want to be sure we understand and trust the new mail system before removing the old (as bad as it may be.) I think we should look for solutions to have less emails in total to make it more manageable. I don't know about you but very often I don't even look at hudson emails and throw them away. hehe I can honestly say I don't throw them away. After matching regex filters, they go in an array of directories to bit rot and occasionally be "mark folder as read" ;) We need to change that so that we care when we receive an hudson email. And if we can now who broke it then that person could feel responsible for it and fix it ASAP (and not wait till the Release starts, thus delaying the release by several days every time). Good point. I had thought of pointing fingers as counterproductive but he who broke it will definitely know best how to fix it. Caleb
Thanks -Vincent
Caleb
* shorter email titles * know how broke the build in the email and very visible * console logs in the mail (not the full log, just the module that fails to build and only the part around the failure: let's say the last 100 lines)
Thanks -Vincent
On Nov 9, 2010, at 4:02 AM, Caleb James DeLisle wrote:
Trying out a new test reporter, tell me what you think.
Statistics Report: 22 tests failed out of a total of 3026 The total time taken to run the tests was 1853.3518 seconds, and the average time taken by a test was 0.6124758 seconds. The fastest test ran in 0.0 seconds,a record held by http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$xwoot-conten... The slowest test ran in 120.414 seconds,and that one was http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$jxta/5/testR... and the average speed of a webstandards test (a good indication of page load speed) was 0.0 seconds. ------------------------------------------------------------------------------- Detailed Failure Report: 0 Regressions, 0 Tests are Probably Flickering, 22 Failures -------------------------------------------------------------------------------
Failures: These tests have failed multiple times in a row.
Failing for the past 164 builds. Name: Blog/Archive.xml [month, year, comment, space, language] testParametersInColibri Details: Escaping test failed. * Parameter: "year" Tested file: Blog/Archive.xml URL: http://127.0.0.1:8080/xwiki/bin/view/Blog/Archive?skin=colibri&year=aaa%22bb... List of validation errors: line 305 column 133 WARNING: Macro execution exception in the response. line 531 column 0 WARNING: Possible SQL error trace. line 563 column 0 WARNING: Possible SQL error trace. Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: Blog/CreatePost.xml [category, comment, entrySpace, form_token, language, entryTitle] testParametersInColibri Details: Escaping test failed. * Parameter: "entrySpace" Tested file: Blog/CreatePost.xml URL: http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entrySpace... List of validation errors: line 308 column 62 ERROR: Unescaped < character line 308 column 58 ERROR: Unescaped > character * Parameter: "entryTitle" Tested file: Blog/CreatePost.xml URL: http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entryTitle... Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: Panels/PanelWizard.xml [forceLeftPanels, section, queryString, place, forceRightPanels, comment, space, language] testParametersInColibri Details: Escaping test failed. * Parameter: "place" Tested file: Panels/PanelWizard.xml URL: http://127.0.0.1:8080/xwiki/bin/view/Panels/PanelWizard?skin=colibri&place=a... List of validation errors: line 341 column 95 ERROR: Unescaped < character line 341 column 91 ERROR: Unescaped > character Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: XWiki/ExtensionManager.xml [extensionid, actioninstall, actionresolve, confirm, extensionversion, comment, actionuninstall, language, editor] testParametersInColibri Details: Escaping test failed. * Parameter: "actioninstall" Tested file: XWiki/ExtensionManager.xml URL: http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&act... List of validation errors: line 321 column 140 WARNING: Macro execution exception in the response. * Parameter: "actionresolve" Tested file: XWiki/ExtensionManager.xml URL: http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&act... Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: XWiki/LiveTableResults.xml [classname, orphaned, collist, comment, space, language] testParametersInColibri Details: Escaping test failed. * Parameter: "classname" Tested file: XWiki/LiveTableResults.xml URL: http://127.0.0.1:8080/xwiki/bin/view/XWiki/LiveTableResults?classname=aaa%22... List of validation errors: line 304 column 133 WARNING: Macro execution exception in the response. line 408 column 0 WARNING: Possible SQL error trace. line 423 column 0 WARNING: Possible SQL error trace. * Parameter: "space" Tested file: XWiki/LiveTab Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: testClassEditor Details: Escaping test for XWIKI-5404 failed. Tested file: templates/editclass.vm URL: http://127.0.0.1:8080/xwiki/bin/edit/aaa%22bbb%27ccc%3Eddd%3Ceee/aaa%22bbb%2... List of validation errors: line 332 column 71 WARNING: Unescaped ' character line 336 column 77 WARNING: Unescaped ' character line 338 column 78 WARNING: Unescaped ' character Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: templates/editattachments.vm [] testPageEscaping Details: Escaping test for page name failed. Tested file: templates/editattachments.vm URL: http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=d... List of validation errors: line 1 column 42 ERROR: Unescaped < character line 1 column 38 ERROR: Unescaped > character Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: templates/editgroup.vm [classname] testPageEscaping Details: Escaping test for page name failed. Tested file: templates/editgroup.vm URL: http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=d... List of validation errors: line 0 column 0 WARNING: Unexpected empty response Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: templates/editgroup.vm [classname] testParameterEscaping Details: Escaping test failed. * Parameter: "classname" Tested file: templates/editgroup.vm URL: http://127.0.0.1:8080/xwiki/bin/view/Main/WebHome?classname=aaa%22bbb%27ccc%... List of validation errors: line 0 column 0 WARNING: Unexpected empty response Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 164 builds. Name: templates/editgroup.vm [classname] testSpaceEscaping Details: Escaping test for space name failed. Tested file: templates/editgroup.vm URL: http://127.0.0.1:8080/xwiki/bin/view/aaa%22bbb%27ccc%3Eddd%3Ceee/WebHome?ski... List of validation errors: line 0 column 0 WARNING: Unexpected empty response Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 177 builds. Name: testDocumentCacheSync Details: null expected:<[modified ]content> but was:<[]content> Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 177 builds. Name: testDocumentCacheSyncForAttachments Details: Name: PUT URI: http://localhost:8081/xwiki/rest/wikis/xwiki/spaces/Test/pages/AttachementCa... Status code: 404 Status text: Not Found Response: <html> <head> <title>Status page</title> </head> <body> <h3>The server has not found anything matching the request URI</h3><p>You can get technical details <a href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.5">here</a>.<br> Please continue your visit at our <a href="/">home page</a>. </p> </body> </html> Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 177 builds. Name: org.xwiki.test.ui.AllTests Details: Failed to connect to binary FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; process output follows: Error: cannot open display: :1.0 System info: os.name: 'Linux', os.arch: 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: '1.5.0_15' Driver info: driver.version: firefox Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 177 builds. Name: org.xwiki.test.ui.AllTests Details: Failed to connect to binary FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; process output follows: Error: cannot open display: :1.0 System info: os.name: 'Linux', os.arch: 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: '1.5.0_15' Driver info: driver.version: firefox Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 177 builds. Name: WYSIWYG Selenium Tests Details: Could not start Selenium session: Failed to start new browser session: Error while launching browser Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 180 builds. Name: junit.framework.TestSuite@6b3fc7 Details: Could not start Selenium session: Failed to start new browser session: Error while launching browser Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 180 builds. Name: junit.framework.TestSuite@1d85f79 Details: Could not start Selenium session: Failed to start new browser session: Error while launching browser Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterpr...
Failing for the past 828 builds. Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome executed with credentials Admin:admin Details: Validation errors in space=Main, page=WebHome ERROR: At least one style attribute has been found on the page. Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki...
Failing for the past 828 builds. Name: Validating Dutch Web Guidelines validity for: space=WikiManager, page=CreateNewWiki executed with credentials Admin:admin Details: Validation errors in space=WikiManager, page=CreateNewWiki ERROR: An input field has been found with no label association. Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki...
Failing for the past 828 builds. Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome executed with credentials Admin:admin Details: Validation errors in space=Main, page=WebHome ERROR: At least one style attribute has been found on the page. Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki...
Failing for the past 828 builds. Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome executed with credentials Admin:admin Details: Validation errors in space=Main, page=WebHome ERROR: At least one style attribute has been found on the page. Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki...
Failing for the past 839 builds. Name: junit.framework.TestSuite@2a4983 Details: Could not start Selenium session: Failed to start new browser session: Error while launching browser Link: http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki...
devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs