On 11/09/2010 02:17 AM, Vincent Massol wrote:
Hi Caleb,
Nice start. Some questions/feedback:
* Is this replacing the standard hudson emails or does it come as an additional report?
When is it sent?
I imagined it being sent periodically (maybe once a day). Since it
uses commons-configuration, a
different configuration profile could be set up to send a different type of mail for
broken builds.
* I'd like to see an email whenever someone
commits something that makes one of the modules fail to build and in that mail the title
should be short and explicit about whom has made the build fail + the mail should contain
the log of the failure (in order to understand why it fails directly from the email).
IMO in general we need:
* less emails from hudson (only mails when builds are failing IMO, not needed when
they're not)
* separate flickering from non flickering
I tried to do that, no flickers were
detected though.
Yes but what I meant is to send less emails than currently. With yours that means more
emails since we now have all the standard ones + yours. I think we should look for
solutions to have less emails in total to make it more manageable. I don't know about
you but very often I don't even look at hudson emails and throw them away. We need to
change that so that we care when we receive an hudson email. And if we can now who broke
it then that person could feel responsible for it and fix it ASAP (and not wait till the
Release starts, thus delaying the release by several days every time).
Thanks
-Vincent
Caleb
> * shorter email titles
> * know how broke the build in the email and very visible
> * console logs in the mail (not the full log, just the module that fails to build and
only the part around the failure: let's say the last 100 lines)
>
> Thanks
> -Vincent
>
> On Nov 9, 2010, at 4:02 AM, Caleb James DeLisle wrote:
>
>> Trying out a new test reporter, tell me what you think.
>>
>> Statistics Report:
>> 22 tests failed out of a total of 3026
>> The total time taken to run the tests was 1853.3518 seconds,
>> and the average time taken by a test was 0.6124758 seconds.
>> The fastest test ran in 0.0 seconds,a record held by
>>
http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$xwoot-conte…
>> The slowest test ran in 120.414 seconds,and that one was
>>
http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$jxta/5/test…
>> and the average speed of a webstandards test (a good indication of page load
speed) was 0.0 seconds.
>> -------------------------------------------------------------------------------
>> Detailed Failure Report:
>> 0 Regressions,
>> 0 Tests are Probably Flickering,
>> 22 Failures
>> -------------------------------------------------------------------------------
>>
>> Failures:
>> These tests have failed multiple times in a row.
>>
>> Failing for the past 164 builds.
>> Name: Blog/Archive.xml [month, year, comment, space, language]
testParametersInColibri
>> Details: Escaping test failed. * Parameter: "year" Tested file:
Blog/Archive.xml URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/Blog/Archive?skin=colibri&year=aaa…
>> List of validation errors: line 305 column 133 WARNING: Macro execution
exception in the
>> response. line 531 column 0 WARNING: Possible SQL error trace. line
563 column 0
>> WARNING: Possible SQL error trace.
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: Blog/CreatePost.xml [category, comment, entrySpace, form_token, language,
entryTitle]
>> testParametersInColibri
>> Details: Escaping test failed. * Parameter: "entrySpace" Tested file:
Blog/CreatePost.xml URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entry…
>> List of validation errors: line 308 column 62 ERROR: Unescaped <
character line 308
>> column 58 ERROR: Unescaped > character * Parameter: "entryTitle"
Tested file:
>> Blog/CreatePost.xml URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entry…
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: Panels/PanelWizard.xml [forceLeftPanels, section, queryString, place,
forceRightPanels,
>> comment, space, language] testParametersInColibri
>> Details: Escaping test failed. * Parameter: "place" Tested file:
Panels/PanelWizard.xml URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/Panels/PanelWizard?skin=colibri&pl…
>> List of validation errors: line 341 column 95 ERROR: Unescaped <
character line 341
>> column 91 ERROR: Unescaped > character
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: XWiki/ExtensionManager.xml [extensionid, actioninstall, actionresolve,
confirm,
>> extensionversion, comment, actionuninstall, language, editor]
testParametersInColibri
>> Details: Escaping test failed. * Parameter: "actioninstall" Tested
file:
>> XWiki/ExtensionManager.xml URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&am…
>> List of validation errors: line 321 column 140 WARNING: Macro execution
exception in the
>> response. * Parameter: "actionresolve" Tested file:
XWiki/ExtensionManager.xml URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&am…
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: XWiki/LiveTableResults.xml [classname, orphaned, collist, comment, space,
language]
>> testParametersInColibri
>> Details: Escaping test failed. * Parameter: "classname" Tested file:
XWiki/LiveTableResults.xml
>> URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/XWiki/LiveTableResults?classname=aaa%2…
>> List of validation errors: line 304 column 133 WARNING: Macro execution
exception in the
>> response. line 408 column 0 WARNING: Possible SQL error trace. line
423 column 0
>> WARNING: Possible SQL error trace. * Parameter: "space" Tested file:
XWiki/LiveTab
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: testClassEditor
>> Details: Escaping test for XWIKI-5404 failed. Tested file:
templates/editclass.vm URL:
>>
http://127.0.0.1:8080/xwiki/bin/edit/aaa%22bbb%27ccc%3Eddd%3Ceee/aaa%22bbb%…
>> List of validation errors: line 332 column 71 WARNING: Unescaped '
character line 336
>> column 77 WARNING: Unescaped ' character line 338 column 78
WARNING: Unescaped ' character
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: templates/editattachments.vm []
testPageEscaping
>> Details: Escaping test for page name failed. Tested file:
templates/editattachments.vm URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=…
>> List of validation errors: line 1 column 42 ERROR: Unescaped <
character line 1
>> column 38 ERROR: Unescaped > character
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: templates/editgroup.vm [classname]
testPageEscaping
>> Details: Escaping test for page name failed. Tested file:
templates/editgroup.vm URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=…
>> List of validation errors: line 0 column 0 WARNING: Unexpected empty
response
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: templates/editgroup.vm [classname]
testParameterEscaping
>> Details: Escaping test failed. * Parameter: "classname" Tested file:
templates/editgroup.vm URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/Main/WebHome?classname=aaa%22bbb%27ccc…
>> List of validation errors: line 0 column 0 WARNING: Unexpected empty
response
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 164 builds.
>> Name: templates/editgroup.vm [classname]
testSpaceEscaping
>> Details: Escaping test for space name failed. Tested file:
templates/editgroup.vm URL:
>>
http://127.0.0.1:8080/xwiki/bin/view/aaa%22bbb%27ccc%3Eddd%3Ceee/WebHome?sk…
>> List of validation errors: line 0 column 0 WARNING: Unexpected empty
response
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 177 builds.
>> Name: testDocumentCacheSync
>> Details: null expected:<[modified ]content> but was:<[]content>
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 177 builds.
>> Name: testDocumentCacheSyncForAttachments
>> Details: Name: PUT URI:
>>
http://localhost:8081/xwiki/rest/wikis/xwiki/spaces/Test/pages/AttachementC…
>> Status code: 404 Status text: Not Found Response: <html> <head>
<title>Status page</title>
>> </head> <body> <h3>The server has not found anything matching
the request URI</h3><p>You can get
>> technical details <a
>>
href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.5…
Please
>> continue your visit at our <a href="/">home page</a>.
</p> </body> </html>
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 177 builds.
>> Name: org.xwiki.test.ui.AllTests
>> Details: Failed to connect to binary
FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055;
>> process output follows: Error: cannot open display: :1.0 System info: os.name:
'Linux', os.arch:
>> 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64',
java.version: '1.5.0_15' Driver info:
>> driver.version: firefox
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 177 builds.
>> Name: org.xwiki.test.ui.AllTests
>> Details: Failed to connect to binary
FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055;
>> process output follows: Error: cannot open display: :1.0 System info: os.name:
'Linux', os.arch:
>> 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64',
java.version: '1.5.0_15' Driver info:
>> driver.version: firefox
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 177 builds.
>> Name: WYSIWYG Selenium Tests
>> Details: Could not start Selenium session: Failed to start new browser session:
Error while
>> launching browser
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 180 builds.
>> Name: junit.framework.TestSuite@6b3fc7
>> Details: Could not start Selenium session: Failed to start new browser session:
Error while
>> launching browser
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 180 builds.
>> Name: junit.framework.TestSuite@1d85f79
>> Details: Could not start Selenium session: Failed to start new browser session:
Error while
>> launching browser
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
>>
>> Failing for the past 828 builds.
>> Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome
executed with
>> credentials Admin:admin
>> Details: Validation errors in space=Main, page=WebHome ERROR: At least one style
attribute has been
>> found on the page.
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
>>
>> Failing for the past 828 builds.
>> Name: Validating Dutch Web Guidelines validity for: space=WikiManager,
page=CreateNewWiki executed
>> with credentials Admin:admin
>> Details: Validation errors in space=WikiManager, page=CreateNewWiki ERROR: An
input field has been
>> found with no label association.
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
>>
>> Failing for the past 828 builds.
>> Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome
executed with
>> credentials Admin:admin
>> Details: Validation errors in space=Main, page=WebHome ERROR: At least one style
attribute has been
>> found on the page.
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
>>
>> Failing for the past 828 builds.
>> Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome
executed with
>> credentials Admin:admin
>> Details: Validation errors in space=Main, page=WebHome ERROR: At least one style
attribute has been
>> found on the page.
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
>>
>> Failing for the past 839 builds.
>> Name: junit.framework.TestSuite@2a4983
>> Details: Could not start Selenium session: Failed to start new browser session:
Error while
>> launching browser
>> Link:
>>
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…