Hi Caleb,
Nice start. Some questions/feedback:
* Is this replacing the standard hudson emails or does it come as an additional report?
When is it sent?
* I'd like to see an email whenever someone commits something that makes one of the
modules fail to build and in that mail the title should be short and explicit about whom
has made the build fail + the mail should contain the log of the failure (in order to
understand why it fails directly from the email).
IMO in general we need:
* less emails from hudson (only mails when builds are failing IMO, not needed when
they're not)
* separate flickering from non flickering
* shorter email titles
* know how broke the build in the email and very visible
* console logs in the mail (not the full log, just the module that fails to build and only
the part around the failure: let's say the last 100 lines)
Thanks
-Vincent
On Nov 9, 2010, at 4:02 AM, Caleb James DeLisle wrote:
Trying out a new test reporter, tell me what you
think.
Statistics Report:
22 tests failed out of a total of 3026
The total time taken to run the tests was 1853.3518 seconds,
and the average time taken by a test was 0.6124758 seconds.
The fastest test ran in 0.0 seconds,a record held by
http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$xwoot-conte…
The slowest test ran in 120.414 seconds,and that one was
http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$jxta/5/test…
and the average speed of a webstandards test (a good indication of page load speed) was
0.0 seconds.
-------------------------------------------------------------------------------
Detailed Failure Report:
0 Regressions,
0 Tests are Probably Flickering,
22 Failures
-------------------------------------------------------------------------------
Failures:
These tests have failed multiple times in a row.
Failing for the past 164 builds.
Name: Blog/Archive.xml [month, year, comment, space, language]
testParametersInColibri
Details: Escaping test failed. * Parameter: "year" Tested file:
Blog/Archive.xml URL:
http://127.0.0.1:8080/xwiki/bin/view/Blog/Archive?skin=colibri&year=aaa…
List of validation errors: line 305 column 133 WARNING: Macro execution exception
in the
response. line 531 column 0 WARNING: Possible SQL error trace. line 563
column 0
WARNING: Possible SQL error trace.
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: Blog/CreatePost.xml [category, comment, entrySpace, form_token, language,
entryTitle]
testParametersInColibri
Details: Escaping test failed. * Parameter: "entrySpace" Tested file:
Blog/CreatePost.xml URL:
http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entry…
List of validation errors: line 308 column 62 ERROR: Unescaped < character
line 308
column 58 ERROR: Unescaped > character * Parameter: "entryTitle" Tested
file:
Blog/CreatePost.xml URL:
http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entry…
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: Panels/PanelWizard.xml [forceLeftPanels, section, queryString, place,
forceRightPanels,
comment, space, language] testParametersInColibri
Details: Escaping test failed. * Parameter: "place" Tested file:
Panels/PanelWizard.xml URL:
http://127.0.0.1:8080/xwiki/bin/view/Panels/PanelWizard?skin=colibri&pl…
List of validation errors: line 341 column 95 ERROR: Unescaped < character
line 341
column 91 ERROR: Unescaped > character
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: XWiki/ExtensionManager.xml [extensionid, actioninstall, actionresolve, confirm,
extensionversion, comment, actionuninstall, language, editor] testParametersInColibri
Details: Escaping test failed. * Parameter: "actioninstall" Tested file:
XWiki/ExtensionManager.xml URL:
http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&am…
List of validation errors: line 321 column 140 WARNING: Macro execution exception
in the
response. * Parameter: "actionresolve" Tested file:
XWiki/ExtensionManager.xml URL:
http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&am…
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: XWiki/LiveTableResults.xml [classname, orphaned, collist, comment, space,
language]
testParametersInColibri
Details: Escaping test failed. * Parameter: "classname" Tested file:
XWiki/LiveTableResults.xml
URL:
http://127.0.0.1:8080/xwiki/bin/view/XWiki/LiveTableResults?classname=aaa%2…
List of validation errors: line 304 column 133 WARNING: Macro execution exception
in the
response. line 408 column 0 WARNING: Possible SQL error trace. line 423
column 0
WARNING: Possible SQL error trace. * Parameter: "space" Tested file:
XWiki/LiveTab
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: testClassEditor
Details: Escaping test for XWIKI-5404 failed. Tested file: templates/editclass.vm
URL:
http://127.0.0.1:8080/xwiki/bin/edit/aaa%22bbb%27ccc%3Eddd%3Ceee/aaa%22bbb%…
List of validation errors: line 332 column 71 WARNING: Unescaped ' character
line 336
column 77 WARNING: Unescaped ' character line 338 column 78 WARNING:
Unescaped ' character
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: templates/editattachments.vm [] testPageEscaping
Details: Escaping test for page name failed. Tested file: templates/editattachments.vm
URL:
http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=…
List of validation errors: line 1 column 42 ERROR: Unescaped < character
line 1
column 38 ERROR: Unescaped > character
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: templates/editgroup.vm [classname] testPageEscaping
Details: Escaping test for page name failed. Tested file: templates/editgroup.vm
URL:
http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=…
List of validation errors: line 0 column 0 WARNING: Unexpected empty
response
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: templates/editgroup.vm [classname]
testParameterEscaping
Details: Escaping test failed. * Parameter: "classname" Tested file:
templates/editgroup.vm URL:
http://127.0.0.1:8080/xwiki/bin/view/Main/WebHome?classname=aaa%22bbb%27ccc…
List of validation errors: line 0 column 0 WARNING: Unexpected empty
response
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 164 builds.
Name: templates/editgroup.vm [classname] testSpaceEscaping
Details: Escaping test for space name failed. Tested file: templates/editgroup.vm
URL:
http://127.0.0.1:8080/xwiki/bin/view/aaa%22bbb%27ccc%3Eddd%3Ceee/WebHome?sk…
List of validation errors: line 0 column 0 WARNING: Unexpected empty
response
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 177 builds.
Name: testDocumentCacheSync
Details: null expected:<[modified ]content> but was:<[]content>
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 177 builds.
Name: testDocumentCacheSyncForAttachments
Details: Name: PUT URI:
http://localhost:8081/xwiki/rest/wikis/xwiki/spaces/Test/pages/AttachementC…
Status code: 404 Status text: Not Found Response: <html> <head>
<title>Status page</title>
</head> <body> <h3>The server has not found anything matching the
request URI</h3><p>You can get
technical details <a
href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.5…
Please
continue your visit at our <a href="/">home page</a>. </p>
</body> </html>
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 177 builds.
Name: org.xwiki.test.ui.AllTests
Details: Failed to connect to binary FirefoxBinary(/home/hudsonagent/firefox/firefox) on
port 7055;
process output follows: Error: cannot open display: :1.0 System info: os.name:
'Linux', os.arch:
'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version:
'1.5.0_15' Driver info:
driver.version: firefox
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 177 builds.
Name: org.xwiki.test.ui.AllTests
Details: Failed to connect to binary FirefoxBinary(/home/hudsonagent/firefox/firefox) on
port 7055;
process output follows: Error: cannot open display: :1.0 System info: os.name:
'Linux', os.arch:
'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version:
'1.5.0_15' Driver info:
driver.version: firefox
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 177 builds.
Name: WYSIWYG Selenium Tests
Details: Could not start Selenium session: Failed to start new browser session: Error
while
launching browser
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 180 builds.
Name: junit.framework.TestSuite@6b3fc7
Details: Could not start Selenium session: Failed to start new browser session: Error
while
launching browser
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 180 builds.
Name: junit.framework.TestSuite@1d85f79
Details: Could not start Selenium session: Failed to start new browser session: Error
while
launching browser
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterp…
Failing for the past 828 builds.
Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome executed
with
credentials Admin:admin
Details: Validation errors in space=Main, page=WebHome ERROR: At least one style
attribute has been
found on the page.
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
Failing for the past 828 builds.
Name: Validating Dutch Web Guidelines validity for: space=WikiManager, page=CreateNewWiki
executed
with credentials Admin:admin
Details: Validation errors in space=WikiManager, page=CreateNewWiki ERROR: An input field
has been
found with no label association.
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
Failing for the past 828 builds.
Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome executed
with
credentials Admin:admin
Details: Validation errors in space=Main, page=WebHome ERROR: At least one style
attribute has been
found on the page.
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
Failing for the past 828 builds.
Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome executed
with
credentials Admin:admin
Details: Validation errors in space=Main, page=WebHome ERROR: At least one style
attribute has been
found on the page.
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
Failing for the past 839 builds.
Name: junit.framework.TestSuite@2a4983
Details: Could not start Selenium session: Failed to start new browser session: Error
while
launching browser
Link:
http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwik…
-------------------------------------------------------------------------------