[xwiki-devs] State of our selenium tests on multiple browsers (on Mac)

Hi devs, Yesterday, I tried to fix some functional UI tests that were failing on my machine (Mac) since 9 ui tests were failing. FireFox Driver =========== After some time and help from Marius we realized that Native Events are currently not supported on Mac for the Firefox driver (see https://groups.google.com/forum/?fromgroups#!topic/webdriver/LfMDwd2phDg and https://groups.google.com/forum/?fromgroups#!topic/selenium-users/DYHb61cJH… ) Note that the tests work if the browser window has the focus... Chrome Driver =========== Next I tried to use ChromeDriver by installing https://code.google.com/p/chromedriver/downloads/list version 0.9 (chromedriver2_mac32_0.9.zip). I got: Tests run: 359, Failures: 2, Errors: 188, Skipped: 1 … One big problem I got was: org.openqa.selenium.WebDriverException: focusElement execution failed; Failed to send keys because cannot focus element (WARNING: The server did not provide any stacktrace information) Which corresponds to https://code.google.com/p/chromedriver/issues/detail?id=59 (see my comments at the bottom) PhantomJS Driver (aka Ghostdriver) ============================= Next I tried phantomJS/ghostdriver (see http://jira.xwiki.org/browse/XWIKI-9198). I just tried to run EditWYSIWYGTest and 4 tests out of 8 failed. One issue is the one I raised at https://github.com/detro/ghostdriver/issues/226 That's not the only issue though… Conclusion ========= There's a lot of work to make our functional tests work with various selenium drivers and there's no solution that works well on Mac... Thanks -Vincent