Branch: refs/heads/xwiki-release-test-triage-skill Home: https://github.com/xwiki/xwiki-dev-llm Commit: 879e8202aadd22888014a7709f3147e649128c7e https://github.com/xwiki/xwiki-dev-llm/commit/879e8202aadd22888014a7709f3147... Author: Vincent Massol <[email protected]> Date: 2026-09-06 (Sun, 06 Sep 2026) Changed paths: M README.md M xwiki/skills/xwiki-release-test-triage/SKILL.md M xwiki/skills/xwiki-release-test-triage/tools/triage.mjs Log Message: ----------- [Misc] Rate each failure over recent builds, not just the latest one * One build is one sample, so the previous version could not tell a test that flickered once from one that has failed every build for a fortnight. triage.mjs now also counts, per test, the builds of the last few (--history, default 5 per job) in which it ran and failed, and a test that fails every recent build is systematic even when a single environment ran it. * Stop letting an open flickering issue settle the question. The evidence outranks the issue: a test with a flicker issue that now fails in every environment is triaged as a breakage, and the issue is marked STALE when it also fails every recent build. Checked against master, where the realtime tests carry open flicker issues while failing all four environments. Co-Authored-By: Claude Opus 5 (1M context) <[email protected]> To unsubscribe from these emails, change your notification settings at https://github.com/xwiki/xwiki-dev-llm/settings/notifications