Bug 29220

Summary: run-webkit-tests needs a --repeat-each=N option (AAABBBCCC instead of ABCABCABC)
Product: WebKit Reporter: Eric Seidel (no email) <eric>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED FIXED    
Severity: Normal CC: simon.fraser
Priority: P2    
Version: 528+ (Nightly build)   
Hardware: PC   
OS: OS X 10.5   
Attachments:
Description Flags
Patch v1 darin: review+

Eric Seidel (no email)
Reported 2009-09-11 19:02:25 PDT
run-webkit-tests needs a --repeat-each=N option which will repeat each test N times. so: run-webkit-tests foo.html bar.html --repeat-each=N would do: foo -> passed foo -> passed bar -> passed bar -> passed This is useful for finding flakey tests (like https://bugs.webkit.org/show_bug.cgi?id=28845#c35) or tests which are causing later tests to fail. It also could be useful for finding tests which fail if their resources are already cached, etc.
Attachments
Patch v1 (2.81 KB, patch)
2009-09-22 13:56 PDT, Eric Seidel (no email) 		darin: review+
DetailsFormatted DiffDiff
View All Add attachment proposed patch, testcase, etc.
Alexey Proskuryakov
Comment 1 2009-09-15 10:46:39 PDT
*** This bug has been marked as a duplicate of bug 29263 ***
Simon Fraser (smfr)
Comment 2 2009-09-15 10:51:15 PDT
Actually in 29263 I took the easy way out and just duplicated the @tests array N times, so that the order will be: ABCABCABC not AAABBBCCC I'd be fine either way.
Eric Seidel (no email)
Comment 3 2009-09-15 11:03:17 PDT
After discussion in bug 29263, unduping... bug 29263 added support for running tests ABC as ABCABCABC this bug is about running test ABC as AAABBBCCC
Eric Seidel (no email)
Comment 4 2009-09-22 13:56:52 PDT
Created attachment 39941 [details] Patch v1
Darin Adler
Comment 5 2009-09-22 14:07:21 PDT
Comment on attachment 39941 [details] Patch v1 > - --iterations n Number of times to run the tests > + --iterations n Number of times to run the set of tests (e.g. ABCABCABC) > + --repeat-each n Number of times to run each test (e.g. AAABBBCCC) These are alphabetical, so --repeat-each should go further down in the list.
Eric Seidel (no email)
Comment 6 2009-09-22 14:11:40 PDT
Committed r48649: <http://trac.webkit.org/changeset/48649>
Eric Seidel (no email)
Comment 7 2009-09-22 14:11:44 PDT
Comment on attachment 39941 [details] Patch v1 Thanks! Fixed.
Eric Seidel (no email)
Comment 8 2009-09-22 15:39:49 PDT
Committed r48655: <http://trac.webkit.org/changeset/48655>
Note You need to log in before you can comment on or make changes to this bug.