Build #98

Build: #98 failed Changes by Dawid Weiss

Stages & jobs

  1. Compile and test

  2. Package

Build result summary

Details

Completed
Duration
16 seconds
Labels
None
Revision
31cc2d277c5cdc01830e3027c768accda9cccf34 31cc2d277c5cdc01830e3027c768accda9cccf34
Total tests
608
Fixed in
#99 (Changes by Dawid Weiss)

Tests

Responsible

Code commits

Author Commit Message Commit date
Dawid Weiss Dawid Weiss 31cc2d277c5cdc01830e3027c768accda9cccf34 31cc2d277c5cdc01830e3027c768accda9cccf34 GH-194: Flexible test case ordering via the new annotation (TestCaseOrdering). Minor cleanups in RandomizedRunner code.

Tests

New test failures 416
Status Test View job Duration
Collapse Failed TestAnnotationInheritance checkOldMethodRules History
JDK 11 J9 < 1 sec
org.junit.ComparisonFailure: [# JUnit order:
[before-class, rule-before, inherited before-test, inherited testMethod, inherited after-test, rule-after, after-class]
# RR order:
[]] expected:<[["before-class",
    "rule-before",
    "inherited before-test",
    "inherited testMethod",
    "inherited after-test",
(3 more lines...)
Collapse Failed TestAnnotationInheritance checkOldMethodRules History
JDK 1.7 < 1 sec
org.junit.ComparisonFailure: [# JUnit order:
[before-class, rule-before, inherited before-test, inherited testMethod, inherited after-test, rule-after, after-class]
# RR order:
[]] expected:<[["before-class",
    "rule-before",
    "inherited before-test",
    "inherited testMethod",
    "inherited after-test",
(3 more lines...)
Collapse Failed TestAnnotationInheritance checkOldMethodRules History
JDK 1.8 < 1 sec
org.junit.ComparisonFailure: [# JUnit order:
[before-class, rule-before, inherited before-test, inherited testMethod, inherited after-test, rule-after, after-class]
# RR order:
[]] expected:<[["before-class",
    "rule-before",
    "inherited before-test",
    "inherited testMethod",
    "inherited after-test",
(3 more lines...)
Collapse Failed TestAnnotationInheritance checkOldMethodRules History
JDK 9 < 1 sec
org.junit.ComparisonFailure: [# JUnit order:
[before-class, rule-before, inherited before-test, inherited testMethod, inherited after-test, rule-after, after-class]
# RR order:
[]] expected:<[["before-class",
    "rule-before",
    "inherited before-test",
    "inherited testMethod",
    "inherited after-test",
(3 more lines...)
Collapse Failed TestAssumptionsAtClassLevel checkOrder History
JDK 11 J9 < 1 sec
java.lang.AssertionError: expected:<1> but was:<0>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at com.carrotsearch.randomizedtesting.contracts.TestAssumptionsAtClassLevel.checkOrder(TestAssumptionsAtClassLevel.java:84)
Collapse Failed TestAssumptionsAtClassLevel checkOrder History
JDK 1.7 < 1 sec
java.lang.AssertionError: expected:<1> but was:<0>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at com.carrotsearch.randomizedtesting.contracts.TestAssumptionsAtClassLevel.checkOrder(TestAssumptionsAtClassLevel.java:84)
Collapse Failed TestAssumptionsAtClassLevel checkOrder History
JDK 1.8 < 1 sec
java.lang.AssertionError: expected:<1> but was:<0>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at com.carrotsearch.randomizedtesting.contracts.TestAssumptionsAtClassLevel.checkOrder(TestAssumptionsAtClassLevel.java:84)
Collapse Failed TestAssumptionsAtClassLevel checkOrder History
JDK 9 < 1 sec
java.lang.AssertionError: expected:<1> but was:<0>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at com.carrotsearch.randomizedtesting.contracts.TestAssumptionsAtClassLevel.checkOrder(TestAssumptionsAtClassLevel.java:84)
Collapse Failed TestBeforeAfterMethodOrder checkOrder History
JDK 11 J9 < 1 sec
java.lang.AssertionError: JUnit4 and RandomizedRunner differed.
	at org.junit.Assert.fail(Assert.java:93)
	at com.carrotsearch.randomizedtesting.contracts.TestBeforeAfterMethodOrder.checkOrder(TestBeforeAfterMethodOrder.java:224)
Collapse Failed TestBeforeAfterMethodOrder checkOrder History
JDK 1.7 < 1 sec
java.lang.AssertionError: JUnit4 and RandomizedRunner differed.
	at org.junit.Assert.fail(Assert.java:93)
	at com.carrotsearch.randomizedtesting.contracts.TestBeforeAfterMethodOrder.checkOrder(TestBeforeAfterMethodOrder.java:224)
Collapse Failed TestBeforeAfterMethodOrder checkOrder History
JDK 1.8 < 1 sec
java.lang.AssertionError: JUnit4 and RandomizedRunner differed.
	at org.junit.Assert.fail(Assert.java:93)
	at com.carrotsearch.randomizedtesting.contracts.TestBeforeAfterMethodOrder.checkOrder(TestBeforeAfterMethodOrder.java:224)
Collapse Failed TestBeforeAfterMethodOrder checkOrder History
JDK 9 < 1 sec
java.lang.AssertionError: JUnit4 and RandomizedRunner differed.
	at org.junit.Assert.fail(Assert.java:93)
	at com.carrotsearch.randomizedtesting.contracts.TestBeforeAfterMethodOrder.checkOrder(TestBeforeAfterMethodOrder.java:224)
Collapse Failed TestClassRules checkOldMethodRules History
JDK 11 J9 < 1 sec
java.lang.AssertionError: expected:<[rule-before, before-class, passing, after-class, rule-after]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.contracts.TestClassRules.assertSameExecution(TestClassRules.java:73)
	at com.carrotsearch.randomizedtesting.contracts.TestClassRules.checkOldMethodRules(TestClassRules.java:60)
Collapse Failed TestClassRules checkOldMethodRules History
JDK 1.7 < 1 sec
java.lang.AssertionError: expected:<[rule-before, before-class, passing, after-class, rule-after]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.contracts.TestClassRules.assertSameExecution(TestClassRules.java:73)
	at com.carrotsearch.randomizedtesting.contracts.TestClassRules.checkOldMethodRules(TestClassRules.java:60)
Collapse Failed TestClassRules checkOldMethodRules History
JDK 1.8 < 1 sec
java.lang.AssertionError: expected:<[rule-before, before-class, passing, after-class, rule-after]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.contracts.TestClassRules.assertSameExecution(TestClassRules.java:73)
	at com.carrotsearch.randomizedtesting.contracts.TestClassRules.checkOldMethodRules(TestClassRules.java:60)
Collapse Failed TestClassRules checkOldMethodRules History
JDK 9 < 1 sec
java.lang.AssertionError: expected:<[rule-before, before-class, passing, after-class, rule-after]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.contracts.TestClassRules.assertSameExecution(TestClassRules.java:73)
	at com.carrotsearch.randomizedtesting.contracts.TestClassRules.checkOldMethodRules(TestClassRules.java:60)
Collapse Failed TestNoClassHooksShadowingRule testShadowingNoAnnotation History
JDK 11 J9 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoClassHooksShadowingRule.testShadowingNoAnnotation(TestNoClassHooksShadowingRule.java:63)
Collapse Failed TestNoClassHooksShadowingRule testShadowingWithAnnotation History
JDK 11 J9 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoClassHooksShadowingRule.testShadowingWithAnnotation(TestNoClassHooksShadowingRule.java:71)
Collapse Failed TestNoClassHooksShadowingRule testShadowingWithAnnotation History
JDK 1.7 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoClassHooksShadowingRule.testShadowingWithAnnotation(TestNoClassHooksShadowingRule.java:71)
Collapse Failed TestNoClassHooksShadowingRule testShadowingNoAnnotation History
JDK 1.7 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoClassHooksShadowingRule.testShadowingNoAnnotation(TestNoClassHooksShadowingRule.java:63)
Collapse Failed TestNoClassHooksShadowingRule testShadowingNoAnnotation History
JDK 1.8 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoClassHooksShadowingRule.testShadowingNoAnnotation(TestNoClassHooksShadowingRule.java:63)
Collapse Failed TestNoClassHooksShadowingRule testShadowingWithAnnotation History
JDK 1.8 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoClassHooksShadowingRule.testShadowingWithAnnotation(TestNoClassHooksShadowingRule.java:71)
Collapse Failed TestNoClassHooksShadowingRule testShadowingWithAnnotation History
JDK 9 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoClassHooksShadowingRule.testShadowingWithAnnotation(TestNoClassHooksShadowingRule.java:71)
Collapse Failed TestNoClassHooksShadowingRule testShadowingNoAnnotation History
JDK 9 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoClassHooksShadowingRule.testShadowingNoAnnotation(TestNoClassHooksShadowingRule.java:63)
Collapse Failed TestNoInstanceHooksOverridesRule testOverrideNoAnnotation History
JDK 11 J9 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoInstanceHooksOverridesRule.testOverrideNoAnnotation(TestNoInstanceHooksOverridesRule.java:79)
Collapse Failed TestNoInstanceHooksOverridesRule testOverrideWithAnnotation History
JDK 11 J9 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoInstanceHooksOverridesRule.testOverrideWithAnnotation(TestNoInstanceHooksOverridesRule.java:87)
Collapse Failed TestNoInstanceHooksOverridesRule testOverrideNoAnnotation History
JDK 1.7 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoInstanceHooksOverridesRule.testOverrideNoAnnotation(TestNoInstanceHooksOverridesRule.java:79)
Collapse Failed TestNoInstanceHooksOverridesRule testOverrideWithAnnotation History
JDK 1.7 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoInstanceHooksOverridesRule.testOverrideWithAnnotation(TestNoInstanceHooksOverridesRule.java:87)
Collapse Failed TestNoInstanceHooksOverridesRule testOverrideNoAnnotation History
JDK 1.8 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoInstanceHooksOverridesRule.testOverrideNoAnnotation(TestNoInstanceHooksOverridesRule.java:79)
Collapse Failed TestNoInstanceHooksOverridesRule testOverrideWithAnnotation History
JDK 1.8 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoInstanceHooksOverridesRule.testOverrideWithAnnotation(TestNoInstanceHooksOverridesRule.java:87)
Collapse Failed TestNoInstanceHooksOverridesRule testOverrideNoAnnotation History
JDK 9 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoInstanceHooksOverridesRule.testOverrideNoAnnotation(TestNoInstanceHooksOverridesRule.java:79)
Collapse Failed TestNoInstanceHooksOverridesRule testOverrideWithAnnotation History
JDK 9 < 1 sec
java.lang.AssertionError: 
Expecting actual not to be empty
	at com.carrotsearch.randomizedtesting.rules.TestNoInstanceHooksOverridesRule.testOverrideWithAnnotation(TestNoInstanceHooksOverridesRule.java:87)
Collapse Failed TestStaticFieldsInvariantRule testFailingAboveThreshold History
JDK 11 J9 < 1 sec
java.lang.AssertionError: 
Expected size:<1> but was:<0> in:
<[]>
	at com.carrotsearch.randomizedtesting.rules.TestStaticFieldsInvariantRule.testFailingAboveThreshold(TestStaticFieldsInvariantRule.java:100)
Collapse Failed TestStaticFieldsInvariantRule testFailingAboveThreshold History
JDK 1.7 < 1 sec
java.lang.AssertionError: 
Expected size:<1> but was:<0> in:
<[]>
	at com.carrotsearch.randomizedtesting.rules.TestStaticFieldsInvariantRule.testFailingAboveThreshold(TestStaticFieldsInvariantRule.java:100)
Collapse Failed TestStaticFieldsInvariantRule testFailingAboveThreshold History
JDK 1.8 < 1 sec
java.lang.AssertionError: 
Expected size:<1> but was:<0> in:
<[]>
	at com.carrotsearch.randomizedtesting.rules.TestStaticFieldsInvariantRule.testFailingAboveThreshold(TestStaticFieldsInvariantRule.java:100)
Collapse Failed TestStaticFieldsInvariantRule testFailingAboveThreshold History
JDK 9 < 1 sec
java.lang.AssertionError: 
Expected size:<1> but was:<0> in:
<[]>
	at com.carrotsearch.randomizedtesting.rules.TestStaticFieldsInvariantRule.testFailingAboveThreshold(TestStaticFieldsInvariantRule.java:100)
Collapse Failed TestClassMethodFiltering testGlobMethodName History
JDK 11 J9 < 1 sec
java.lang.AssertionError: expected:<[beforeClass1, method1, beforeClass2, method1]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testGlobMethodName(TestClassMethodFiltering.java:109)
Collapse Failed TestClassMethodFiltering testMethodFilter History
JDK 11 J9 < 1 sec
java.lang.AssertionError: expected:<[beforeClass1, method1, beforeClass2, method1]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testMethodFilter(TestClassMethodFiltering.java:87)
Collapse Failed TestClassMethodFiltering testGlobClassName History
JDK 11 J9 < 1 sec
java.lang.AssertionError: null
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testGlobClassName(TestClassMethodFiltering.java:97)
Collapse Failed TestClassMethodFiltering testClassMethodFilter History
JDK 11 J9 < 1 sec
java.lang.AssertionError: expected:<[beforeClass1, method2]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testClassMethodFilter(TestClassMethodFiltering.java:77)
Collapse Failed TestClassMethodFiltering testClassFilter History
JDK 11 J9 < 1 sec
java.lang.AssertionError: null
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testClassFilter(TestClassMethodFiltering.java:64)
Collapse Failed TestClassMethodFiltering testClassFilter History
JDK 1.7 < 1 sec
java.lang.AssertionError: null
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testClassFilter(TestClassMethodFiltering.java:64)
Collapse Failed TestClassMethodFiltering testClassMethodFilter History
JDK 1.7 < 1 sec
java.lang.AssertionError: expected:<[beforeClass1, method2]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testClassMethodFilter(TestClassMethodFiltering.java:77)
Collapse Failed TestClassMethodFiltering testGlobMethodName History
JDK 1.7 < 1 sec
java.lang.AssertionError: expected:<[beforeClass1, method1, beforeClass2, method1]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testGlobMethodName(TestClassMethodFiltering.java:109)
Collapse Failed TestClassMethodFiltering testMethodFilter History
JDK 1.7 < 1 sec
java.lang.AssertionError: expected:<[beforeClass1, method1, beforeClass2, method1]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testMethodFilter(TestClassMethodFiltering.java:87)
Collapse Failed TestClassMethodFiltering testGlobClassName History
JDK 1.7 < 1 sec
java.lang.AssertionError: null
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testGlobClassName(TestClassMethodFiltering.java:97)
Collapse Failed TestClassMethodFiltering testGlobMethodName History
JDK 1.8 < 1 sec
java.lang.AssertionError: expected:<[beforeClass1, method1, beforeClass2, method1]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testGlobMethodName(TestClassMethodFiltering.java:109)
Collapse Failed TestClassMethodFiltering testClassFilter History
JDK 1.8 < 1 sec
java.lang.AssertionError: null
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testClassFilter(TestClassMethodFiltering.java:64)
Collapse Failed TestClassMethodFiltering testGlobClassName History
JDK 1.8 < 1 sec
java.lang.AssertionError: null
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testGlobClassName(TestClassMethodFiltering.java:97)
Collapse Failed TestClassMethodFiltering testClassMethodFilter History
JDK 1.8 < 1 sec
java.lang.AssertionError: expected:<[beforeClass1, method2]> but was:<[]>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at com.carrotsearch.randomizedtesting.TestClassMethodFiltering.testClassMethodFilter(TestClassMethodFiltering.java:77)

Jira issues

IssueDescriptionStatus
Unknown Issue TypeGH-194Could not obtain issue details from Jira