Skip to content

IT Failure(google-cloud-compute): ITPaginationTest.testPaginationIterating zone not found #9134

Open

Description

@emmileaf

Failures observed in GraalVM nightly build and presubmit. This error is happening often (in a number of presubmits and re-triggers), but not consistently:

Problematic test - com.google.cloud.compute.v1.integration.ITPaginationTest.testPaginationIterating

Failures (1):
  JUnit Vintage:ITPaginationTest:testPaginationIterating
    MethodSource [className = 'com.google.cloud.compute.v1.integration.ITPaginationTest', methodName = 'testPaginationIterating', methodParameterTypes = '']
    => java.lang.AssertionError: Zone us-central1-a was not found for cloud-java-ci-test in zones list (size: 65).
       org.junit.Assert.fail(Assert.java:89)
       org.junit.Assert.assertTrue(Assert.java:42)
       com.google.cloud.compute.v1.integration.ITPaginationTest.testPaginationIterating(ITPaginationTest.java:124)
       java.base@17.0.5/java.lang.reflect.Method.invoke(Method.java:568)
       org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
       org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
       org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
       org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
       org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
       org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
       [...]

This could be a similar issue with interfering compute resources from integration tests as observed/addressed in #8260.

Activity

  1. added
    type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.
    priority: p2Moderately-important priority. Fix may not be included in next release.
    on Feb 17, 2023
  2. emmileaf commented on Feb 17, 2023

    @emmileaf
    ContributorAuthor

    Update - seems like this is a previously observed flake coming back: googleapis/java-compute#683, googleapis/java-compute#682 (comment) look relevant.

  3. emmileaf commented on Feb 17, 2023

    @emmileaf
    ContributorAuthor

    An initial investigation from locally reproducing this error w/ Terraform:

    gcloud compute zones list returns 119 zones, which also consistent with the response.iterateAll() size from testList().

    In testPaginationIterating(), iterating over zones sometimes gets stuck at around this point:

    ...
    Zone: europe-west9-b
    Zone: europe-west9-a
    Zone: me-central1-b
    Zone: me-central1-c
    

    response.IterateAll() size: 46

    And sometimes able to get a full list including us-central1-a (DEFAULT_ZONE):

    ...
    Zone: europe-west9-b
    Zone: europe-west9-a
    Zone: me-west1-a
    Zone: me-west1-c
    Zone: me-west1-b
    ...
    Zone: us-central1-a
    ...
    
  4. emmileaf commented on Feb 21, 2023

    @emmileaf
    ContributorAuthor

    The nightly builds are back to green, and I am no longer able to reproduce this error 🤔. Leaving this issue open to track and revisit if it resurfaces again.

  5. lqiu96 commented on Apr 25, 2023

    @lqiu96
    Member

    Closing this issue now. It's been ~3 months since this last flaked. We can re-open if this test flakes again.

  6. emmileaf commented on Jun 9, 2023

    @emmileaf
    ContributorAuthor

    Observed this flake again in nightly build - reopening to track.

  7. added
    type: processA process-related concern. May include testing, release, or the like.
    and removed
    type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.
    on Jun 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    priority: p2Moderately-important priority. Fix may not be included in next release.type: processA process-related concern. May include testing, release, or the like.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions