Kafka: runtime integration test failure or flaky

[stevenzwu]

Apache Iceberg version

main (development)

Query engine

Kafka Connect

Please describe the bug 🐞

here is an example CI build failure for main branch: https://github.com/apache/iceberg/actions/runs/10618244799/job/29432988040

> Task :iceberg-kafka-connect:iceberg-kafka-connect-runtime:integrationTest

IntegrationDynamicTableTest > testIcebergSink(String) > [1] null FAILED
    java.lang.ExceptionInInitializerError at IntegrationDynamicTableTest.java:38
        Caused by: org.testcontainers.containers.ContainerLaunchException at IntegrationDynamicTableTest.java:38
            Caused by: org.rnorth.ducttape.RetryCountExceededException at IntegrationDynamicTableTest.java:38
                Caused by: org.testcontainers.containers.ContainerLaunchException at IntegrationDynamicTableTest.java:38
                    Caused by: java.lang.IllegalStateException at IntegrationDynamicTableTest.java:38

IntegrationDynamicTableTest > testIcebergSink(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationDynamicTableTest.java:38
        Caused by: java.lang.ExceptionInInitializerError at IntegrationDynamicTableTest.java:38

IntegrationMultiTableTest > testIcebergSink(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationMultiTableTest.java:38
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationMultiTableTest > testIcebergSink(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationMultiTableTest.java:38
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkUnpartitionedTable(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkUnpartitionedTable(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkSchemaEvolution(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkSchemaEvolution(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkAutoCreate(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkAutoCreate(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkPartitionedTable(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkPartitionedTable(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359


> Task :iceberg-kafka-connect:iceberg-kafka-connect-runtime:integrationTest FAILED
12 tests completed, 12 failed

FAILURE: Build failed with an exception.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.


You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
* What went wrong:

Execution failed for task ':iceberg-kafka-connect:iceberg-kafka-connect-runtime:integrationTest'.

Willingness to contribute

• I can contribute a fix for this bug independently
• I would be willing to contribute a fix for this bug with guidance from the Iceberg community
• I cannot contribute a fix for this bug at this time

[stevenzwu]

cc @bryanck