Skip to content

Question: Cannot start KafkaContainer() #1015

@wfxronald

Description

@wfxronald

I am trying to create a KafkaContainer for my integration test, but I have issues starting it.

Using testcontainers==4.12.0, the following snippet has no issues:

from testcontainers.kafka import KafkaContainer
kafka_container = KafkaContainer()
kafka_container.start()
kafka_bootstrap_servers = cls.kafka_container.get_bootstrap_server()

However, upgrading to testcontainers==4.14.2, the same snippet gives the following issue:

Traceback (most recent call last):
  File "...\test.py", line 42, in setUpClass
    cls.kafka_container.start()
  File "...\env\Lib\site-packages\testcontainers\kafka\__init__.py", line 192, in start
    self.tc_start()
  File "...\env\Lib\site-packages\testcontainers\kafka\__init__.py", line 165, in tc_start
    port = self.get_exposed_port(self.port)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "...\env\Lib\site-packages\testcontainers\core\container.py", line 251, in get_exposed_port
    return self._get_exposed_port(port)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "...\env\Lib\site-packages\testcontainers\core\container.py", line 257, in _get_exposed_port
    return int(self.get_docker_client().port(c.id, port))
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "...\env\Lib\site-packages\testcontainers\core\docker_client.py", line 170, in port
    raise ConnectionError(f"Port mapping for container {container_id} and port {port} is not available")
ConnectionError: Port mapping for container 06001694f7ed34dac7f89c4f3a3488d23a884338ec2cc8b367120c2452d39382 and port 9093 is not available

I did a simple investigation and found out that the waiting logic has changed between these two tags. When I use tag 13.0 and 13.1, there is a "legacy deprecation warning" but KafkaContainer can still be started.

...\test.py:40: DeprecationWarning: The wait_for_logs function with string or callable predicates is deprecated and will be removed in a future version. Use structured wait strategies instead: container.waiting_for(LogMessageWaitStrategy('ready')) or container.waiting_for(LogMessageWaitStrategy(re.compile(r'pattern')))
  wait_for_logs(cls.kafka_container, "started")

Specifically, the ConnectionError I mentioned above occurred when I upgraded 13.1 to 13.2. The changes I suspect could cause this would be this line

Not sure if this is caused by wrong usage of the library or my personal setup. It is worth noting that I have to disable Ryuk when running the code snippet (using TESTCONTAINERS_RYUK_DISABLED=true) and I am running the code snippet from Windows cmd.

Let me know if there are more information I could provide to investigate this further

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions