New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[8.2](backport #31048) Put data stream so there is no need for additional permissions #31180

Merged

kvch merged 1 commit into 8.2 from mergify/bp/8.2/pr-31048

Apr 6, 2022

+336 −32

Contributor

mergify bot commented Apr 6, 2022 •

edited by zube bot

Loading

This is an automatic backport of pull request #31048 done by Mergify.

Mergify commands and options

More conditions and actions can be found in the documentation.

You can also trigger Mergify actions by commenting on this pull request:

@Mergifyio refresh will re-evaluate the rules
@Mergifyio rebase will rebase this PR on its base branch
@Mergifyio update will merge the base branch into this PR
@Mergifyio backport <destination> will backport this PR on <destination> branch

Additionally, on Mergify dashboard you can:

look at your merge queues
generate the Mergify configuration with the config editor.

Finally, you can contact us on https://mergify.com


          Put data stream so there is no need for additional permissions (#31048)

567557f

## What does this PR do?

This PR adds a new step to loading templates. Now not only the template is loaded, but the data stream is created as well. Given that users might load templates from JSON file that are not data streams, I added a new option called `setup.template.json.data_stream`. It has to be set, if the JSON template is a data stream.

## Why is it important?

Without this change users needed more permissions to publish events. Now `create_doc` priviledge is  enough to publish events to the data stream.

Closes #30647
Closes #30567

(cherry picked from commit 5cdb312)

mergify bot requested review from a team as code owners

April 6, 2022 09:32

mergify bot added the backport label

mergify bot assigned kvch

botelastic bot added the needs_team label

botelastic bot commented Apr 6, 2022

This pull request doesn't have a Team:<team> label.

Collaborator

elasticmachine commented Apr 6, 2022

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2022-04-06T09:32:52.364+0000
Duration: 108 min 59 sec

Test stats 🧪

Test	Results
Failed	8
Passed	21999
Skipped	1933
Total	23940

Test errors

Expand to view the tests failures

`Build&Test / x-pack/metricbeat-pythonIntegTest / test_dashboards – x-pack.metricbeat.tests.system.test_xpack_base.Test`

Expand to view the error details

 failed on setup with "Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana"

Expand to view the stacktrace

 self = <class 'test_xpack_base.Test'>

    @classmethod
    def setUpClass(self):
        self.beat_name = "metricbeat"
        self.beat_path = os.path.abspath(
            os.path.join(os.path.dirname(__file__), "../../"))
    
        self.template_paths = [
            os.path.abspath(os.path.join(self.beat_path, "../../metricbeat")),
            os.path.abspath(os.path.join(self.beat_path, "../../libbeat")),
        ]
    
>       super(XPackTest, self).setUpClass()

tests/system/xpack_metricbeat.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../metricbeat/tests/system/metricbeat.py:42: in setUpClass
    super().setUpClass()
../../libbeat/tests/system/beat/beat.py:199: in setUpClass
    cls.compose_up_with_retries()
../../libbeat/tests/system/beat/beat.py:217: in compose_up_with_retries
    raise ex
../../libbeat/tests/system/beat/beat.py:213: in compose_up_with_retries
    cls.compose_up()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'test_xpack_base.Test'>

    @classmethod
    def compose_up(cls):
        """
        Ensure *only* the services defined under `COMPOSE_SERVICES` are running and healthy
        """
        if not INTEGRATION_TESTS or not cls.COMPOSE_SERVICES:
            return
    
        if os.environ.get('NO_COMPOSE'):
            return
    
        def print_logs(container):
            print("---- " + container.name_without_project)
            print(container.logs())
            print("----")
    
        def is_healthy(container):
            return container.inspect()['State']['Health']['Status'] == 'healthy'
    
        project = cls.compose_project()
    
        with disabled_logger('compose.service'):
            project.pull(
                ignore_pull_failures=True,
                service_names=cls.COMPOSE_SERVICES)
    
        project.up(
            strategy=ConvergenceStrategy.always,
            service_names=cls.COMPOSE_SERVICES,
            timeout=30)
    
        # Wait for them to be healthy
        start = time.time()
        while True:
            containers = project.containers(
                service_names=cls.COMPOSE_SERVICES,
                stopped=True)
    
            healthy = True
            for container in containers:
                if not container.is_running:
                    print_logs(container)
                    raise Exception(
                        "Container %s unexpectedly finished on startup" %
                        container.name_without_project)
                if not is_healthy(container):
                    healthy = False
                    break
    
            if healthy:
                break
    
            if cls.COMPOSE_ADVERTISED_HOST:
                for service in cls.COMPOSE_SERVICES:
                    cls._setup_advertised_host(project, service)
    
            time.sleep(1)
            timeout = time.time() - start > cls.COMPOSE_TIMEOUT
            if timeout:
                for container in containers:
                    if not is_healthy(container):
                        print_logs(container)
>               raise Exception(
                    "Timeout while waiting for healthy "
                    "docker-compose services: %s" %
                    ','.join(cls.COMPOSE_SERVICES))
E               Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana

../../libbeat/tests/system/beat/compose.py:102: Exception

`Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_config – x-pack.metricbeat.tests.system.test_xpack_base.Test`

Expand to view the error details

 failed on setup with "Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana"

Expand to view the stacktrace

 self = <class 'test_xpack_base.Test'>

    @classmethod
    def setUpClass(self):
        self.beat_name = "metricbeat"
        self.beat_path = os.path.abspath(
            os.path.join(os.path.dirname(__file__), "../../"))
    
        self.template_paths = [
            os.path.abspath(os.path.join(self.beat_path, "../../metricbeat")),
            os.path.abspath(os.path.join(self.beat_path, "../../libbeat")),
        ]
    
>       super(XPackTest, self).setUpClass()

tests/system/xpack_metricbeat.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../metricbeat/tests/system/metricbeat.py:42: in setUpClass
    super().setUpClass()
../../libbeat/tests/system/beat/beat.py:199: in setUpClass
    cls.compose_up_with_retries()
../../libbeat/tests/system/beat/beat.py:217: in compose_up_with_retries
    raise ex
../../libbeat/tests/system/beat/beat.py:213: in compose_up_with_retries
    cls.compose_up()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'test_xpack_base.Test'>

    @classmethod
    def compose_up(cls):
        """
        Ensure *only* the services defined under `COMPOSE_SERVICES` are running and healthy
        """
        if not INTEGRATION_TESTS or not cls.COMPOSE_SERVICES:
            return
    
        if os.environ.get('NO_COMPOSE'):
            return
    
        def print_logs(container):
            print("---- " + container.name_without_project)
            print(container.logs())
            print("----")
    
        def is_healthy(container):
            return container.inspect()['State']['Health']['Status'] == 'healthy'
    
        project = cls.compose_project()
    
        with disabled_logger('compose.service'):
            project.pull(
                ignore_pull_failures=True,
                service_names=cls.COMPOSE_SERVICES)
    
        project.up(
            strategy=ConvergenceStrategy.always,
            service_names=cls.COMPOSE_SERVICES,
            timeout=30)
    
        # Wait for them to be healthy
        start = time.time()
        while True:
            containers = project.containers(
                service_names=cls.COMPOSE_SERVICES,
                stopped=True)
    
            healthy = True
            for container in containers:
                if not container.is_running:
                    print_logs(container)
                    raise Exception(
                        "Container %s unexpectedly finished on startup" %
                        container.name_without_project)
                if not is_healthy(container):
                    healthy = False
                    break
    
            if healthy:
                break
    
            if cls.COMPOSE_ADVERTISED_HOST:
                for service in cls.COMPOSE_SERVICES:
                    cls._setup_advertised_host(project, service)
    
            time.sleep(1)
            timeout = time.time() - start > cls.COMPOSE_TIMEOUT
            if timeout:
                for container in containers:
                    if not is_healthy(container):
                        print_logs(container)
>               raise Exception(
                    "Timeout while waiting for healthy "
                    "docker-compose services: %s" %
                    ','.join(cls.COMPOSE_SERVICES))
E               Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana

../../libbeat/tests/system/beat/compose.py:102: Exception

`Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_ilm_policy – x-pack.metricbeat.tests.system.test_xpack_base.Test`

Expand to view the error details

 failed on setup with "Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana"

Expand to view the stacktrace

 self = <class 'test_xpack_base.Test'>

    @classmethod
    def setUpClass(self):
        self.beat_name = "metricbeat"
        self.beat_path = os.path.abspath(
            os.path.join(os.path.dirname(__file__), "../../"))
    
        self.template_paths = [
            os.path.abspath(os.path.join(self.beat_path, "../../metricbeat")),
            os.path.abspath(os.path.join(self.beat_path, "../../libbeat")),
        ]
    
>       super(XPackTest, self).setUpClass()

tests/system/xpack_metricbeat.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../metricbeat/tests/system/metricbeat.py:42: in setUpClass
    super().setUpClass()
../../libbeat/tests/system/beat/beat.py:199: in setUpClass
    cls.compose_up_with_retries()
../../libbeat/tests/system/beat/beat.py:217: in compose_up_with_retries
    raise ex
../../libbeat/tests/system/beat/beat.py:213: in compose_up_with_retries
    cls.compose_up()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'test_xpack_base.Test'>

    @classmethod
    def compose_up(cls):
        """
        Ensure *only* the services defined under `COMPOSE_SERVICES` are running and healthy
        """
        if not INTEGRATION_TESTS or not cls.COMPOSE_SERVICES:
            return
    
        if os.environ.get('NO_COMPOSE'):
            return
    
        def print_logs(container):
            print("---- " + container.name_without_project)
            print(container.logs())
            print("----")
    
        def is_healthy(container):
            return container.inspect()['State']['Health']['Status'] == 'healthy'
    
        project = cls.compose_project()
    
        with disabled_logger('compose.service'):
            project.pull(
                ignore_pull_failures=True,
                service_names=cls.COMPOSE_SERVICES)
    
        project.up(
            strategy=ConvergenceStrategy.always,
            service_names=cls.COMPOSE_SERVICES,
            timeout=30)
    
        # Wait for them to be healthy
        start = time.time()
        while True:
            containers = project.containers(
                service_names=cls.COMPOSE_SERVICES,
                stopped=True)
    
            healthy = True
            for container in containers:
                if not container.is_running:
                    print_logs(container)
                    raise Exception(
                        "Container %s unexpectedly finished on startup" %
                        container.name_without_project)
                if not is_healthy(container):
                    healthy = False
                    break
    
            if healthy:
                break
    
            if cls.COMPOSE_ADVERTISED_HOST:
                for service in cls.COMPOSE_SERVICES:
                    cls._setup_advertised_host(project, service)
    
            time.sleep(1)
            timeout = time.time() - start > cls.COMPOSE_TIMEOUT
            if timeout:
                for container in containers:
                    if not is_healthy(container):
                        print_logs(container)
>               raise Exception(
                    "Timeout while waiting for healthy "
                    "docker-compose services: %s" %
                    ','.join(cls.COMPOSE_SERVICES))
E               Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana

../../libbeat/tests/system/beat/compose.py:102: Exception

`Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_index_pattern – x-pack.metricbeat.tests.system.test_xpack_base.Test`

Expand to view the error details

 failed on setup with "Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana"

Expand to view the stacktrace

 self = <class 'test_xpack_base.Test'>

    @classmethod
    def setUpClass(self):
        self.beat_name = "metricbeat"
        self.beat_path = os.path.abspath(
            os.path.join(os.path.dirname(__file__), "../../"))
    
        self.template_paths = [
            os.path.abspath(os.path.join(self.beat_path, "../../metricbeat")),
            os.path.abspath(os.path.join(self.beat_path, "../../libbeat")),
        ]
    
>       super(XPackTest, self).setUpClass()

tests/system/xpack_metricbeat.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../metricbeat/tests/system/metricbeat.py:42: in setUpClass
    super().setUpClass()
../../libbeat/tests/system/beat/beat.py:199: in setUpClass
    cls.compose_up_with_retries()
../../libbeat/tests/system/beat/beat.py:217: in compose_up_with_retries
    raise ex
../../libbeat/tests/system/beat/beat.py:213: in compose_up_with_retries
    cls.compose_up()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'test_xpack_base.Test'>

    @classmethod
    def compose_up(cls):
        """
        Ensure *only* the services defined under `COMPOSE_SERVICES` are running and healthy
        """
        if not INTEGRATION_TESTS or not cls.COMPOSE_SERVICES:
            return
    
        if os.environ.get('NO_COMPOSE'):
            return
    
        def print_logs(container):
            print("---- " + container.name_without_project)
            print(container.logs())
            print("----")
    
        def is_healthy(container):
            return container.inspect()['State']['Health']['Status'] == 'healthy'
    
        project = cls.compose_project()
    
        with disabled_logger('compose.service'):
            project.pull(
                ignore_pull_failures=True,
                service_names=cls.COMPOSE_SERVICES)
    
        project.up(
            strategy=ConvergenceStrategy.always,
            service_names=cls.COMPOSE_SERVICES,
            timeout=30)
    
        # Wait for them to be healthy
        start = time.time()
        while True:
            containers = project.containers(
                service_names=cls.COMPOSE_SERVICES,
                stopped=True)
    
            healthy = True
            for container in containers:
                if not container.is_running:
                    print_logs(container)
                    raise Exception(
                        "Container %s unexpectedly finished on startup" %
                        container.name_without_project)
                if not is_healthy(container):
                    healthy = False
                    break
    
            if healthy:
                break
    
            if cls.COMPOSE_ADVERTISED_HOST:
                for service in cls.COMPOSE_SERVICES:
                    cls._setup_advertised_host(project, service)
    
            time.sleep(1)
            timeout = time.time() - start > cls.COMPOSE_TIMEOUT
            if timeout:
                for container in containers:
                    if not is_healthy(container):
                        print_logs(container)
>               raise Exception(
                    "Timeout while waiting for healthy "
                    "docker-compose services: %s" %
                    ','.join(cls.COMPOSE_SERVICES))
E               Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana

../../libbeat/tests/system/beat/compose.py:102: Exception

`Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_index_pattern_migration – x-pack.metricbeat.tests.system.test_xpack_base.Test`

Expand to view the error details

 failed on setup with "Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana"

Expand to view the stacktrace

 self = <class 'test_xpack_base.Test'>

    @classmethod
    def setUpClass(self):
        self.beat_name = "metricbeat"
        self.beat_path = os.path.abspath(
            os.path.join(os.path.dirname(__file__), "../../"))
    
        self.template_paths = [
            os.path.abspath(os.path.join(self.beat_path, "../../metricbeat")),
            os.path.abspath(os.path.join(self.beat_path, "../../libbeat")),
        ]
    
>       super(XPackTest, self).setUpClass()

tests/system/xpack_metricbeat.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../metricbeat/tests/system/metricbeat.py:42: in setUpClass
    super().setUpClass()
../../libbeat/tests/system/beat/beat.py:199: in setUpClass
    cls.compose_up_with_retries()
../../libbeat/tests/system/beat/beat.py:217: in compose_up_with_retries
    raise ex
../../libbeat/tests/system/beat/beat.py:213: in compose_up_with_retries
    cls.compose_up()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'test_xpack_base.Test'>

    @classmethod
    def compose_up(cls):
        """
        Ensure *only* the services defined under `COMPOSE_SERVICES` are running and healthy
        """
        if not INTEGRATION_TESTS or not cls.COMPOSE_SERVICES:
            return
    
        if os.environ.get('NO_COMPOSE'):
            return
    
        def print_logs(container):
            print("---- " + container.name_without_project)
            print(container.logs())
            print("----")
    
        def is_healthy(container):
            return container.inspect()['State']['Health']['Status'] == 'healthy'
    
        project = cls.compose_project()
    
        with disabled_logger('compose.service'):
            project.pull(
                ignore_pull_failures=True,
                service_names=cls.COMPOSE_SERVICES)
    
        project.up(
            strategy=ConvergenceStrategy.always,
            service_names=cls.COMPOSE_SERVICES,
            timeout=30)
    
        # Wait for them to be healthy
        start = time.time()
        while True:
            containers = project.containers(
                service_names=cls.COMPOSE_SERVICES,
                stopped=True)
    
            healthy = True
            for container in containers:
                if not container.is_running:
                    print_logs(container)
                    raise Exception(
                        "Container %s unexpectedly finished on startup" %
                        container.name_without_project)
                if not is_healthy(container):
                    healthy = False
                    break
    
            if healthy:
                break
    
            if cls.COMPOSE_ADVERTISED_HOST:
                for service in cls.COMPOSE_SERVICES:
                    cls._setup_advertised_host(project, service)
    
            time.sleep(1)
            timeout = time.time() - start > cls.COMPOSE_TIMEOUT
            if timeout:
                for container in containers:
                    if not is_healthy(container):
                        print_logs(container)
>               raise Exception(
                    "Timeout while waiting for healthy "
                    "docker-compose services: %s" %
                    ','.join(cls.COMPOSE_SERVICES))
E               Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana

../../libbeat/tests/system/beat/compose.py:102: Exception

`Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_template – x-pack.metricbeat.tests.system.test_xpack_base.Test`

Expand to view the error details

 failed on setup with "Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana"

Expand to view the stacktrace

 self = <class 'test_xpack_base.Test'>

    @classmethod
    def setUpClass(self):
        self.beat_name = "metricbeat"
        self.beat_path = os.path.abspath(
            os.path.join(os.path.dirname(__file__), "../../"))
    
        self.template_paths = [
            os.path.abspath(os.path.join(self.beat_path, "../../metricbeat")),
            os.path.abspath(os.path.join(self.beat_path, "../../libbeat")),
        ]
    
>       super(XPackTest, self).setUpClass()

tests/system/xpack_metricbeat.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../metricbeat/tests/system/metricbeat.py:42: in setUpClass
    super().setUpClass()
../../libbeat/tests/system/beat/beat.py:199: in setUpClass
    cls.compose_up_with_retries()
../../libbeat/tests/system/beat/beat.py:217: in compose_up_with_retries
    raise ex
../../libbeat/tests/system/beat/beat.py:213: in compose_up_with_retries
    cls.compose_up()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'test_xpack_base.Test'>

    @classmethod
    def compose_up(cls):
        """
        Ensure *only* the services defined under `COMPOSE_SERVICES` are running and healthy
        """
        if not INTEGRATION_TESTS or not cls.COMPOSE_SERVICES:
            return
    
        if os.environ.get('NO_COMPOSE'):
            return
    
        def print_logs(container):
            print("---- " + container.name_without_project)
            print(container.logs())
            print("----")
    
        def is_healthy(container):
            return container.inspect()['State']['Health']['Status'] == 'healthy'
    
        project = cls.compose_project()
    
        with disabled_logger('compose.service'):
            project.pull(
                ignore_pull_failures=True,
                service_names=cls.COMPOSE_SERVICES)
    
        project.up(
            strategy=ConvergenceStrategy.always,
            service_names=cls.COMPOSE_SERVICES,
            timeout=30)
    
        # Wait for them to be healthy
        start = time.time()
        while True:
            containers = project.containers(
                service_names=cls.COMPOSE_SERVICES,
                stopped=True)
    
            healthy = True
            for container in containers:
                if not container.is_running:
                    print_logs(container)
                    raise Exception(
                        "Container %s unexpectedly finished on startup" %
                        container.name_without_project)
                if not is_healthy(container):
                    healthy = False
                    break
    
            if healthy:
                break
    
            if cls.COMPOSE_ADVERTISED_HOST:
                for service in cls.COMPOSE_SERVICES:
                    cls._setup_advertised_host(project, service)
    
            time.sleep(1)
            timeout = time.time() - start > cls.COMPOSE_TIMEOUT
            if timeout:
                for container in containers:
                    if not is_healthy(container):
                        print_logs(container)
>               raise Exception(
                    "Timeout while waiting for healthy "
                    "docker-compose services: %s" %
                    ','.join(cls.COMPOSE_SERVICES))
E               Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana

../../libbeat/tests/system/beat/compose.py:102: Exception

`Build&Test / x-pack/metricbeat-pythonIntegTest / test_index_management – x-pack.metricbeat.tests.system.test_xpack_base.Test`

Expand to view the error details

 failed on setup with "Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana"

Expand to view the stacktrace

 self = <class 'test_xpack_base.Test'>

    @classmethod
    def setUpClass(self):
        self.beat_name = "metricbeat"
        self.beat_path = os.path.abspath(
            os.path.join(os.path.dirname(__file__), "../../"))
    
        self.template_paths = [
            os.path.abspath(os.path.join(self.beat_path, "../../metricbeat")),
            os.path.abspath(os.path.join(self.beat_path, "../../libbeat")),
        ]
    
>       super(XPackTest, self).setUpClass()

tests/system/xpack_metricbeat.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../metricbeat/tests/system/metricbeat.py:42: in setUpClass
    super().setUpClass()
../../libbeat/tests/system/beat/beat.py:199: in setUpClass
    cls.compose_up_with_retries()
../../libbeat/tests/system/beat/beat.py:217: in compose_up_with_retries
    raise ex
../../libbeat/tests/system/beat/beat.py:213: in compose_up_with_retries
    cls.compose_up()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'test_xpack_base.Test'>

    @classmethod
    def compose_up(cls):
        """
        Ensure *only* the services defined under `COMPOSE_SERVICES` are running and healthy
        """
        if not INTEGRATION_TESTS or not cls.COMPOSE_SERVICES:
            return
    
        if os.environ.get('NO_COMPOSE'):
            return
    
        def print_logs(container):
            print("---- " + container.name_without_project)
            print(container.logs())
            print("----")
    
        def is_healthy(container):
            return container.inspect()['State']['Health']['Status'] == 'healthy'
    
        project = cls.compose_project()
    
        with disabled_logger('compose.service'):
            project.pull(
                ignore_pull_failures=True,
                service_names=cls.COMPOSE_SERVICES)
    
        project.up(
            strategy=ConvergenceStrategy.always,
            service_names=cls.COMPOSE_SERVICES,
            timeout=30)
    
        # Wait for them to be healthy
        start = time.time()
        while True:
            containers = project.containers(
                service_names=cls.COMPOSE_SERVICES,
                stopped=True)
    
            healthy = True
            for container in containers:
                if not container.is_running:
                    print_logs(container)
                    raise Exception(
                        "Container %s unexpectedly finished on startup" %
                        container.name_without_project)
                if not is_healthy(container):
                    healthy = False
                    break
    
            if healthy:
                break
    
            if cls.COMPOSE_ADVERTISED_HOST:
                for service in cls.COMPOSE_SERVICES:
                    cls._setup_advertised_host(project, service)
    
            time.sleep(1)
            timeout = time.time() - start > cls.COMPOSE_TIMEOUT
            if timeout:
                for container in containers:
                    if not is_healthy(container):
                        print_logs(container)
>               raise Exception(
                    "Timeout while waiting for healthy "
                    "docker-compose services: %s" %
                    ','.join(cls.COMPOSE_SERVICES))
E               Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana

../../libbeat/tests/system/beat/compose.py:102: Exception

`Build&Test / x-pack/metricbeat-pythonIntegTest / test_start_stop – x-pack.metricbeat.tests.system.test_xpack_base.Test`

Expand to view the error details

 failed on setup with "Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana"

Expand to view the stacktrace

 self = <class 'test_xpack_base.Test'>

    @classmethod
    def setUpClass(self):
        self.beat_name = "metricbeat"
        self.beat_path = os.path.abspath(
            os.path.join(os.path.dirname(__file__), "../../"))
    
        self.template_paths = [
            os.path.abspath(os.path.join(self.beat_path, "../../metricbeat")),
            os.path.abspath(os.path.join(self.beat_path, "../../libbeat")),
        ]
    
>       super(XPackTest, self).setUpClass()

tests/system/xpack_metricbeat.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../metricbeat/tests/system/metricbeat.py:42: in setUpClass
    super().setUpClass()
../../libbeat/tests/system/beat/beat.py:199: in setUpClass
    cls.compose_up_with_retries()
../../libbeat/tests/system/beat/beat.py:217: in compose_up_with_retries
    raise ex
../../libbeat/tests/system/beat/beat.py:213: in compose_up_with_retries
    cls.compose_up()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

cls = <class 'test_xpack_base.Test'>

    @classmethod
    def compose_up(cls):
        """
        Ensure *only* the services defined under `COMPOSE_SERVICES` are running and healthy
        """
        if not INTEGRATION_TESTS or not cls.COMPOSE_SERVICES:
            return
    
        if os.environ.get('NO_COMPOSE'):
            return
    
        def print_logs(container):
            print("---- " + container.name_without_project)
            print(container.logs())
            print("----")
    
        def is_healthy(container):
            return container.inspect()['State']['Health']['Status'] == 'healthy'
    
        project = cls.compose_project()
    
        with disabled_logger('compose.service'):
            project.pull(
                ignore_pull_failures=True,
                service_names=cls.COMPOSE_SERVICES)
    
        project.up(
            strategy=ConvergenceStrategy.always,
            service_names=cls.COMPOSE_SERVICES,
            timeout=30)
    
        # Wait for them to be healthy
        start = time.time()
        while True:
            containers = project.containers(
                service_names=cls.COMPOSE_SERVICES,
                stopped=True)
    
            healthy = True
            for container in containers:
                if not container.is_running:
                    print_logs(container)
                    raise Exception(
                        "Container %s unexpectedly finished on startup" %
                        container.name_without_project)
                if not is_healthy(container):
                    healthy = False
                    break
    
            if healthy:
                break
    
            if cls.COMPOSE_ADVERTISED_HOST:
                for service in cls.COMPOSE_SERVICES:
                    cls._setup_advertised_host(project, service)
    
            time.sleep(1)
            timeout = time.time() - start > cls.COMPOSE_TIMEOUT
            if timeout:
                for container in containers:
                    if not is_healthy(container):
                        print_logs(container)
>               raise Exception(
                    "Timeout while waiting for healthy "
                    "docker-compose services: %s" %
                    ','.join(cls.COMPOSE_SERVICES))
E               Exception: Timeout while waiting for healthy docker-compose services: elasticsearch,kibana

../../libbeat/tests/system/beat/compose.py:102: Exception

Steps errors

Expand to view the steps failures

Show only the first 10 steps failures

`x-pack/auditbeat-windows-2022-windows-2022 - Install Python`

Took 3 min 33 sec . View more details here
Description: .ci/scripts/install-tools.bat

`x-pack/filebeat-windows-2022-windows-2022 - Install Python`

Took 3 min 43 sec . View more details here
Description: .ci/scripts/install-tools.bat

`x-pack/filebeat-windows-2016-windows-2016 - Install Python`

Took 2 min 47 sec . View more details here
Description: .ci/scripts/install-tools.bat

`x-pack/functionbeat-windows-2016-windows-2016 - Install Python`

Took 2 min 33 sec . View more details here
Description: .ci/scripts/install-tools.bat

`x-pack/metricbeat-pythonIntegTest - mage pythonIntegTest`

Took 28 min 33 sec . View more details here
Description: mage pythonIntegTest

`x-pack/metricbeat-pythonIntegTest - mage pythonIntegTest`

Took 22 min 33 sec . View more details here
Description: mage pythonIntegTest

`x-pack/metricbeat-pythonIntegTest - mage pythonIntegTest`

Took 22 min 32 sec . View more details here
Description: mage pythonIntegTest

`x-pack/osquerybeat-windows-2016-windows-2016 - Install Python`

Took 1 min 57 sec . View more details here
Description: .ci/scripts/install-tools.bat

`x-pack/packetbeat-windows-2022-windows-2022 - Install Python`

Took 3 min 54 sec . View more details here
Description: .ci/scripts/install-tools.bat

`Error signal`

Took 0 min 0 sec . View more details here
Description: Error 'hudson.AbortException: script returned exit code 1'

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Genuine test errors

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

Name: Build&Test / x-pack/metricbeat-pythonIntegTest / test_dashboards – x-pack.metricbeat.tests.system.test_xpack_base.Test
Name: Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_config – x-pack.metricbeat.tests.system.test_xpack_base.Test
Name: Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_ilm_policy – x-pack.metricbeat.tests.system.test_xpack_base.Test
Name: Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_index_pattern – x-pack.metricbeat.tests.system.test_xpack_base.Test
Name: Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_index_pattern_migration – x-pack.metricbeat.tests.system.test_xpack_base.Test
Name: Build&Test / x-pack/metricbeat-pythonIntegTest / test_export_template – x-pack.metricbeat.tests.system.test_xpack_base.Test
Name: Build&Test / x-pack/metricbeat-pythonIntegTest / test_index_management – x-pack.metricbeat.tests.system.test_xpack_base.Test
Name: Build&Test / x-pack/metricbeat-pythonIntegTest / test_start_stop – x-pack.metricbeat.tests.system.test_xpack_base.Test

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.
/package : Generate the packages and run the E2E tests.
/beats-tester : Run the installation tests with beats-tester.
run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

kvch merged commit d40d321 into 8.2

mergify bot deleted the mergify/bp/8.2/pr-31048 branch

April 6, 2022 11:51

# for free to join this conversation on GitHub. Already have an account? # to comment

Labels

backport needs_team