Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

TheHive 3.4.0 migration logs errors ([error] m.Migration - Failed to create dashboard) #1202

Closed
Trolldemorted opened this issue Jan 15, 2020 · 0 comments
Assignees
Labels
Milestone

Comments

@Trolldemorted
Copy link

Request Type

Bug

Work Environment

Question Answer
OS version (server) Mobi Linux
OS version (client) W10
TheHive version / git hash 3.4.0
Package Type Docker

Problem Description

TheHive logs the following error:

thehive_1        | [info] o.e.s.MigrationSrv - Migrate database from version 0, add operations for version 15
thehive_1        | [warn] o.e.c.RestClient - request [PUT http://172.20.0.2:9200/the_hive_15] returned 1 warnings: [299 Elasticsearch-6.8.0-65b6179 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]      
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from sequence
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from action
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from alert
thehive_1        | migrateEntity(action) has finished : Success(())
thehive_1        | migrateEntity(sequence) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from audit
thehive_1        | migrateEntity(alert) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case
thehive_1        | migrateEntity(audit) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from caseTemplate
thehive_1        | migrateEntity(case) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case_artifact
thehive_1        | migrateEntity(caseTemplate) has finished : Success(())
thehive_1        | migrateEntity(case_artifact) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case_artifact_job
thehive_1        | migrateEntity(case_artifact_job) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case_task
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case_task_log
thehive_1        | migrateEntity(case_task) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from dashboard
thehive_1        | migrateEntity(case_task_log) has finished : Success(())
thehive_1        | migrateEntity(dashboard) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from data
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from dblist
thehive_1        | migrateEntity(data) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from reportTemplate
thehive_1        | migrateEntity(dblist) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from user
thehive_1        | migrateEntity(reportTemplate) has finished : Success(())
thehive_1        | migrateEntity(user) has finished : Success(())
thehive_1        | [info] m.Migration - Retrieve MISP attribute to update alerts
thehive_1        | [info] m.Migration - Updating observable data type list
thehive_1        | [info] o.e.s.MigrationSrv - End of migration
thehive_1        | [error] m.Migration - Failed to create dashboard /opt/thehive/migration/12/dashboards/Observable_statistics .json during migration
thehive_1        | org.elastic4play.AttributeCheckingError: [Unknown attribute dashboard._version: {"type":"JsonInputValue","value":3}][Unknown attribute dashboard._id: {"type":"JsonInputValue","value":"AWu4YZXHg8tFuebkSwcG"}][Unknown attribute dashboard._routing: {"type":"JsonInputValue","value":"AWu4YZXHg8tFuebkSwcG"}][Unknown attribute dashboard._parent: {"type":"JsonInputValue","value":null}]   
thehive_1        |      at org.elastic4play.services.FieldsSrv.$anonfun$parse$7(FieldsSrv.scala:33)
thehive_1        |      at org.scalactic.Bad.transform(Or.scala:1386)
thehive_1        |      at org.elastic4play.services.FieldsSrv.parse(FieldsSrv.scala:33)
thehive_1        |      at org.elastic4play.services.CreateSrv.create(CreateSrv.scala:105)
thehive_1        |      at org.elastic4play.services.CreateSrv.apply(CreateSrv.scala:67)
thehive_1        |      at services.DashboardSrv.create(DashboardSrv.scala:32)
thehive_1        |      at models.Migration.$anonfun$addDashboards$8(Migration.scala:107)
thehive_1        |      at scala.Option.map(Option.scala:146)
thehive_1        |      at models.Migration.$anonfun$addDashboards$6(Migration.scala:104)
thehive_1        |      at scala.collection.TraversableLike$WithFilter.$anonfun$flatMap$2(TraversableLike.scala:770)

Steps to Reproduce

  • Take this docker-compose.yaml:
version: "2"
services:
  elasticsearch:
    image: docker.elastic.co/elasticsearch/elasticsearch:6.8.0
    environment:
      - http.host=0.0.0.0
      - transport.host=0.0.0.0
      - xpack.security.enabled=false
      - cluster.name=hive
      - script.allowed_types=inline
      - thread_pool.index.queue_size=100000
      - thread_pool.search.queue_size=100000
      - thread_pool.bulk.queue_size=100000
    ulimits:
      nofile:
        soft: 65536
        hard: 65536
  thehive:
    image: thehiveproject/thehive:3.4.0
    ports:
      - "0.0.0.0:9000:9000"
  • Start migration:
    curl 'http://localhost:9000/api/maintenance/migrate' --data '{}' --fail
@To-om To-om self-assigned this Apr 6, 2020
@To-om To-om added the bug label Apr 6, 2020
@To-om To-om added this to the 3.4.1 milestone Apr 6, 2020
To-om added a commit that referenced this issue Apr 7, 2020
@To-om To-om closed this as completed Apr 7, 2020
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants