Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TheHive 3.4.0 migration logs errors ([error] m.Migration - Failed to create dashboard) #1202

Closed
Trolldemorted opened this issue Jan 15, 2020 · 0 comments
Assignees
Labels
Milestone

Comments

@Trolldemorted
Copy link

Request Type

Bug

Work Environment

Question Answer
OS version (server) Mobi Linux
OS version (client) W10
TheHive version / git hash 3.4.0
Package Type Docker

Problem Description

TheHive logs the following error:

thehive_1        | [info] o.e.s.MigrationSrv - Migrate database from version 0, add operations for version 15
thehive_1        | [warn] o.e.c.RestClient - request [PUT http://172.20.0.2:9200/the_hive_15] returned 1 warnings: [299 Elasticsearch-6.8.0-65b6179 "[types removal] The parameter include_type_name should be explicitly specified in create index requests to prepare for 7.0. In 7.0 include_type_name will default to 'false', and requests are expected to omit the type name in mapping definitions."]      
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from sequence
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from action
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from alert
thehive_1        | migrateEntity(action) has finished : Success(())
thehive_1        | migrateEntity(sequence) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from audit
thehive_1        | migrateEntity(alert) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case
thehive_1        | migrateEntity(audit) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from caseTemplate
thehive_1        | migrateEntity(case) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case_artifact
thehive_1        | migrateEntity(caseTemplate) has finished : Success(())
thehive_1        | migrateEntity(case_artifact) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case_artifact_job
thehive_1        | migrateEntity(case_artifact_job) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case_task
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from case_task_log
thehive_1        | migrateEntity(case_task) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from dashboard
thehive_1        | migrateEntity(case_task_log) has finished : Success(())
thehive_1        | migrateEntity(dashboard) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from data
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from dblist
thehive_1        | migrateEntity(data) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from reportTemplate
thehive_1        | migrateEntity(dblist) has finished : Success(())
thehive_1        | [info] o.e.s.MigrationSrv - Migrating 0 entities from user
thehive_1        | migrateEntity(reportTemplate) has finished : Success(())
thehive_1        | migrateEntity(user) has finished : Success(())
thehive_1        | [info] m.Migration - Retrieve MISP attribute to update alerts
thehive_1        | [info] m.Migration - Updating observable data type list
thehive_1        | [info] o.e.s.MigrationSrv - End of migration
thehive_1        | [error] m.Migration - Failed to create dashboard /opt/thehive/migration/12/dashboards/Observable_statistics .json during migration
thehive_1        | org.elastic4play.AttributeCheckingError: [Unknown attribute dashboard._version: {"type":"JsonInputValue","value":3}][Unknown attribute dashboard._id: {"type":"JsonInputValue","value":"AWu4YZXHg8tFuebkSwcG"}][Unknown attribute dashboard._routing: {"type":"JsonInputValue","value":"AWu4YZXHg8tFuebkSwcG"}][Unknown attribute dashboard._parent: {"type":"JsonInputValue","value":null}]   
thehive_1        |      at org.elastic4play.services.FieldsSrv.$anonfun$parse$7(FieldsSrv.scala:33)
thehive_1        |      at org.scalactic.Bad.transform(Or.scala:1386)
thehive_1        |      at org.elastic4play.services.FieldsSrv.parse(FieldsSrv.scala:33)
thehive_1        |      at org.elastic4play.services.CreateSrv.create(CreateSrv.scala:105)
thehive_1        |      at org.elastic4play.services.CreateSrv.apply(CreateSrv.scala:67)
thehive_1        |      at services.DashboardSrv.create(DashboardSrv.scala:32)
thehive_1        |      at models.Migration.$anonfun$addDashboards$8(Migration.scala:107)
thehive_1        |      at scala.Option.map(Option.scala:146)
thehive_1        |      at models.Migration.$anonfun$addDashboards$6(Migration.scala:104)
thehive_1        |      at scala.collection.TraversableLike$WithFilter.$anonfun$flatMap$2(TraversableLike.scala:770)

Steps to Reproduce

  • Take this docker-compose.yaml:
version: "2"
services:
  elasticsearch:
    image: docker.elastic.co/elasticsearch/elasticsearch:6.8.0
    environment:
      - http.host=0.0.0.0
      - transport.host=0.0.0.0
      - xpack.security.enabled=false
      - cluster.name=hive
      - script.allowed_types=inline
      - thread_pool.index.queue_size=100000
      - thread_pool.search.queue_size=100000
      - thread_pool.bulk.queue_size=100000
    ulimits:
      nofile:
        soft: 65536
        hard: 65536
  thehive:
    image: thehiveproject/thehive:3.4.0
    ports:
      - "0.0.0.0:9000:9000"
  • Start migration:
    curl 'http://localhost:9000/api/maintenance/migrate' --data '{}' --fail
@To-om To-om self-assigned this Apr 6, 2020
@To-om To-om added the bug label Apr 6, 2020
@To-om To-om added this to the 3.4.1 milestone Apr 6, 2020
To-om added a commit that referenced this issue Apr 7, 2020
@To-om To-om closed this as completed Apr 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants