-
Notifications
You must be signed in to change notification settings - Fork 611
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]- Migration from Hive 3.4.4 to Hive 4.1.17 not working #2331
Comments
The migration tool found an index with multiple types whereas the index uses a single type. The detection doesn't work correctly (it need a fix). You can force by adding the parameter |
Hello @To-om I have tested it by adding --es-single-type true in the migration script.
This issue is only for this specific customField userGroup. Not sure, what could be the problem. Besides, once migration was over, I saw that we got 5 ORGANIZATIONS created [2 for admin and 3 for the one which we used as MAIN organization] instead of 2 . Even after re-indexing status is same. |
Hello @To-om , After looking into the logs, I realised error initially while creating customFields in the migration script. ``[error] I see that CustField is truncated at 7691 characters. I tried to change the data of the CF in Hive 3 to see if it makes any difference, but everytime it fails at same character position 7691 |
Single type detection and custom field truncation problems are fixed in 4.1.18 |
Request Type
Bug
Work Environment
Problem Description
Describe the problem/bug as clearly as possible.
Steps to Reproduce
Install The Hive 4-4.1.17 version on RHEL machine. Configure database as cassandra, index as lucene and file system is local.
Start The Hive service.All goes well
Now, launch migration to target server with ES 6.8.21 and Hive version 3.4.4. Migration starts but it detects nothing to change and finishes with no change.
`[root@azucl20007 thehive]# /opt/thehive/bin/migrate --main-organisation StSOC --es-uri http://10.28.100.37:9200 --es-index the_hive --exclude-alert-types misp -o /etc/thehive/application.conf
[info] 1,666,167/1,769,472KiB(95%) GC:8 (cpu:5% 169ms)
[initialisation]
[info] Found ElasticSearch 6.8.21
[info] Found Index the_hive_15
[info] Found index with multiple types
[info] Initialising cluster
[info] Member is Up: akka://TheHiveMigration@127.0.0.1:35141
[info] 1,430,538/1,769,472KiB(81%) GC:9 (cpu:3% 373ms)
[initialisation]
[info] Full-text index is available (lucene:/opt/thp/thehive/index) single node
[info] Creating database schema
[info] The field data is indexed
[info] 1,458,874/1,769,472KiB(83%) GC:1 (cpu:0% 22ms)
[Finalisation] Organisation:1/1(240,525µs)
[info] Running check on Tag ...
[info] Check on Tag: no change needed
[info] Running check on Log ...
[info] Check on Log: no change needed
[info] Running check on Alert ...
[info] Check on Alert: no change needed
[info] Running check on Organisation ...
[info] Found duplicate entities:
[info] Check on Organisation: duplicate:1
[info] Running check on Data ...
[info] Check on Data: no change needed
[info] Running check on CaseTemplate ...
[info] Check on CaseTemplate: no change needed
[info] Running check on Profile ...
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Check on Profile: duplicate:4
[info] Running check on Case ...
[info] Check on Case: no change needed
[info] Running check on ImpactStatus ...
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Check on ImpactStatus: duplicate:3
[info] Running check on ResolutionStatus ...
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Check on ResolutionStatus: duplicate:5
[info] Running check on User ...
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Check on User: no change needed
[info] Running check on Task ...
[info] Check on Task: no change needed
[info] Running check on CustomField ...
[info] Check on CustomField: no change needed
[info] Running check on ObservableType ...
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Found duplicate entities:
[info] Check on ObservableType: duplicate:16
[info] Running check on Observable ...
[info] Check on Observable: no change needed
[info] Migration finished
[info] Member is Removed: akka://TheHiveMigration@127.0.0.1:35141 after Exiting
`
Migration ends with no change.
Install The Hive 4-4.0.4 version and attempt migration. This time it works perfectly.
The text was updated successfully, but these errors were encountered: