-
Notifications
You must be signed in to change notification settings - Fork 145
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix AttributeError: 'int' object has no attribute 'item' (#1995)
* Fixes an issue where an `int` is being returned in the DFP rolling window stage, likely caused by the recent update to the version of pandas being used. * Update file paths to reflect the move of the `dfp_duo_pipeline.py`, `dfp_azure_pipeline.py` & `dfp_integrated_training_batch_pipeline.py` scripts * Document installing the missing dependencies needed for the DFP Grafana example Closes #1994 ## By Submitting this PR I confirm: - I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md). - When the PR is ready for review, new or existing tests cover these changes. - When the PR is ready for review, the documentation is up to date with these changes. Authors: - David Gardner (https://github.com/dagardner-nv) Approvers: - Michael Demoret (https://github.com/mdemoret-nv) - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah) URL: #1995
- Loading branch information
1 parent
036d0b4
commit 4d84238
Showing
25 changed files
with
542 additions
and
523 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
39 changes: 19 additions & 20 deletions
39
.../digital_fingerprinting/production/morpheus/control_messages/azure_payload_inference.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,25 +1,24 @@ | ||
| { | ||
| "inputs": [ | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../../data/dfp/azure-inference-data/*.json" | ||
| ] | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../data/dfp/azure-inference-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "inference", | ||
| "properties": {} | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| }, | ||
| { | ||
| "type": "inference", | ||
| "properties": { | ||
| } | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| } | ||
| ] | ||
| } | ||
| } |
78 changes: 38 additions & 40 deletions
78
...ngerprinting/production/morpheus/control_messages/azure_payload_load_train_inference.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,46 +1,44 @@ | ||
| { | ||
| "inputs": [ | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../../data/dfp/azure-training-data/*.json" | ||
| ] | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../data/dfp/azure-training-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "training", | ||
| "properties": {} | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| }, | ||
| { | ||
| "type": "training", | ||
| "properties": { | ||
| }, | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../data/dfp/azure-inference-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "inference", | ||
| "properties": {} | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| }, | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../../data/dfp/azure-inference-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "inference", | ||
| "properties": { | ||
| } | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| } | ||
| ] | ||
| } | ||
| } |
39 changes: 19 additions & 20 deletions
39
...ital_fingerprinting/production/morpheus/control_messages/azure_payload_load_training.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,25 +1,24 @@ | ||
| { | ||
| "inputs": [ | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../../data/dfp/azure-training-data/*.json" | ||
| ] | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../data/dfp/azure-training-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "training", | ||
| "properties": {} | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| }, | ||
| { | ||
| "type": "training", | ||
| "properties": { | ||
| } | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| } | ||
| ] | ||
| } | ||
| } |
110 changes: 59 additions & 51 deletions
110
examples/digital_fingerprinting/production/morpheus/control_messages/azure_payload_lti.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,58 +1,66 @@ | ||
| { | ||
| "inputs": [ | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../../data/dfp/azure-training-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "training", | ||
| "properties": { | ||
| } | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload", | ||
| "batching_options": {"period": "M", "start_time": "2022-08-01", "end_time": "2022-08-31"}, | ||
| "file_to_df_options":{ | ||
| "parser_kwargs": { | ||
| "lines": false, "orient": "records" | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../data/dfp/azure-training-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "training", | ||
| "properties": {} | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload", | ||
| "batching_options": { | ||
| "period": "M", | ||
| "start_time": "2022-08-01", | ||
| "end_time": "2022-08-31" | ||
| }, | ||
| "file_to_df_options": { | ||
| "parser_kwargs": { | ||
| "lines": false, | ||
| "orient": "records" | ||
| } | ||
| } | ||
| } | ||
| } | ||
| }, | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../../data/dfp/azure-inference-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "inference", | ||
| "properties": { | ||
| } | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload", | ||
| "batching_options": {"period": "D", "start_time": "2022-08-01", "end_time": "2022-08-31"}, | ||
| "file_to_df_options":{ | ||
| "parser_kwargs": { | ||
| "lines": false, "orient": "records" | ||
| }, | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../data/dfp/azure-inference-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "inference", | ||
| "properties": {} | ||
| } | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload", | ||
| "batching_options": { | ||
| "period": "D", | ||
| "start_time": "2022-08-01", | ||
| "end_time": "2022-08-31" | ||
| }, | ||
| "file_to_df_options": { | ||
| "parser_kwargs": { | ||
| "lines": false, | ||
| "orient": "records" | ||
| } | ||
| } | ||
| } | ||
| } | ||
| } | ||
| ] | ||
| } | ||
| } |
39 changes: 19 additions & 20 deletions
39
...s/digital_fingerprinting/production/morpheus/control_messages/azure_payload_training.json
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,25 +1,24 @@ | ||
| { | ||
| "inputs": [ | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../../data/dfp/azure-training-data/*.json" | ||
| ] | ||
| { | ||
| "tasks": [ | ||
| { | ||
| "type": "load", | ||
| "properties": { | ||
| "loader_id": "fsspec", | ||
| "files": [ | ||
| "../../data/dfp/azure-training-data/*.json" | ||
| ] | ||
| } | ||
| }, | ||
| { | ||
| "type": "training", | ||
| "properties": {} | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| }, | ||
| { | ||
| "type": "training", | ||
| "properties": { | ||
| } | ||
| } | ||
| ], | ||
| "metadata": { | ||
| "data_type": "payload" | ||
| } | ||
| } | ||
| ] | ||
| } | ||
| } |
Oops, something went wrong.