Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Story structure analysis #4088

Closed
4 of 5 tasks
JEM-Mosig opened this issue Jul 23, 2019 · 1 comment · Fixed by #4968
Closed
4 of 5 tasks

Story structure analysis #4088

JEM-Mosig opened this issue Jul 23, 2019 · 1 comment · Fixed by #4968
Assignees
Labels
area:rasa-oss 🎡 Anything related to the open source Rasa framework area:rasa-x/backend 🎩 All issues focused on the Rasa X backend type:enhancement ✨ Additions of new features or changes to existing ones, should be doable in a single PR

Comments

@JEM-Mosig
Copy link
Contributor

JEM-Mosig commented Jul 23, 2019

Description of Problem:
Stories might be inconsistent with one another. E.g. when story 1 is A > B > C, and story 2 is A > B > X, and C and X are bot actions, then rasa core would now know what to learn. Presently, it is hard to identify such history branches in large story files.

Overview of the Solution:
I wrote the story_tree.py script that solves this problem: https://github.com/RasaHQ/research/blob/master/report_multiWOZ/multiwoz/scripts/story_tree.py (private repo). This issue is about integrating it into rasa, so it can be called to check for inconsistencies with rasa test core, and perhaps also be called for statistics / deleting duplicate stories / exploring the story tree.

Examples (if relevant):

These stories are inconsistent:

## Story 1
* greet
  - utter_greet
* mood_unhappy
  - utter_cheer_up
  - utter_did_that_help
* affirm
  - utter_happy

## Story 2
* greet
  - utter_greet
* mood_unhappy
  - utter_cheer_up
* affirm
  - utter_happy

## Story 3
* greet
  - utter_greet
* mood_happy
  - utter_happy

Blockers (if relevant):

Definition of Done:

  • UX is decided (how would users call this function?)
  • Original story-tree functionality can be leveraged with Rasa
  • Tests are added
  • Feature is documented
  • Blog post is published (?)
@JEM-Mosig JEM-Mosig added the type:enhancement ✨ Additions of new features or changes to existing ones, should be doable in a single PR label Jul 23, 2019
@JEM-Mosig JEM-Mosig self-assigned this Jul 23, 2019
@JEM-Mosig JEM-Mosig added area:rasa-oss 🎡 Anything related to the open source Rasa framework area:rasa-x/backend 🎩 All issues focused on the Rasa X backend labels Jul 23, 2019
@JEM-Mosig
Copy link
Contributor Author

Created a Colab notebook, testing out the solution: https://colab.research.google.com/drive/1We1EcSp_uA31OooC78sReryhMCkOjEKM

@JEM-Mosig JEM-Mosig changed the title Story tree analysis Story structure analysis Dec 13, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:rasa-oss 🎡 Anything related to the open source Rasa framework area:rasa-x/backend 🎩 All issues focused on the Rasa X backend type:enhancement ✨ Additions of new features or changes to existing ones, should be doable in a single PR
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant