brunohjs / rasa-model-report Goto Github PK

Is there an existing idea for this?
Please search 🔍 the ideas to check if this idea has already been reported.

• I have searched the existing ideas.

Is your feature request related to a problem? Please describe.
Create a response file validator to check little errors that the Rasa don't see, like a extra " or } in a button payload:

• /my_intent{""my_entity": "my_value"}
• /my_intent{"my_entity": "my_value"}}

Also, it could check case in intents or entities in a button payload:

• /My_intent
• /my_Intent

And other checks.

Is there an existing issue for this?
Please search 🔍 the issues to check if this bug has already been reported.

• I have searched the existing issues.

Actual behavior
The overall score is 0.

Expected behavior
The overall score must be 10.

Screenshots

Environment
Please provide the following information about your environment.

• Operational System (with version): Ubuntu 20.22
• Python version: 3.10.8
• rasa-model-report version: 1.4.1

Is there an existing issue for this?
Please search 🔍 the issues to check if this bug has already been reported.

• I have searched the existing issues.

Actual behavior
Entity and overall score are with precision when they have 10 score.

Expected behavior
When a score is 10, it can't have precision.

Screenshots

Environment
Please provide the following information about your environment.

• Operational System (with version): Ubuntu 20.04
• Python version: 3.10.8
• rasa-model-report version: 1.4.2b13

Error when NLU controller analyze empty NLU file

Is there an existing issue for this?
Please search 🔍 the issues to check if this bug has already been reported.

• I have searched the existing issues.

Expected behavior
If I have an utter in action covered by an end-to-end test, the utter can't be on the not-covered list on the model report.

Actual behavior
The utter is in the not-covered list on the model report, but the action is covered.

Screenshots

Environment
Please provide the following information about your environment.

• Operational System (with version): Ubuntu 22.04
• Python version: 3.10.8
• rasa-model-report version: 1.3.3

Is there an existing idea for this?
Please search 🔍 the ideas to check if this idea has already been reported.

• I have searched the existing ideas.

Is your feature request related to a problem? Please describe.
I have to count each intent, intent example etc to know the size of my chatbot.

Describe the solution you'd like (optional)
Have a total counter for intents, stories, intent examples, stories usages, etc. Have this at the end of each table would be a good solution for me.

Describe alternatives you've considered (optional)
I don't have.

Futher Information (optional)
I don't have.

This parameter is necessary because, in projects, actions folder can be in a different folder. For example, out of Rasa project folder:

 Project folder
 |
 |- actions/
 |- rasa_project/

Is there an existing issue for this?
Please search 🔍 the issues to check if this bug has already been reported.

• I have searched the existing issues.

Actual behavior
Counting elements is incorrect. The numbers in Element count and E2E Coverage sections aren't correct.

Expected behavior
It was expected the total number of elements. Include the excluded elements.

Screenshots

Environment
Please provide the following information about your environment.

• Operational System (with version): Ubuntu 22.04
• Python version: 3.10.8
• rasa-model-report version: 1.4.1

When the intent sentence is retrieval type, it will not correct in report.

This optional parameter will be displayed in the report summary if it is filled.

Is there an existing issue for this?
Please search 🔍 the issues to check if this bug has already been reported.

• I have searched the existing issues.

Expected behavior
Entities covered when there is E2E test with it.

Actual behaviour
Many entities aren't covered in E2E coverage report (image 1) even when there is E2E test (image 2).

Screenshots
Image 1:

Image 2:

Environment
Please provide the following information about your environment.

• Operational System (with version): Ubuntu 20.04.1 LTS
• Python version: 3.10
• rasa-model-report version: 1.3.3

At the moment, rasa-model-report supports python v3.10 or higher.

Is there an existing issue for this?
Please search 🔍 the issues to check if this bug has already been reported.

• I have searched the existing issues.

Actual behavior
Counting elements is incorrect. The numbers in Element count and E2E Coverage sections aren't correct.

Expected behavior
It was expected the total number of elements. Include the excluded elements.

Screenshots

Environment
Please provide the following information about your environment.

• Operational System (with version): Ubuntu 22.04
• Python version: 3.10.8
• rasa-model-report version: 1.4.0

Is there an existing idea for this?
Please search 🔍 the ideas to check if this idea has already been reported.

• I have searched the existing ideas.

Is your feature request related to a problem? Please describe.
I have a project that has utters in actions imported from external modules. These utters aren't covered by E2E test coverage, even though there is E2E test for these actions.

Describe the solution you'd like (optional)
Create a parameter named --exclude that accepts a list of utters and actions to exclude from E2E test coverage.