Create regression testing infrastructure about biothings_explorer HOT 3 CLOSED

@andrewsu I'm copying this from Slack over to here too:

Brief summary: we now have a workflow bte_regression_test.yml that is configured to run every Saturday as well as on demand. (There's also an abbreviated version of this same workflow: bte_regression_test_quick_demo.yml).

It pulls the latest BTE TRAPI Docker image to create a local instance of the API and then runs every query template in src/query_templates against that API. It currently saves the resulting full_results.csv file as a GH Action artifact, but the future plan is to create a static page showing summary stats over time as well as a Jupyter notebook for interactively exploring the results, potentially hosted via colab or mybinder.
Another future improvement: use batch queries to speed up the tests. Right now, it takes 1 hour to run the six query templates for the first two lines of the OOPD file and the better part of a day to run the entire test.

If you want to see some completed workflow runs, you can take a look at my fork:
https://github.com/ariutta/bte_regression_test/actions
You'll notice the full test timed out, but the quick demo did finish, so you can see the result saved as an artifact.

from biothings_explorer.

Still plenty left to be done, but just remembered that @kevinxin90 did some initial analysis of the OOPD dataset in https://github.com/biothings/bte_regression_test, and we also created some issues there. Would be good to build on that...

from biothings_explorer.

I'll close this issue in favor of the new issue created in the bte_regression_test repo:
biothings/bte_regression_test#9

from biothings_explorer.