robot testing of games about expfactory-games HOT 5 OPEN

To start, I'll just validate the config.json files for the continuous integration.

from expfactory-games.

this would definitely be a great feature - would be really excellent for
our screener as well and i'd love to hear more about your robot

On Fri, Apr 15, 2016 at 10:59 AM, Vanessa Sochat [email protected]
wrote:

To start, I'll just validate the config.json files for the continuous
integration.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
#6 (comment)

from expfactory-games.

If you cd into an experiment folder, you can just type

  expfactory --test

and the robot will run through it, and you can watch. It's the same robot that runs on circle, for example, if you poke around circle:

https://circleci.com/gh/expfactory/expfactory-experiments

The continuous integration typically has a few tests. First to validate the config.json files, again can be done on command line in a folder with:

  expfactory --validate

then to check that the circle.yml includes all experiments/surveys etc that should be tested, and then it clones the current master, compares to the PR being done, and tests the experiments that were changed using selenium. It's pretty cool, definitely useful to find errors you don't anticipate.

from expfactory-games.

This should be a fairly straightforward port from what you have written for jspsych since I think the only difference will be taking a click from each sprite rather than from the jspsych object, right?

from expfactory-games.

Right - if you just tell me the object in the console to look at to get the current state (and calculate what to click / do next) I can probably get a robot up and running for it!

from expfactory-games.