• oTree Virtual Machine Manager version: latest
• Python version: 3.5 / 3.6
• Operating System: oTree Virtual Machine image, but also fresh osboxes.org Ubuntu image

Description

I wanted to add, and then delete a user. Adding works. When I try to delete a user, there are some errors, and the user does not get removed from the PG table and from the system. The file user_config/davidjk.txt is deleted after running the command, however, subsequent runs of the delete_user command still fail with reference to the pkill exit code.

Thanks for the great work on ovmm, it is really very helpful.

What I Did

sudo ovmm delete_user

------------------- Process: Delete User -------------------
Do you want to see a list of users? [Y/n]: n
Which user do you want to delete? [louis]: davidjk
Do you want a database backup? [Y/n]: n
ERROR: User could not be deleted.
Command line: ['/usr/bin/sudo', 'pkill', '-u', 'davidjk']
Exit code: 0
SUCCESS: nginx configuration works.
SUCCESS: nginx configuration works.
SUCCESS: Removed user from nginx configuration.
SUCCESS: smb.conf works.
SUCCESS: Created backup of smb.conf.
SUCCESS: Removed user from smb.conf.
ERROR: User configuration text file could not be deleted.
Command line: ['/usr/bin/sudo', 'rm', '/home/otreeadmin/ovmm_sources/user_configs/davidjk.txt']
Exit code: 0
ERROR: An exception was raised during the deletion process.
Please, fix the problem manually. After that, run the command
again, so that the user will also be deleted from database.

WARNING: The deletion process is completed. If an error
occurred, check it manually.

----------------------- Process: End -----------------------

Instead of writing a replacement handler for each new file could we iterate over the statics folder structure and replace ALL standardized the replacements?

• oTree Ubuntu Server Manager version: 0.1.0
• Python version: 3.6
• Operating System: Ubuntu

Description

A much more sophisticate approach regarding commands would be to build class BaseCommand which could look like this:

# commands/base.py
"""The base command"""

class BaseCommand(object):
    """A base command."""
 
    def __init__(self, options, *args, **kwargs):
        self.options = options
        self.args = args
        self.kwargs = kwargs

   def requirements_check():
        pass
 
    def run(self):
        raise NotImplementedError('You must implement the run() method yourself!')

Additional ressources:

• https://stormpath.com/blog/building-simple-cli-interfaces-in-python
• https://github.com/django/django/tree/master/django/core/management
• https://docs.djangoproject.com/en/1.10/howto/custom-management-commands/

• oTree Virtual Machine Manager version: 0.1.0

Description

Up to now, there are now tests available for ovmm\handlers\postgres.py.

Links:

• https://github.com/tk0miya/testing.postgresql
• http://faitout.fedorainfracloud.org/
• https://gist.github.com/inklesspen/4504383

• oTree Virtual Machine Manager version: 0.2.2
• Python version: 3.5
• Operating System: Ubuntu 16.04.2

Description

• add step to add user to "sudo" group to allow for installation of software

For highly trusted users.
Default: "No"

ovmmadmin@otreehost:~/otree_virtual_machine_manager$ sudo ovmm add_user
ERROR: Not all environment variables are specified.
Program does not work! Have you run ovmm initialise?

Description

Add option to add an existing user (useful for extending admin accounts).

• no add user, no samba
• yes to statics, venv,

• need to replace database name for pg_dump to backup DB

I learned that sentry is a django based open source project and can be installed locally.
I will look into it and we will add it to the installation instructions and add the necessary stuff to the otree_environ_config.

Todo

• pip install -U sentry on initialise (optional)
• write sentry link to otree_environ_config for each user
• on otree_startproject ask if local sentry should be activated (static)
  • run sed on settings.py, add SENTRY_DSN = environ.get('SENTRY_DSN')

Realized that we do not open the ports 80 and 443 by default.

Should happen on ovvm initialise
commands:
sudo ufw allow "Nginx Full"
sudo service ufw restart

• oTree Virtual Machine Manager version: 0.2.2
• Python version: 3.5
• Operating System: Ubuntu 16.04.2

Description

• make database dump
• get otree version / django version / base linux system
• compress including project folder using 7zip
• kill running otree instance *optional

• oTree Ubuntu Server Manager version: 0.1.0
• Python version: 3.6
• Operating System: Ubuntu

Description

Adding a new user account should also implement the shortcut run_prodserver.

What I Did

When logging in as a new user, changing the folder to <user>/oTree/, running run_prodserver produces the error Cannot open your terminal '/dev/pts/17' - please check. Running script /dev/null resolves the error of running screen, but now run_prodserver, the shortcut, is gone.

Additional resources:

• https://www.google.de/search?q=cannot+open+your+terminal+%27%2Fdev%2Fpts%2F17%27+-+please+check&rlz=1C1CHBF_deDE710DE710&oq=cannot+open+&aqs=chrome.1.69i57j69i59j0l4.4509j0j7&sourceid=chrome&ie=UTF-8

https://pyup.io/docs/configuration/

We need to move the 'original' preconfigured nginx_conf.py to, e.g., nginx_conf_example.py.

Admins then need to create an nginx_conf.py with their specific data. Otherwise nginx_conf.py get replaced every time the git is pulled or the pull fails because of local changes in the nginx_conf.py.

If the PostgreSQL superuser exists, set password? [Y/n]:
--> The content folder will be created under /home/ovmmadmin/ovmm_sources
Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/ovmm-0.2.2-py3.5.egg/ovmm/commands/initialise.py", line 107, in initialise
os.mkdir(os.path.join(HOME, OSF))
FileExistsError: [Errno 17] File exists: '/home/ovmmadmin/ovmm_sources'

During handling of the above exception, another exception occurred:

I used the old-old-old implementation as the module failed on me.
But it appears to me that this is a ufw rather than a python issue.

Trying to connect to the database and user table
The connection to the PostgreSQL database was successful!
Number of user accounts: 2
Limit of additional accounts: 97
The nginx configuration is fine.
The user was successfully added to nginx configuration.
The nginx configuration is fine.
Traceback (most recent call last):
  File "admin_scripts/add_user.py", line 148, in <module>
    add_user()
  File "admin_scripts/add_user.py", line 105, in add_user
    sudo[ufw['allow', dict_user['http_port']]]()
  File "/usr/local/lib/python3.5/dist-packages/plumbum/commands/base.py", line 96, in __call__
    return self.run(args, **kwargs)[1]
  File "/usr/local/lib/python3.5/dist-packages/plumbum/commands/base.py", line 226, in run
    return p.run()
  File "/usr/local/lib/python3.5/dist-packages/plumbum/commands/base.py", line 188, in runner
    return run_proc(p, retcode, timeout)
  File "/usr/local/lib/python3.5/dist-packages/plumbum/commands/processes.py", line 206, in run_proc
    return _check_process(proc, retcode, timeout, stdout, stderr)
  File "/usr/local/lib/python3.5/dist-packages/plumbum/commands/processes.py", line 23, in _check_process
    proc.verify(retcode, timeout, stdout, stderr)
  File "/usr/local/lib/python3.5/dist-packages/plumbum/machines/base.py", line 22, in verify
    stdout, stderr)
plumbum.commands.processes.ProcessExecutionError: Command line: ['/usr/bin/sudo', '/usr/sbin/ufw', 'allow', '7902']
Exit code: 1
Stderr:  | ERROR: problem running
otree@sms:~/otree-ubuserver-config$ 

• change broad range killall otree to user specific clean process termination

kill $(ps -axo user:20,pid,command | grep $USER | grep 'otree' | grep 'python' | awk '{if (NR==1) print $(2)}')

• oTree Virtual Machine Manager version:
• Python version:
• Operating System:

Description

Rerunning initialise deletes the current nginx config.

Here is the traceback:

otree@sms:~$ ovmm list_user
Traceback (most recent call last):
  File "/usr/local/bin/ovmm", line 11, in <module>
    load_entry_point('ovmm==0.1.0', 'console_scripts', 'ovmm')()
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 1066, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python2.7/dist-packages/click-6.7-py2.7.egg/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/ovmm-0.1.0-py2.7.egg/ovmm/cli.py", line 64, in list_user
    from .commands.list_user import list_user as list_usr
  File "/usr/local/lib/python2.7/dist-packages/ovmm-0.1.0-py2.7.egg/ovmm/commands/__init__.py", line 18, in <module>
    raise e
AttributeError: 'module' object has no attribute 'util'

• oTree Ubuntu Server Manager version: 0.1.0
• Python version: 3.6
• Operating System: Ubuntu

Description

Up to now, plumbum commands are used in different flavors. But since sudo is used for almost all commands, one could also call all other commands with sudo instead of importing them explicitly.

E.g.:

from plumbum.cmd import sudo
from plumbum.cmd import useradd

sudo[useradd[]]()

or

from plumbum.cmd import sudo

sudo['useradd', ...]()

Check oTree instance for last worker action and send notification mail to user after long (48h) inactivity to close oTree.

• create local cronjob on user_add ~ 1.00am
• check if otree is active
  kill $(ps -axo user:20,pid,command | grep $USER | grep 'otree' | grep 'python' | awk '{if (NR==1) print $(2)}')
• query database for last user every 24h
• if last user activity > 48h, send reminder to experimenter to kill otree

Needs one script and one crontab entry.

User-specific cronjob:
https://askubuntu.com/questions/2368/how-do-i-set-up-a-cron-job#2369

https://stackoverflow.com/questions/1523427/what-is-the-common-header-format-of-python-files

Need a way to upgrade user statics without overwriting everything.
Probably relates to issue "different handling of statics".

• upgrade command for admin

Description

https://github.com/kennethreitz/setup.py

http://keepachangelog.com/en/0.3.0/

Description

Currently, we are using Plumbum which offers a way to execute shell commands in a python script but it is not very pythonic.

Sultan is more pythonic, the syntax is cleaner and offers context managers.

There is no current need for it, but we should consider this when we want to improve the program.

User name [louis_alexander]:
/usr/local/lib/python3.5/dist-packages/click/core.py:880: Warning: Invoked legacy parameter callback "<function validate_user_name at 0x7fc06dac9d08>". The new signature for such callbacks starting with click 2.0 is (ctx, param, value).
value, args = param.handle_parse_result(ctx, opts, args)
Traceback (most recent call last):

• oTree Virtual Machine Manager version: 0.2.1
• Python version: 3.6
• Operating System: Ubuntu 16.04.2

Description

Add command to create personal certificate quickly.

Standard snakeoil already implemented, but with distribution online, private key is freely on the web.

Description

Up to now, there is no documentation online on readthedocs.org.

Relocate Nginx file to ovmm/sources.

Egon ran into the issue that a resetdb did NOT completely remove all existing tables.
After Egon renamed some fields otree kept throwing errors because it kept referencing old non-existent fields that didn't exist anymore.
Only a database removal and reinstallation of Egon DB solved the issue.

Suggestion, single user command to executes the following.
In the DB:
DROP SCHEMA public CASCADE; # removes all tables within the DB
CREATE SCHEMA public; # creates a schema that be filled by otree

Before executing a clear warning msg should show up. (in red)

• oTree Ubuntu Server Manager version: 0.1.0
• Python version: 3.6
• Operating System: Ubuntu

Description

A much more sophisticate approach regarding prompts would be to build class BasePrompt which could look like this:

# prompts/base.py
"""The base prompt"""

class BasePrompt():
   """A base prompt."""

    def __init__(self, prompt_string):
        self.prompt_string = prompt_string
        self.input = None

   def input_validation(self):
       # check with regular expression, type conversion, escaping of command sequences
 
    def run(self):
        raise NotImplementedError('You must implement the run() method yourself!')

Up to know, I dropped the input validation and provided examples of inputs, so that users hopefully stick to them. But in the long run users will try everything and you do not want to have a user called "John ; DROP TABLE;".

Remarks

• usernames should not include hyphens because of postgres

Additional ressources:

• http://stackoverflow.com/questions/23294658/asking-the-user-for-input-until-they-give-a-valid-response
• http://www.tldp.org/LDP/LG/issue83/evans.html
• http://stackoverflow.com/questions/42078103/how-to-use-click-prompt-to-get-a-valid-date-from-the-user - use value_proc argument

Where do you want the enduser scripts?

This would also solve the run_prodserver issue. We will replace the command alias with a script handling the resetdb and database backup, too.

• oTree Virtual Machine Manager version: DON’T KNOW — Maybe add command “ovmm version”? (addressed in #102 )

oTree Virtual Machine Image:

• Set video RAM to at least 16 MByte to support higher resolutions. (Automatic resizing of the VM window worked when I set the VRAM to 32 MB.)
• 2 CPU cores by default.
• Conky positioning should be adjusted on-the-fly when the resolution/windows size is changed.
• Font in Conky should be monospaced. Decimal period instead of comma.
• Add “construction site” emblem to the “Projects” folder.
• Relabel the buttons in the “collectstatic” message.
  • Change text.
• Include an “empty app” to be shown on the oTree demo page.
• Conky: use monospaced font; replace decimal comma by period; make position depend on CURRENT screen resolution.
  • not feasible.
• Window regarding creation of a virtual environment: Add explanation that this would enable installation of several oTree versions in parallel, one per project.
• “Link Experiment” script: Change text so that “project folder” is replaced by “project (which is usually a subfolder of /home/otreeadmin/Projects/)”.
• 3 tabs/windows that open when Firefox/Chromium starts: otree.org, localhost, http://otree.readthedocs.io/en/latest/
• export OTREE_PRODUCTION=0 or 1 should be set on the fly instead of hardcoded; same for OTREE_AUTH_LEVEL?
• /home/otreeadmin/Templates/_rooms/econ101.txt should include leading zeros.

OVMM

• In the help file of ovmm, the “experimenter” and “user” are used as synonyms, which is a bit confusing.
• User name: [max] is really confusing. It’s not clear that this is supposed to be an example. Moreover, the user name has to include at least 6 characters — hence, “max” is too short.
• ovmm add_user HAS TO BE preceded by sudo.
  • Mentioned in the docs
  • https://stackoverflow.com/questions/2806897/what-is-the-best-practices-for-checking-if-the-user-of-a-python-script-has-root with os.geteuid()

ovmm add_user

is executed and at then end asks for the sudo password. The command fails, however. See attached screenshot.

• nginx_template: Rephrase the instructions on how to set up HTTPS instead of HTTP.

On ovvm initialise:

• create folder query whether port change should be doable by user - default admin
• create folder "/var/port_80_switch
• set permissions according to 1 - group permissions writeable group either admin or users
• copy default nginx config to /etc/nginx/sites-available that calls /var/port_80_switch/otree
• write user command to switch port (not in static package)
• make available to admin ?~/local/bin
• copy to users' ~/local/bin is users are allowed to use

Felix: provides switch command and default nginx

Propose functionality:

*** TODO nginx default config setup [0%]

• nginx default config - bot block
• replace original setup default config with ours

*** TODO Make default port switchable [0%]

**** TODO decide whether only admin or user can switch ports

**** TODO if users are allowed

• create linux usergroup otree on initialise
• config folder creating with otree group permission
• assign newly created users to group otree
• create symlink otree_link in folder
• shell script that deletes symlink otree_link and creates new one to HOME/.oTree

**** TODO if only admin

• ovmm query for username to switch default port to
• delete current otree_link replace with symlink to /home/username/.oTree

make wording clearer in ovvm initialise

"admin password" -> "otree GUI admin password" ?