project-sunbird / sunbird-devops Goto Github PK

@Abhishek-Govula commented on Mon Feb 19 2018

Hi,
Can you please provide the latest version of NGINX for the proxy service. The current proxy service is using NGINX version# 1.13.3 which is obsolete.

@steotia commented on Mon Feb 19 2018

@mathewjpallan can you please get your team to triage it? Or else if it is a configuration which @Abhishek-Govula can handle, let him know how to do it.
cc @Manojvv

@steotia commented on Mon Feb 19 2018

How are you deploying the stack?
Let me know the deployment steps (basic).

@Abhishek-Govula commented on Mon Feb 19 2018

@steotia - I am running the deployment script. Inside sunbird-devops/deploy/deploy-proxy.sh directory

content_service_content_service container doesn't start after installation.

Log messages below:

content_service_content_service.1.v8uv854olarj@sl-dev-appsrvr | /home/sunbird/mw/content/node_modules/azure-storage/lib/common/services/servicesettings.js:83
content_service_content_service.1.v8uv854olarj@sl-dev-appsrvr | throw new SyntaxError(SR.INVALID_CONNECTION_STRING);
content_service_content_service.1.y20aiss38x01@sl-dev-appsrvr | throw new SyntaxError(SR.INVALID_CONNECTION_STRING);
content_service_content_service.1.njvasdcxy1qw@sl-dev-appsrvr | throw new SyntaxError(SR.INVALID_CONNECTION_STRING);
content_service_content_service.1.w86oh7jiwxvs@sl-dev-appsrvr | throw new SyntaxError(SR.INVALID_CONNECTION_STRING);
content_service_content_service.1.w86oh7jiwxvs@sl-dev-appsrvr | ^
content_service_content_service.1.v8uv854olarj@sl-dev-appsrvr | ^
content_service_content_service.1.y20aiss38x01@sl-dev-appsrvr | ^
content_service_content_service.1.njvasdcxy1qw@sl-dev-appsrvr | ^
content_service_content_service.1.njvasdcxy1qw@sl-dev-appsrvr |
content_service_content_service.1.w86oh7jiwxvs@sl-dev-appsrvr |
content_service_content_service.1.v8uv854olarj@sl-dev-appsrvr |
content_service_content_service.1.y20aiss38x01@sl-dev-appsrvr |
content_service_content_service.1.y20aiss38x01@sl-dev-appsrvr | SyntaxError: Connection strings must be of the form "key1=value1;key2=value2".
content_service_content_service.1.njvasdcxy1qw@sl-dev-appsrvr | SyntaxError: Connection strings must be of the form "key1=value1;key2=value2".
content_service_content_service.1.w86oh7jiwxvs@sl-dev-appsrvr | SyntaxError: Connection strings must be of the form "key1=value1;key2=value2".
content_service_content_service.1.v8uv854olarj@sl-dev-appsrvr | SyntaxError: Connection strings must be of the form "key1=value1;key2=value2".

@Manojvv @harishgilimi @kochhar @rjshrjndrn @mathewjpallan

Question - when an SSL certificate is renewed do we have to update the config file with the new certificate value(s) and rerun deploy-core.sh and deploy-proxy.sh scripts?

@kochhar @Manojvv @mathewjpallan @rjshrjndrn

@pranvendra commented on Thu Feb 01 2018

Hi,
I wanted to know how the backup of databases is taken on sunbird and what is the restoring process for the same. Moreover, if the backup is happening on regular basis.

@kochhar commented on Fri Feb 02 2018

Issue moved to project-sunbird/sunbird-devops #26 via ZenHub

Installing api-manger_kong is failing, because we're waiting for the service to come up, and the service is not discoverable from host machine so containerizing

@pranvendra commented on Thu Feb 01 2018

Hi,
I wanted to know how the backup of databases is taken on sunbird and what is the restoring process for the same. Moreover, if the backup is happening on regular basis.

While trying to run :::

ubuntu@ip-10-0-0-28:/sunbird-devops/deploy$ sudo ./install-dbs.sh mysb-devops/ansible/inventories/deploy
Reading package lists... Done
Building dependency tree
Reading state information... Done
software-properties-common is already the newest version (0.96.20.7).
0 upgraded, 0 newly installed, 0 to remove and 8 not upgraded.
gpg: keyring /tmp/tmpefwtsimy/secring.gpg' created gpg: keyring /tmp/tmpefwtsimy/pubring.gpg' created
gpg: requesting key 7BB9C367 from hkp server keyserver.ubuntu.com
gpg: /tmp/tmpefwtsimy/trustdb.gpg: trustdb created
gpg: key 7BB9C367: public key "Launchpad PPA for Ansible, Inc." imported
gpg: Total number processed: 1
gpg: imported: 1 (RSA: 1)
OK
Hit:1 http://us-east-1.ec2.archive.ubuntu.com/ubuntu xenial InRelease
Get:2 http://us-east-1.ec2.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:3 http://us-east-1.ec2.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Ign:4 http://repo.mongodb.org/apt/ubuntu xenial/mongodb-org/3.4 InRelease
Hit:5 http://repo.mongodb.org/apt/ubuntu xenial/mongodb-org/3.4 Release
Hit:6 https://download.docker.com/linux/ubuntu xenial InRelease
Get:7 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Hit:8 http://ppa.launchpad.net/ansible/ansible/ubuntu xenial InRelease
Hit:11 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial InRelease
Get:10 http://dl.bintray.com/apache/cassandra 311x InRelease [3,169 B]
Get:12 http://dl.bintray.com/apache/cassandra 22x InRelease [3,168 B]
Fetched 313 kB in 0s (478 kB/s)
Reading package lists... Done
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Version '2.4.1.0-1ppaxenial' for 'ansible' was not found

we are getting the above error.We check the ansible version,it is as per requirement and also pinging.

http://www.sunbird.org/developer-docs/installation/setup_db/

Run cd ./sunbird-devops/deploy && ./generate-config.sh <implementation-name> <environment-name> deploy

deploy is not a valid option for generate-config.sh script. It should be either core or azure according to the script.

@kochhar @Manojvv

• Adding test command in deployment steps
• Updating gitup repo with test covrage

@coolbung @kochhar @steotia @parthlawate @mathewjpallan

Hi,

Can some please review the PR - #5 ?

This docker image will be used for building and deploying the site http://www.sunbird.org/ using CircleCI.
This image is using Ubuntu Xenial as base image and has -> ruby, aws-cli , gems and other required dependencies.

Also can someone please build the image and host it on sunbird docker hub account? or else add me in account so that i can take necessary actions.

Once server is restarted some times logs are visible , but after an hour or two non of the logs are coming , this is happening across all installation.

Current installation process doesn't create required ElasticSearch indexes. Without these indices creation of organization fails. Please see if this step can be incorporated as part of installation process.

@Manojvv @kochhar @rjshrjndrn @mathewjpallan

Badger Dockerization.

Current db initialisation script is not idempotent -- this means that the DB initialisation code cannot be run multiple times to correct errors. This is causing problems for installers because the database configuration cannot be automated.

See: https://github.com/project-sunbird/sunbird-commons/issues/111#issuecomment-343912528

Hi, can you please share DB (Cassandra & ES) migration scripts. Am trying to migrate our Sunbird installation from Sept 5th (v1.0) to current (v1.3). Let me know in case of any questions.

@kochhar @mathewjpallan @Meethaz @Manojvv

Docker file and other configurations for encryption service

Hi Team @rjshrjndrn , @mathewjpallan

As part of a issue resolution, sunbird engg team - @harishgilimi has asked us to upgrade the player for julia computing sunbird to 0.0.10-gold. Can you pls list down the steps to upgrade the player.

Thanks
Thillai.

@Jenifer-Ramsingh - FYI

None of the deployment scripts present in this directory https://github.com/project-sunbird/sunbird-devops/tree/master/deploy have any test cases. Thus it's impossible to know if the scripts are broken or if there is an error to be found.

If we are recommending that a new adopter of Sunbird use automation to bootstrap a new Sunbird instance, the automation must be tested thoroughly.

automate keycloak configuration using python-keycloak library
Create bootstrap-keycloak shell script
Integrate it with sunbird easy installation

Hi Team, @rjshrjndrn @mathewjpallan

We would like to configure the current Julia Computing sunbird installation(sunbird.juliacomputing.io) to www.aiprohub.org (ip address - 52.224.127.144). Can you pls list down the steps involved in keycloak and config including the certificate changes required.

thanks,
Thillai.

Hi Team,

While running ./certbot.sh script we getting bellow error.

-e This script won't work for aws, as it's black listed in letsencrypt
so if youre running on aws please press ctrl+c with in 5 seconds
please enter your dns name
sunbird.....io(entered correct Domain name here)
dpkg-query: error: --search needs at least one file name pattern argument

Use --help for help about querying packages.

@kochhar @mathewjpallan @coolbung @parthlawate @devops-ekstep @steotia

Hi,

Can someone create a s3 bucket and provide me details - id , secrets and bucket name on my email address ( [email protected] ) ?

This bucket will be used to host the dev site of http://www.sunbird.org/

Please also let me know the Endpoint where i will be able to access the site.
http://docs.aws.amazon.com/AmazonS3/latest/user-guide/static-website-hosting.html

Thanks!

Hi, The julia computing azure servers got restarted early this morning and the sunbird.juliacomputing.io login was not working - we were getting 502 Bad gateway error.

On investigation we found that the keycloak is not up and we needed to manually restart the keycloak to ensure that the sunbird application is up and running.

Raising this issue as part of documentation - @mathewjpallan @rjshrjndrn

Facing the following error when trying to execute sudo ./install-dbs.sh <implementation-name>-devops/ansible/inventories/<environment-name>

sluser@sl-dev-dbsrvr:~/sunbird-devops/deploy$ sudo ./install-dbs.sh sldev-devops/ansible/inventories/dev/
@@@@@@@@@ Elasticsearch installation
./install-dbs.sh: 14: ./install-dbs.sh: ansible-playbook: not found

@Manojvv @mathewjpallan @kochhar @rjshrjndrn

Acs template variable fix

While trying to run :::
ubuntu@ip-10-0-0-28:/sunbird-devops/deploy$ sudo ./install-dbs.sh mysb-devops/ansible/inventories/deploy
Reading package lists... Done
Building dependency tree
Reading state information... Done
software-properties-common is already the newest version (0.96.20.7).
0 upgraded, 0 newly installed, 0 to remove and 8 not upgraded.
gpg: keyring /tmp/tmpefwtsimy/secring.gpg' created gpg: keyring/tmp/tmpefwtsimy/pubring.gpg' created
gpg: requesting key 7BB9C367 from hkp server keyserver.ubuntu.com
gpg: /tmp/tmpefwtsimy/trustdb.gpg: trustdb created
gpg: key 7BB9C367: public key "Launchpad PPA for Ansible, Inc." imported
gpg: Total number processed: 1
gpg: imported: 1 (RSA: 1)
OK
Hit:1 http://us-east-1.ec2.archive.ubuntu.com/ubuntu xenial InRelease
Get:2 http://us-east-1.ec2.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB]
Get:3 http://us-east-1.ec2.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB]
Ign:4 http://repo.mongodb.org/apt/ubuntu xenial/mongodb-org/3.4 InRelease
Hit:5 http://repo.mongodb.org/apt/ubuntu xenial/mongodb-org/3.4 Release
Hit:6 https://download.docker.com/linux/ubuntu xenial InRelease
Get:7 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB]
Hit:8 http://ppa.launchpad.net/ansible/ansible/ubuntu xenial InRelease
Hit:11 http://ppa.launchpad.net/webupd8team/java/ubuntu xenial InRelease
Get:10 http://dl.bintray.com/apache/cassandra 311x InRelease [3,169 B]
Get:12 http://dl.bintray.com/apache/cassandra 22x InRelease [3,168 B]
Fetched 313 kB in 0s (478 kB/s)
Reading package lists... Done
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Version '2.4.1.0-1ppaxenial' for 'ansible' was not found
we are getting the above error.We check the ansible version,it is as per requirement and also pinging.

Sunbird app required the access to domainUser whitelist group for accessing the channel and framework API.

This issue is to put in configuration placeholders for Sunbird services deployment.

In the multinode installation, Initiating docker swarm in multiple nodes.

It'll need 1 or an odd number of managers(for HA), and worker nodes( for load distribution). Keeping manager nodes separately, as it's best practice.

Manager node can be of t2.medium.

Ubuntu 16.04 instances in aws and some other cloud providers come without python2, which is a prerequisite for ansible, our automation tool.

And create an unified user sunbird who will manage sunbird.

Dear Team,

Please provide api_key which has access to Org, User, Content, Framework, Channel APIs in Sunbird Staging environment.

Warm regards,
JP

To create a fast and reliable Installation procedure, which requires bare minimum user intervention as much as possible.

User creation is failing in init-db postgres.

Write automation script to install pre-requisites required, build and deploying Registry (open-saber) module