getredash / setup Goto Github PK
View Code? Open in Web Editor NEWSetup scripts for Redash Cloud Images
License: BSD 2-Clause "Simplified" License
Setup scripts for Redash Cloud Images
License: BSD 2-Clause "Simplified" License
Hi,
Where to add the docker directive bellow to share host sqlite db with container ?
volumes:
- /tmp/sqlite:/tmp/sqlite
E: Repository 'http://archive.ubuntukylin.com/ukui focal InRelease' changed its 'Origin' value from 'LP-PPA-ubuntukylin-members-ukui3.0' to 'LP-PPA-ubuntukylin-members-ukui'
E: Repository 'http://archive.ubuntukylin.com/ukui focal InRelease' changed its 'Label' value from 'UKUI 3.0' to 'UKUI'
Ubuntu 18.04 reached its official End Of Life (EOL) in April for the majority of users (aka those without support contracts):
https://ubuntu.com/about/release-cycle
So, we need to update this for a newer base server version. Probably Ubuntu 20.04, as that's likely the easiest approach that'll do the job.
After removing redash from a server any use of docker-compose yields the following error:
ERROR: .FileNotFoundError: [Errno 2] No such file or directory: '/opt/redash/docker-compose.yml'
This effectively makes docker-compose unusable for any other purpose. The cause is these two lines in the user's .profile
file which are added by the setup script.
export COMPOSE_PROJECT_NAME=redash
export COMPOSE_FILE=/opt/redash/docker-compose.yml
It would be useful if this were documented in the README.
<p>To get started on DigitalOcean, you can use the image from DigitalOcean’s Marketplace (<a href="[https://marketplace.digitalocean.com/apps/redash](view-source:https://marketplace.digitalocean.com/apps/redash)" target="_blank" rel="nofollow noopener noreferrer">Redash on the Marketplace</a>). Once started the Droplet, proceed to ”<a href="[#setup-redash-instance-setup](view-source:https://redash.io/help/open-source/setup/#setup-redash-instance-setup)">Setup</a>“.</p>
Hi,
I'm trying to install on Ubuntu 22.04 (fully updated just before starting, new install, nothing custom), I found similar instruction on several sites, here is one:
https://computingforgeeks.com/install-redash-data-visualization-dashboard-on-ubuntu/
The first step is:
"Run the following commands to install Docker on Ubuntu 22.04/20.04/18.04:"
sudo apt update
sudo apt -yy install apt-transport-https ca-certificates curl software-properties-common wget pwgen
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /etc/apt/trusted.gpg.d/docker-archive-keyring.gpg
sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu $(lsb_release -cs) stable"
sudo apt update && sudo apt -y install docker-ce docker-ce-cli containerd.io
To which I get the following error:
"Command line option 'S' [from -fsSL] is not understood in combination with the other options"
I tried several variants (-fSSL, -fssL, -fSL, etc.) but nothing seemed to work.
Any ideas? (I have very little knowledge of the CLI)
Thanks,
Mike
Getting following error at the time of testing the mysql connection in redash :
(2059, 'Plugin caching_sha2_password could not be loaded: /usr/lib/x86_64-linux-gnu/mariadb19/plugin/caching_sha2_password.so: cannot open shared object file: No such file or directory')
Just noticed the LATEST_VERSION
being reported for the 8.x series release is 8.0.0.b32245
:
Line 58 in cb47626
However, 8.0.2.b37747
is available.
Is the 8.0.2 build not considered stable, or is this just a case of something needing updating? 😄
I am getting this error when I run setup.sh, Actually I am using Dockerfile to run this script taking Docker machine locally using
docker build . -t redashtest
My Dockerfile:
`FROM ubuntu:latest
RUN apt-get update && apt-get install -y
sudo
curl
RUN adduser --system --no-create-home --disabled-login --gecos "" redash
COPY setup.sh /opt/redash/
RUN /bin/sh /opt/redash/setup.sh`
Error :
100 664 100 664 0 0 402 0 0:00:01 0:00:01 --:--:-- 402
100 11.2M 100 11.2M 0 0 703k 0 0:00:16 0:00:16 --:--:-- 2305k
#9 119.6 /opt/redash/setup.sh: 22: USER: parameter not set
------
executor failed running [/bin/sh -c /bin/sh /opt/redash/setup.sh]: exit code: 2
Please, could someone show a way to add the Oracle query in redash 10.1.0 ?
There is a docker image with the Oracle query, but it is still in version 7.0.0, I would like to add in the latest version 10.1.0.
Thanks for the time.
in setup.sh
Lines 63 to 64 in e611a6a
return 8.0.0.b32245
$ curl -s "https://version.redash.io/api/releases?channel=stable" | json_pp | grep "docker_image" | head -n 1 | awk 'BEGIN{FS=":"}{print $3}' | awk 'BEGIN{FS="\""}{print $1}'
8.0.0.b32245
Is #11 relevant?
Because I would like to update my version of Redash.
However, if I go to setup.sh and get the version
replacement, so I cannot update it without modifying setup.sh.
Line 69 in e611a6a
I would like to improve this situation.
setup.sh stop and throw an error at
" wget https://raw.githubusercontent.com/getredash/setup/${GIT_BRANCH}/data/docker-compose.yml
"
connect refuse
i want to download it manually , but i can find it .
Please include LDAP3 libs in the container builds.
Scheduler container keeps crashing with:
The ldap3 library was not found. This is required to use LDAP authentication (see requirements.txt).
when i run setup.sh script, i get error. I run it on Ubuntu 18.04 bionic
Starting redash_redis_1 ... done
Traceback (most recent call last):
File "/app/manage.py", line 9, in <module>
manager()
File "/usr/local/lib/python2.7/site-packages/click/core.py", line 716, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/flask/cli.py", line 380, in main
return AppGroup.main(self, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/click/core.py", line 696, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python2.7/site-packages/click/core.py", line 1060, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python2.7/site-packages/click/core.py", line 889, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python2.7/site-packages/click/core.py", line 534, in invoke
return callback(*args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/click/decorators.py", line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/flask/cli.py", line 257, in decorator
return __ctx.invoke(f, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/click/core.py", line 534, in invoke
return callback(*args, **kwargs)
File "/app/redash/cli/database.py", line 31, in create_tables
db.create_all()
File "/usr/local/lib/python2.7/site-packages/flask_sqlalchemy/__init__.py", line 963, in create_all
self._execute_for_all_tables(app, bind, 'create_all')
File "/usr/local/lib/python2.7/site-packages/flask_sqlalchemy/__init__.py", line 955, in _execute_for_all_tables
op(bind=self.get_engine(app, bind), **extra)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/sql/schema.py", line 4005, in create_all
tables=tables)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1939, in _run_visitor
with self._optional_conn_ctx_manager(connection) as conn:
File "/usr/local/lib/python2.7/contextlib.py", line 17, in __enter__
return self.gen.next()
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1932, in _optional_conn_ctx_manager
with self.contextual_connect() as conn:
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 2123, in contextual_connect
self._wrap_pool_connect(self.pool.connect, None),
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 2162, in _wrap_pool_connect
e, dialect, self)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1476, in _handle_dbapi_exception_noconnection
exc_info
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 265, in raise_from_cause
reraise(type(exception), exception, tb=exc_tb, cause=cause)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 2158, in _wrap_pool_connect
return fn()
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 400, in connect
return _ConnectionFairy._checkout(self)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 788, in _checkout
fairy = _ConnectionRecord.checkout(pool)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 529, in checkout
rec = pool._do_get()
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 1193, in _do_get
self._dec_overflow()
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 66, in __exit__
compat.reraise(exc_type, exc_value, exc_tb)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 1190, in _do_get
return self._create_connection()
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 347, in _create_connection
return _ConnectionRecord(self)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 474, in __init__
self.__connect(first_connect_check=True)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/pool.py", line 671, in __connect
connection = pool._invoke_creator(self)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 106, in connect
return dialect.connect(*cargs, **cparams)
File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 412, in connect
return self.dbapi.connect(*cargs, **cparams)
File "/usr/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 130, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) FATAL: password authentication failed for user "postgres"
(Background on this error at: http://sqlalche.me/e/e3q8)
Docker version 19.03.8, build afacb8b7f0
It would be nice to have this repository updated for Redash v10.
It used to execute succesfully a couple days ago.
Exact same steps on a VM with the same OS image is now failing with error : Cannot install -r requirements_all_ds.txt ... :
Requirement already satisfied: future>=0.15.0 in /usr/local/lib/python3.7/site-packages (from dql==0.5.26->-r requirements_all_ds.txt (line 12)) (0.18.2)
INFO: pip is looking at multiple versions of azure-kusto-data to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of atsd-client to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install -r requirements_all_ds.txt (line 12), -r requirements_all_ds.txt (line 15), -r requirements_all_ds.txt (line 21) and -r requirements_all_ds.txt (line 34) because these package versions have conflicting dependencies.
The conflict is caused by:
atsd-client 3.0.5 depends on python-dateutil
azure-kusto-data 0.0.35 depends on python-dateutil>=2.8.0
botocore 1.13.0 depends on python-dateutil<3.0.0 and >=2.1; python_version >= "2.7"
dql 0.5.26 depends on python-dateutil<2.7.0
To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies
ERROR: Service 'server' failed to build: The command '/bin/sh -c if [ "x$skip_ds_deps" = "x" ] ; then pip install -r requirements_all_ds.txt ; else echo "Skipping pip install -r requirements_all_ds.txt" ; fi' returned a non-zero code: 1
Steps to reproduce:
run these commands on an Ubuntu, 18.04 LTS (AWS ec2 ami: ami-0823c236601fef765):
sudo apt update
sudo apt install apt-transport-https ca-certificates curl software-properties-common -y
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -
sudo add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable"
sudo apt update
sudo apt install docker-ce -y
sudo usermod -aG docker ${USER}
sudo curl -L https://github.com/docker/compose/releases/download/1.21.2/docker-compose-`uname -s`-`uname -m` -o /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose
git clone https://github.com/getredash/setup.git
cd setup/
source ./setup.sh
The detail error logs
scheduler_1 | [2021-02-05 12:55:02,083][PID:25][INFO][Beat] Scheduler: Sending due task sync_user_details (redash.tasks.sync_user_details)
scheduler_1 | [2021-02-05 12:55:02,085][PID:1][INFO][MainProcess] Received task: redash.tasks.sync_user_details[be809368-b74a-4e42-ac62-945db29f570b] expires:[2021-02-05 12:55:47.083909+00:00]
scheduler_1 | [2021-02-05 12:55:02,087][PID:24][INFO][ForkPoolWorker-2] Task redash.tasks.sync_user_details[be809368-b74a-4e42-ac62-945db29f570b] succeeded in 0.000717621995136s: None
scheduler_1 | [2021-02-05 12:55:02,128][PID:25][INFO][Beat] Scheduler: Sending due task refresh_queries (redash.tasks.refresh_queries)
scheduler_1 | [2021-02-05 12:55:02,130][PID:1][INFO][MainProcess] Received task: redash.tasks.refresh_queries[389d1c89-af7e-41a7-aecf-585691e83607]
scheduler_1 | [2021-02-05 12:55:02,132][PID:24][INFO][ForkPoolWorker-2] task_name=redash.tasks.refresh_queries task_id=389d1c89-af7e-41a7-aecf-585691e83607 Refreshing queries...
postgres_1 | ERROR: relation "queries" does not exist at character 979
postgres_1 | STATEMENT: SELECT queries.query AS queries_query, queries.updated_at AS queries_updated_at, queries.created_at AS queries_created_at, queries.id AS queries_id, queries.version AS queries_version, queries.org_id AS queries_org_id, queries.data_source_id AS queries_data_source_id, queries.latest_query_data_id AS queries_latest_query_data_id, queries.name AS queries_name, queries.description AS queries_description, queries.query_hash AS queries_query_hash, queries.api_key AS queries_api_key, queries.user_id AS queries_user_id, queries.last_modified_by_id AS queries_last_modified_by_id, queries.is_archived AS queries_is_archived, queries.is_draft AS queries_is_draft, queries.schedule AS queries_schedule, queries.schedule_failures AS queries_schedule_failures, queries.options AS queries_options, queries.search_vector AS queries_search_vector, queries.tags AS queries_tags, query_results_1.id AS query_results_1_id, query_results_1.retrieved_at AS query_results_1_retrieved_at
postgres_1 | FROM queries LEFT OUTER JOIN query_results AS query_results_1 ON query_results_1.id = queries.latest_query_data_id
postgres_1 | WHERE queries.schedule IS NOT NULL ORDER BY queries.id
scheduler_1 | [2021-02-05 12:55:02,140][PID:24][ERROR][ForkPoolWorker-2] Task redash.tasks.refresh_queries[389d1c89-af7e-41a7-aecf-585691e83607] raised unexpected: ProgrammingError('(psycopg2.ProgrammingError) relation "queries" does not exist\nLINE 2: FROM queries LEFT OUTER JOIN query_results AS query_results_...\n ^\n',)
scheduler_1 | Traceback (most recent call last):
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/celery/app/trace.py", line 385, in trace_task
scheduler_1 | R = retval = fun(*args, **kwargs)
scheduler_1 | File "/app/redash/worker.py", line 84, in __call__
scheduler_1 | return TaskBase.__call__(self, *args, **kwargs)
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/celery/app/trace.py", line 648, in __protected_call__
scheduler_1 | return self.run(*args, **kwargs)
scheduler_1 | File "/app/redash/tasks/queries.py", line 184, in refresh_queries
scheduler_1 | for query in models.Query.outdated_queries():
scheduler_1 | File "/app/redash/models/__init__.py", line 555, in outdated_queries
scheduler_1 | for query in queries:
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2995, in __iter__
scheduler_1 | return self._execute_and_instances(context)
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 3018, in _execute_and_instances
scheduler_1 | result = conn.execute(querycontext.statement, self._params)
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
scheduler_1 | return meth(self, multiparams, params)
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
scheduler_1 | return connection._execute_clauseelement(self, multiparams, params)
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
scheduler_1 | compiled_sql, distilled_params
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1200, in _execute_context
scheduler_1 | context)
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1413, in _handle_dbapi_exception
scheduler_1 | exc_info
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 265, in raise_from_cause
scheduler_1 | reraise(type(exception), exception, tb=exc_tb, cause=cause)
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context
scheduler_1 | context)
scheduler_1 | File "/usr/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py", line 509, in do_execute
scheduler_1 | cursor.execute(statement, parameters)
scheduler_1 | ProgrammingError: (psycopg2.ProgrammingError) relation "queries" does not exist
scheduler_1 | LINE 2: FROM queries LEFT OUTER JOIN query_results AS query_results_...
scheduler_1 | ^
scheduler_1 | [SQL: 'SELECT queries.query AS queries_query, queries.updated_at AS queries_updated_at, queries.created_at AS queries_created_at, queries.id AS queries_id, queries.version AS queries_version, queries.org_id AS queries_org_id, queries.data_source_id AS queries_data_source_id, queries.latest_query_data_id AS queries_latest_query_data_id, queries.name AS queries_name, queries.description AS queries_description, queries.query_hash AS queries_query_hash, queries.api_key AS queries_api_key, queries.user_id AS queries_user_id, queries.last_modified_by_id AS queries_last_modified_by_id, queries.is_archived AS queries_is_archived, queries.is_draft AS queries_is_draft, queries.schedule AS queries_schedule, queries.schedule_failures AS queries_schedule_failures, queries.options AS queries_options, queries.search_vector AS queries_search_vector, queries.tags AS queries_tags, query_results_1.id AS query_results_1_id, query_results_1.retrieved_at AS query_results_1_retrieved_at \nFROM queries LEFT OUTER JOIN query_results AS query_results_1 ON query_results_1.id = queries.latest_query_data_id \nWHERE queries.schedule IS NOT NULL ORDER BY queries.id'] (Background on this error at: http://sqlalche.me/e/f405)
Hello There!
I have made some changes and created the new service Images as the following using make compose_build:
REPOSITORY TAG IMAGE ID CREATED SIZE
proddash-scheduler latest 1c424d1a2e4b 7 minutes ago 1.79GB
proddash-worker latest cc8c05ecb95e 7 minutes ago 1.79GB
proddash-server latest 492b479b343b 7 minutes ago 1.79GB
Now i want to deploy those Images to my on-prem Server but the docker-compose template in this Repo has only one Image to pull.
How do i combine my three images into one?
Hi,
I've been installing Redash for my clients alongside some custom software. Few of them had been raising an issue of Postgres 9.6 reaching End Of Life status soon.
Do you plan to upgrade Postgres to a newer one?
Hey,
For anyone having problems with running preview version of Redash (redash/redash:preview)
Use this docker-compose.yml (Alerts is also working)
version: "3"
services:
server:
image: redash/redash:preview
depends_on:
init-server:
condition: service_completed_successfully
restart: always
environment:
PYTHONUNBUFFERED: "0"
REDASH_LOG_LEVEL: "INFO"
REDASH_REDIS_URL: "redis://redis:6379/0"
REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
REDASH_RATELIMIT_ENABLED: "false"
REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
REDASH_MAIL_SERVER: "email"
REDASH_MAIL_PORT: 1025
REDASH_ENFORCE_CSRF: "true"
REDASH_GUNICORN_TIMEOUT: 60
ports:
- "5000:5000"
platform: linux/amd64
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost:5000/ping"]
interval: 1s
timeout: 2s
retries: 30
init-server:
image: redash/redash:preview
depends_on:
- postgres
- redis
command:
- create_db
environment:
PYTHONUNBUFFERED: "0"
REDASH_LOG_LEVEL: "INFO"
REDASH_REDIS_URL: "redis://redis:6379/0"
REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
REDASH_RATELIMIT_ENABLED: "false"
REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
REDASH_MAIL_SERVER: "email"
REDASH_MAIL_PORT: 1025
REDASH_ENFORCE_CSRF: "true"
REDASH_GUNICORN_TIMEOUT: 60
ports:
- "5000:5000"
platform: linux/amd64
scheduler:
image: redash/redash:preview
depends_on:
- redis
restart: always
command: scheduler
environment:
QUEUES: "celery"
WORKERS_COUNT: 1
PYTHONUNBUFFERED: "0"
REDASH_LOG_LEVEL: "INFO"
REDASH_REDIS_URL: "redis://redis:6379/0"
REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
REDASH_RATELIMIT_ENABLED: "false"
REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
REDASH_MAIL_SERVER: "email"
REDASH_MAIL_PORT: 1025
REDASH_ENFORCE_CSRF: "true"
REDASH_GUNICORN_TIMEOUT: 60
platform: linux/amd64
worker:
image: redash/redash:preview
depends_on:
- redis
restart: always
command: worker
environment:
QUEUES: "scheduled_queries,schemas,periodic,emails,default"
WORKERS_COUNT: 6
PYTHONUNBUFFERED: "0"
REDASH_LOG_LEVEL: "INFO"
REDASH_REDIS_URL: "redis://redis:6379/0"
REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
REDASH_RATELIMIT_ENABLED: "false"
REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
REDASH_MAIL_SERVER: "email"
REDASH_MAIL_PORT: 1025
REDASH_ENFORCE_CSRF: "true"
REDASH_GUNICORN_TIMEOUT: 60
platform: linux/amd64
adhoc-worker:
image: redash/redash:preview
depends_on:
- redis
restart: always
command: worker
environment:
QUEUES: "queries"
WORKERS_COUNT: 2
PYTHONUNBUFFERED: "0"
REDASH_LOG_LEVEL: "INFO"
REDASH_REDIS_URL: "redis://redis:6379/0"
REDASH_COOKIE_SECRET: "xuiCIAEfejj05ZUzQ0odb5pwBttXUkE4"
REDASH_SECRET_KEY: "9emtXqroCnNhFiETBiFXoQvA4PH0nQuP"
REDASH_DATABASE_URL: "postgresql://postgres:YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq@postgres/postgres"
REDASH_RATELIMIT_ENABLED: "false"
REDASH_MAIL_DEFAULT_SENDER: "[email protected]"
REDASH_MAIL_SERVER: "email"
REDASH_MAIL_PORT: 1025
REDASH_ENFORCE_CSRF: "true"
REDASH_GUNICORN_TIMEOUT: 60
platform: linux/amd64
redis:
image: redis:7.0-alpine
restart: always
postgres:
image: postgres:15-alpine
restart: always
environment:
POSTGRES_PASSWORD: "YKK1KkvPb4ula2HRXlnd7z7n6rVbWKSq"
nginx:
image: redash/nginx:latest
ports:
- "80:80"
depends_on:
- server
links:
- server:redash
restart: always
email:
image: maildev/maildev
ports:
- "1080:1080"
- "1025:1025"
restart: always
I am trying to install redash on a new Ubuntu 18.04 server using the setup.sh
install script. However, I have encountered some error's I haven't seen from any of my previous redash installations using the script:
<succesful script execution above - can be provided if needed>
...
Digest: sha256:4eaaa7af6476b0422058b0022661ad6129dfbf9065c506fb0904bbf0a16f2007
Status: Downloaded newer image for redash/nginx:latest
redash_postgres_1 is up-to-date
redash_redis_1 is up-to-date
Creating redash_server_1 ...
Creating redash_scheduler_1 ...
Creating redash_scheduled_worker_1 ...
Creating redash_adhoc_worker_1 ...
ERROR: for redash_scheduler_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read tim
eout=60)
ERROR: for redash_scheduled_worker_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (r
ead timeout=60)
ERROR: for redash_server_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeou
t=60)
ERROR: for redash_adhoc_worker_1 UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read
timeout=60)
ERROR: for scheduler UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
ERROR: for scheduled_worker UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeo
ut=60)
ERROR: for server UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
ERROR: for adhoc_worker UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=6
0)
ERROR: An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEO
UT to a higher value (current value: 60).
After each run of the setup.sh
script I have removed the /opt/redash/
folder, stopped all the running docker containers, and have run docker system prune -a -f
to try and reset the environment. However, each time I run the script it still ends up failing on the An HTTP request took too long to complete
error.
The script seems to run successfully until the following line of the setup.sh
script:
sudo docker-compose run --rm server create_db
But this line also produces the error:
$:/opt/redash# sudo docker-compose run --rm server create_db
Starting redash_redis_1 ... done
Starting redash_postgres_1 ... done
ERROR: An HTTP request took too long to complete. Retry with --verbose to obtain debug information.
If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEO
UT to a higher value (current value: 60).
root@vps92871:/opt/redash#
Any advice on why this might be or what I can do about it would be very much appreciated. Thanks in advance!
Hi, I grabbed the script and when I executed it, I saw the following errors:
E: The repository 'http://us-central1.gce.archive.ubuntu.com/ubuntu kinetic Release' no longer has a Release file.
E: The repository 'http://us-central1.gce.archive.ubuntu.com/ubuntu kinetic-updates Release' no longer has a Release file.
E: The repository 'http://us-central1.gce.archive.ubuntu.com/ubuntu kinetic-backports Release' does not have a Release file.
E: The repository 'http://security.ubuntu.com/ubuntu kinetic-security Release' no longer has a Release file.
I know it's specifically not listed as a supported OS but (I would have thought) it's somewhat close to RHEL so perhaps there's some hope.
If it's of any use, this is the terminal output I get when trying to run it:
I'd happily pursue any directions that might get it to work and share the results ... I'm just not sure where to start trying!
..when from what I can tell a simple cd would suffice should not be done.
And I would like to remind you that docker-compose has other usages than only running redash.
Lines 64 to 67 in cb47626
At https://hub.docker.com/r/redash/redash/tags, there is a latest version which is 3 years old, but there is also preview which is 3 months old and a 10.1.0.b50633 tag which is a year old.
latest also is the first one listed in spite of being older.
Which one is the right one, to download?
Are we supposed to install latest then upgrade it, should it be preview or 10.1.0.b50633?
https://redash.io/help/open-source/setup#docker
<li>Download our recommended <a href="[https://github.com/getredash/setup/blob/master/data/docker-compose.yml](view-source:https://github.com/getredash/setup/blob/master/data/docker-compose.yml)" target="_blank" rel="nofollow noopener noreferrer">Docker Compose configuration</a> and create initial configuration.</li>
<p>To run Redash you need several instances of Redash (API server and background workers to run queries) along with Redis and PostgreSQL. If you don’t want or can’t use our images or <a href="[https://github.com/getredash/setup](view-source:https://github.com/getredash/setup)" target="_blank" rel="nofollow noopener noreferrer">Setup Script</a>, you can refer to the <a href="[https://github.com/getredash/setup/blob/master/data/docker-compose.yml](view-source:https://github.com/getredash/setup/blob/master/data/docker-compose.yml)" target="_blank" rel="nofollow noopener noreferrer">Docker Compose configuration</a> to understand what services you need to define.</p>
After ./setup.sh
and docker compose up
, every call to docker compose up
from anywhere results in something like this:
not@important:~/streamlit-workshop$ docker compose up
[+] Running 7/0
✔ Container redash-postgres-1 Running 0.0s
✔ Container redash-redis-1 Running 0.0s
✔ Container redash-adhoc_worker-1 Running 0.0s
✔ Container redash-scheduler-1 Running 0.0s
✔ Container redash-scheduled_worker-1 Running 0.0s
✔ Container redash-server-1 Running 0.0s
✔ Container redash-nginx-1 Running 0.0s
Attaching to redash-adhoc_worker-1, redash-nginx-1, redash-postgres-1, redash-redis-1, redash-scheduled_worker-1, redash-scheduler-1, redash-server-1
redash-scheduler-1 | [2023-12-05 22:33:14,501][PID:24][INFO][Beat] Scheduler: Sending due task sync_user_details (redash.tasks.sync_user_details)
redash-scheduler-1 | [2023-12-05 22:33:14,504][PID:1][INFO][MainProcess] Received task: redash.tasks.sync_user_details[5a16ec2e-2195-464a-bd17-8cab90ca9ad7] expires:[2023-12-05 22:33:59.502083+00:00]
redash-scheduler-1 | [2023-12-05 22:33:14,506][PID:585][INFO][ForkPoolWorker-563] Task redash.tasks.sync_user_details[5a16ec2e-2195-464a-bd17-8cab90ca9ad7] succeeded in 0.000744658056647s: None
redash-scheduler-1 | [2023-12-05 22:33:22,970][PID:24][INFO][Beat] Scheduler: Sending due task refresh_queries (redash.tasks.refresh_queries)
redash-scheduler-1 | [2023-12-05 22:33:22,973][PID:1][INFO][MainProcess] Received task: redash.tasks.refresh_queries[d42edeb4-c232-4e6f-b39d-aa6649523fcc]
redash-scheduler-1 | [2023-12-05 22:33:22,975][PID:585][INFO][ForkPoolWorker-563] task_name=redash.tasks.refresh_queries task_id=d42edeb4-c232-4e6f-b39d-aa6649523fcc Refreshing queries...
redash-scheduler-1 | [2023-12-05 22:33:22,983][PID:585][INFO][ForkPoolWorker-563] task_name=redash.tasks.refresh_queries task_id=d42edeb4-c232-4e6f-b39d-aa6649523fcc Done refreshing queries. Found 0 outdated queries: []
redash-scheduler-1 | [2023-12-05 22:33:22,986][PID:585][INFO][ForkPoolWorker-563] Task redash.tasks.refresh_queries[d42edeb4-c232-4e6f-b39d-aa6649523fcc] succeeded in 0.0114565880504s: None
^CGracefully stopping... (press Ctrl+C again to force)
Aborting on container exit...
[+] Stopping 7/7
✔ Container redash-adhoc_worker-1 Stopped 3.1s
✔ Container redash-nginx-1 Stopped 1.0s
✔ Container redash-scheduler-1 Stopped 3.5s
✔ Container redash-scheduled_worker-1 Stopped 3.8s
✔ Container redash-server-1 Stopped 1.5s
✔ Container redash-postgres-1 Stopped 1.4s
✔ Container redash-redis-1 Stopped 1.1s
canceled
This project is not redash. Reinstalling docker with
sudo systemctl stop docker
sudo apt-get purge ...
sudo rm -rf /etc/docker /var/lib/docker
...
didn't help. I'll have to reinstall the OS on multiple servers and on my personal PC. This is completely terrible and I might get fired. Even so I hope it's just my fault.
Issue was tested on Debian GNU/Linux 12 (bookworm) x86_64 docker version 20.10.24+dfsg1 and Pop!_OS 22.04 LTS x86_64 docker version 24.0.7. Compose upping was tested on multiple different repositories, with a similar result.
Just following the official guide I get this:
/opt/redash$ bash ~/gits/setup/setup.sh
[sudo] password for ---:
Reading package lists... Done
Building dependency tree
Reading state information... Done
pwgen is already the newest version (2.08-1).
ca-certificates is already the newest version (20190110~18.04.1).
curl is already the newest version (7.58.0-2ubuntu3.10).
software-properties-common is already the newest version (0.96.24.32.14).
wget is already the newest version (1.19.4-1ubuntu2.2).
apt-transport-https is already the newest version (1.6.12ubuntu0.1).
0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded.
OK
Hit:1 http://ru.archive.ubuntu.com/ubuntu bionic InRelease
Hit:2 https://download.docker.com/linux/ubuntu bionic InRelease
Hit:3 http://ru.archive.ubuntu.com/ubuntu bionic-updates InRelease
Hit:4 http://ru.archive.ubuntu.com/ubuntu bionic-backports InRelease
Hit:5 http://ru.archive.ubuntu.com/ubuntu bionic-security InRelease
Reading package lists... Done
Hit:1 http://ru.archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://ru.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Hit:3 https://download.docker.com/linux/ubuntu bionic InRelease
Get:4 http://ru.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:5 http://ru.archive.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Fetched 252 kB in 1s (386 kB/s)
Reading package lists... Done
Reading package lists... Done
Building dependency tree
Reading state information... Done
docker-ce is already the newest version (5:19.03.13~3-0~ubuntu-bionic).
0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded.
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 651 100 651 0 0 3355 0 --:--:-- --:--:-- --:--:-- 3373
100 11.2M 100 11.2M 0 0 4831k 0 0:00:02 0:00:02 --:--:-- 8159k
malformed JSON string, neither array, object, number, string or atom, at character offset 0 (before "(end of string)") at /usr/bin/json_pp line 45.
--2020-09-22 07:57:03-- https://raw.githubusercontent.com/getredash/setup/master/data/docker-compose.yml
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.0.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1076 (1.1K) [text/plain]
Saving to: ‘docker-compose.yml.1’
docker-compose.yml.1 100%[=====================================================================================================================>] 1.05K --.-KB/s in 0s
2020-09-22 07:57:03 (24.7 MB/s) - ‘docker-compose.yml.1’ saved [1076/1076]
ERROR: yaml.scanner.ScannerError: mapping values are not allowed here
in "./docker-compose.yml", line 3, column 23
It is a plain Ubuntu 18.04 Server virtual machine:
/opt/redash$ cat /etc/*-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.5 LTS"
NAME="Ubuntu"
VERSION="18.04.5 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.5 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic
/opt/redash$ uname -a
Linux --- 4.15.0-118-generic #119-Ubuntu SMP Tue Sep 8 12:30:01 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
/opt/redash$
Hi Team,
I have recently setup redash instance using setup.sh and trying to integrate Zabbix with It.
I could not find Zabbix Datasource within datasources list
Can you help me
Ubuntu releases apt security patch for CVE-2019-3462
https://people.canonical.com/~ubuntu-security/cve/2019/CVE-2019-3462.html
Please update base images in packaer.json and publish AMI.
This line should absolutely be removed
https://github.com/getredash/setup/blob/master/setup.sh#L64-L65
There is no reason to modify someone's bash profile without giving them a prompt or at least informing them that you are making changes.
This set's the COMPOSE_* environment variables for every docker-compose command run thereafter.
Please consider removing this line, you are already exporting the variables no need to lock the user in.
this script assumes that everyones primary group is the same as primary user - it is not.
Installed according to the instructions
after installation the container with
NAME="Ubuntu"
VERSION_ID="22.04"
docker logs redash-server-1
[2024-04-03 13:14:02 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:16)
[2024-04-03 13:14:02 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:17)
[2024-04-03 13:14:02 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:18)
[2024-04-03 13:14:02 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:19)
[2024-04-03 13:14:02 +0000] [16] [INFO] Worker exiting (pid: 16)
[2024-04-03 13:14:02 +0000] [17] [INFO] Worker exiting (pid: 17)
[2024-04-03 13:14:02 +0000] [18] [INFO] Worker exiting (pid: 18)
[2024-04-03 13:14:02 +0000] [19] [INFO] Worker exiting (pid: 19)
[2024-04-03 13:14:03 +0000] [20] [INFO] Booting worker with pid: 20
[2024-04-03 13:14:03 +0000] [21] [INFO] Booting worker with pid: 21
[2024-04-03 13:14:03 +0000] [22] [INFO] Booting worker with pid: 22
[2024-04-03 13:14:03 +0000] [23] [INFO] Booting worker with pid: 23
I tried the installation script on my archlinux machine. I understand that such a platform is not yet supported.
Still, I get the error This doesn't seem to be a Debian, Fedora, Ubuntu, nor RHEL (compatible) system, so this script doesn't know how to add Docker to it.
.
The point is that docker
and docker-compose
are already installed in the system.
It would be nice to check whether docker
and docker-compose
are already installed before failing with such a message
./setup.sh: 279: PROFILE: parameter not set
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.