Our users do not want to wait around for a long time when getting answers to their que

I've written up some conclusions here: <a href="https://github

Find out if Postgres' materialized views will solve our needs for real-time data about h HOT 4 CLOSED

jon-betts commented on June 12, 2024

Find out if Postgres' materialized views will solve our needs for real-time data

from h.

Comments (4)

indigobravo commented on June 12, 2024

Temp RDS Instances

A temporary RDS instance (primary & replica) has been created based off a snapshot of the production service used by H and LMS. Connection details can be found below.

FQDN	Role
temp-business-intel.cv4scae14gk6.us-west-1.rds.amazonaws.com	Primary
temp-business-intel-replica.cv4scae14gk6.us-west-1.rds.amazonaws.com	Replica

Link to snapshot: temp-business-intel

These resources need to be deleted after we have completed testing.

from h.

indigobravo commented on June 12, 2024

Temp Devel Instance

A Ubuntu EC2 server has been provisioned with access to the Temp RDS Instances. Using h-ssh you can connect like this:

h-ssh 10.1.1.165

Running the following will set 4 environment variables.

source /home/ianburden/setenv.sh

Name	Description
lms_db_password	The password for lms-prod database
h_db_password	The password for the h database
h_db_dsn	A PostgreSQL DSN for the h database
lms_db_dsn	A PostgreSQL DNS for the lms-prod database

from h.

jon-betts commented on June 12, 2024

I've written up some conclusions here:

https://github.com/hypothesis/numberwang/blob/a00019136c1fce03703b6231f5793028cabbdda5/examples/materialized_views/thoughts.md

Basically:

They give us the performance we need
They seem good for aggregations
We might want to try something else for the main annotation table
Impact on a live system is uncertain

from h.

indigobravo commented on June 12, 2024

Duplicate RDS Instance

Here are the details for the duplicate RDS service that was created. The usernames and passwords have been set to the same values as the Temp RDS Instances