aws-samples / amazon-rds-and-amazon-aurora-logging-blog Goto Github PK

There is an very old issue that amazon haven't fixed for years now. If you have strange symbol(binary) in the logs download breaks. It is an issue with boto3 rds client, and for me is happening all the time. Error looks like that:

An error occurred (InvalidParameterValue) when calling the DownloadDBLogFilePortion operation: This file contains binary data and should be downloaded instead of viewed.

I just tried your script get_pg_log_files.sh and I get the same.

When executing
SELECT * FROM logs.postgres_logs;
got an error

ERROR:  literal carriage return found in data
HINT:  Use "\r" to represent carriage return.
CONTEXT:  COPY postgres_logs_20210322_0900, line 20

Postgres AWS RDS
select version();
PostgreSQL 11.10 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-11), 64-bit

Engine version: 11.13
Error:
ERROR: function public.list_postgres_log_files() does not exist
LINE 1: SELECT file_name FROM public.list_postgres_log_files() WHERE...
^
HINT: No function matches the given name and argument types. You might need to add explicit type casts.
QUERY: SELECT file_name FROM public.list_postgres_log_files() WHERE file_name LIKE '%.csv' ORDER BY 1 DESC
CONTEXT: PL/pgSQL function load_postgres_log_files(text,text,boolean) line 56 at FOR over EXECUTE statement

I know the documentation says you need v12 for PostGres, but is that for this Function to work as well? or just to enable pg_cron?
https://aws.amazon.com/blogs/database/automate-postgresql-log-exports-to-amazon-s3-using-extensions/
Really not sure what enables this function, the documentation doesn't suggest that we create this function too.