This text based blog borrows from and somewhat enhances the example shown in: https://www.youtube.com/watch?v=OvSzLjkMmQo The enhancement is showing you how to create these replications in custom schemas – not just public – and some gotch’yas tips when creating multiple instances on Mac OS. Regardless many thanks to the folks that created the YouTube above, it …
PostgreSQL Logical Replication (on a MacBook) example POC Read More »
https://repost.aws/knowledge-center/glue-crawler-detect-schema important: https://docs.aws.amazon.com/glue/latest/dg/crawler-configuration.html#crawler-grouping-policy (copied from the transient link above) When you run your AWS Glue crawler, the crawler does the following: Classifies the data Groups the data into tables or partitions Writes metadata to the AWS Glue Data Catalog Review the following to learn what happens when you run the crawler and how the crawler …
need to audit connections, DDL, DML, permissions/grant changes and a lot more? set the following parameter in your custom parameter group file: Parameter Name: server_audit_events For more info: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/AuroraMySQL.Auditing.html
select * from v$diag_info; The Oracle alert log can be found in the same sub-directory as Default Trace File which usually ends in …/trace/alert_.log
Note: this was done using the “postgres” superuser, granting this kind of access to a non-superuser requires additional steps / permissions Note: setting up cross database access requires setup on the “target” side, and does require that you specify a “user_mapping” that has/knows the credentials back on the source side — ***** create foreign data …
Remote views – or – postgresql to postgresql cross database copy / SQL access Read More »
keep in mind, if you are running postgresql on ads, this video may not apply. Also note at around the 28 / 30 minute mark of the YouTube video above the author discusses How to Manage Transaction ID wrap around – with AUTOVACUUM_FREEZE_MAX_AGE The video above only applies to self-managed postgresql (for example, on-prem, or …
The best YouTube video on detailed tuning of autovacuum Read More »
http://www.pgbouncer.org/
The following query will show you. select setting from pg_settings where name = ‘data_directory’;
https://computingforgeeks.com/how-to-install-apache-spark-on-ubuntu-debian/ and a quick link to the apache spark docs for the spark 3.3 https://spark.apache.org/docs/3.3.0/
The really nice feature of Snowflake’s materialized views is that they are automatically kept in sync with their underlying SQL. Snowflake is doing this in the background for us. And even if it has not been done yet, Snowflake realizes that from you SQL query, and as quickly as possible updates the MV and uses …
Snowflake – Materialized Views – Limits and one huge advantage Read More »