AWS RDS Point In Time Recovery PITR can only be done with automated backups
All RDS restores create a new instance. On top of that if you want to do a point in time […]
Point In Time Recovery, Programming, RDS
March 2023
RDS, RPO / RTO
Using AWS RDS Export To S3 backups are created in an S3 bucket of your choosing in Parquet format
Yes, you can copy your RDS backups to S3, Using AWS RDS Export To S3 backups are created in an
RDS
AWS RDS SSL TLS certificate URL
Where on Amazon do you get their SSL certificate for RDS – well here is one place – like pulling
Mac OS, PostgreSQL
The default installation directory on Mac OS for postgresql
/Library/PostgreSQL/15 With version 15 and likely older versions there is a pg_env.sh script in this folder that can be used
PostgreSQL, RDS
One way to connect to RDS PostgreSQL without a password
This approach assumes the user has a IAM username. CREATE USER {db username}; GRANT rds_iam to {db_username}; wget https ://s3.amazonaws.com/rds-downloads/rds-
PySpark, Spark, Windows
Installing pyspark and spark 3.2 on Windows 10 or 11
HADOOP_HOME=c:\winutilsJAVA_HOME=C:\java11\jdk-11PYSPARK_PYTHON=C:\python3\python.exeSPARK_HOME=C:\Users\mike\spark\spark3-hadoop3Path=C:\Python3\Scripts;C:\Python3;c:\java11\jdk-11\bin;c:\winutils\bin;C:\Users\mike\spark\spark3-hadoop3\bin; You can add all but the “path” variable to Settings->System->About->Advance system settings -> Environment Variables -> User Variables path
Performance, Snowflake
Another option to make your Snowflake queries more efficient – save warehouse credits – note: there is a charge for using this optimization technique – Search Optimization
Search optimization is a premium product available with enterprise version of Snowflake and up. https://docs.snowflake.com/en/user-guide/search-optimization-service https://docs.snowflake.com/en/user-guide/search-optimization-service#label-search-optimization-maintenance-billing Search optimization expedites queries
Amazon AWS
The many different kinds of AWS Policies
Identity Policy – Assigned to a user group or role, can be either 1.) in-line with the identity, 2.) User
Amazon AWS, AWS CLI
If you need AWS command line creds / credentials and you are using Okta – this maybe your easiest route gimme-aws-creds
I found using gimme-aws-creds is easier to use that okta-awscli. I believe it was written by the Nike folks, To