Month: September 2018

Verizon’s secret $40 unlimited plan is now available to everyone – you just need an iPhone

https://www.yahoo.com/tech/verizon-secret-40-unlimited-plan-now-available-everyone-182849186.html originally posted on bar.com Earlier this year, it emerged that Verizon is very stealthily funding a company called Visible, which is offering a slightly different kind of wireless service. Once you sign up — which happens through an app, rather than in-store or over the phone — you get a slightly restricted unlimited plan …

Verizon’s secret $40 unlimited plan is now available to everyone – you just need an iPhone Read More »

Redshift and PostgreSQL Schemas Versus Owners

Coming from an Oracle background where schemas are roughly equivalent to owners the important differences between users, owners, and schemas / users, can be slightly confusing when dealing with Redshift or PostgreSQL (Redshift was forked from PostgreSQL 8.x) and uses the same concepts as PostgreSQL when it comes to Owners, Users, and Schemas (to my …

Redshift and PostgreSQL Schemas Versus Owners Read More »

Redshift create plain user, superuser, createdb user etc…

select * from pg_user_info where usename like ‘mcost%’; create user mcost with createuser password ‘1234Mike’; create user mcost1 with password ‘1234Mike’; create user mcostr2 with createuser password ‘MCostr123’; create user mcostr3 with createdb password ‘MCostr123’; create user mcostr4 with createdb createuser password ‘MCostr123’;

Big Data Blog Posts That I Found Interesting – I am sure there are many others

Best Of Amazon AWS Big Data Blog https://aws.amazon.com/blogs/big-data/orchestrate-multiple-etl-jobs-using-aws-step-functions-and-aws-lambda/ https://github.com/aws-samples/aws-etl-orchestrator https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/best-practices.html#organizingstacks https://aws.amazon.com/blogs/big-data/build-a-data-lake-foundation-with-aws-glue-and-amazon-s3/ https://aws.amazon.com/blogs/big-data/orchestrate-apache-spark-applications-using-aws-step-functions-and-apache-livy/

psql to the rescue – a client program for postgreSQL or Redshift

Here are SOME links to some psql features: http://www.postgresqltutorial.com/psql-commands/ http://www.postgresqltutorial.com/postgresql-list-users/ http://www.postgresqltutorial.com/postgresql-describe-table/ The most current PostgreSQL docs. as of 09/10/2018 – see appendix VI page 1793 for psql # start psql – and connect to a running redshift instance – the ‘-f small_data_load.sql” is optional to run the script – omit “-f file” to simply connect …

psql to the rescue – a client program for postgreSQL or Redshift Read More »

Preparing For The Amazon AWS Big Data Specialty Certification Test

Here is some of the material I used to prepare for the Amazon AWS Big Data Specialty Certification test Lets Start With A Hadoop 2.0 Very High Level Diagram Note: Spark, Tez and other Big Data products can and do use some Hadoop 2.0 components like YARN, HDFS2 and replace other components like MapReduce.  Hadoop …

Preparing For The Amazon AWS Big Data Specialty Certification Test Read More »

installing scala on RHEL 7 or clones and do we really need this with Spark? No!

# you can install this Scala anywhere – but I install it with sudo / root wget https://www.scala-lang.org/files/archive/scala-2.13.0-M5.tgz sudo tar xzvf scala-2.13.0-M5.tgz sudo mv scala-2.13.0-M5.tgz scala213 alternatives –install /usr/bin/scala scala /opt/hadoop/scala213 1 # just verify where it is and that there are no other versions – at least that alternatives can see alternatives –config scala  There is …

installing scala on RHEL 7 or clones and do we really need this with Spark? No! Read More »