0) Essential Python

14-Oct-19

Essential Python

Resolving Imports and modules in Python

working with typestubs in python

3) Generators in Python

1-Oct-19

Generators in Python

4) On Azure subscriptions

27-Sep-19

On Azure subscriptions

Arima Models and Python

6) Cloud vendor space

18-Sep-19

Cloud vendor space

Python Pending Research/Questions

8) VSCode and python

16-Sep-19

VSCode and python

9) PySpark APIs

11-Sep-19

PySpark APIs

A Shortcut to Big Data - Lesson Plan 2, Installing Spark stand alone on windows 10: Smart Programmer Series

PySpark: PySpark on Windows 10: Installation Journal

12) Azure storage

22-Aug-19

Azure storage

Quick introduction to Spark

A Shortcut to Big Data - Lesson Plan 1, Azure and Spark: Smart Programmer Series

15) Spark on Azure

17-Aug-19

Spark on Azure

Working with Azure Cloud Shell

How to upgrade an azure VM? I have a VM in azure. As I was looking at the bill I realized it is not an RI - Reserved instance. With a reserved instance prices can be half to a third. So I wanted to convert this VM to a 3 year reserved instance. By their cost calculator that will come to about 300 dollars for 3 years.

However when I tried to upgrade the VM (They call it resize), I have realized this is an older VM and I am not able to reserve it for 3 years. So this article goes into how to find a suitable VM that can be reserved for 3 years and how do I migrate my OS disk and the data to this new VM

In addition the VHD (hard disk) I had seemed to be a nonmanaged disk. I needed to convert that to a managed disk as well. this article will go into that as well with some useful reads from microsoft azure site.

18) Azure basics

6-Aug-19

Azure basics

How is HDFS and HBase different?

20) Hive

15-Jul-19

Hive

21) Apache Pig, Grunt

15-Jul-19

Apache Pig, Grunt

What is clustered resource management and YARN?

23) Sqoop

14-Jul-19

Sqoop

24) Apache Flume

14-Jul-19

Apache Flume

What is HDInsight architecture in Azure?

26) What is AWS Athena?

13-Jul-19

What is AWS Athena?

What is equivalent to S3 in Azure?

28) Parquet format

6-May-19

Parquet format

29) AWS General

6-May-19

AWS General

Where is the schema catalogue in AWS?

31) Creating an EMR on aws

29-Apr-19

Creating an EMR on aws

32) what is AWS CLI?

29-Apr-19

what is AWS CLI?

33) putty

25-Mar-19

putty

34) AWS EC2

25-Mar-19

AWS EC2

35) First mapreduce program

21-Mar-19

First mapreduce program

36) Mapreduce

21-Mar-19

Mapreduce

37) Azure

19-Feb-19

Azure

38) Cassandra

7-Jan-19

Cassandra

39) Firebase

6-Jan-19

Firebase

40) Couchdb

6-Jan-19

Couchdb

What is the foundational Java API used to write to HDFS?

What is a hadoop edge server or node?

What is a Hadoop Cluster?

How is HDFS fault tolerant?

How do you store a big CSV file in HDFS?

46) Key Bigdata references

23-Nov-18

Key Bigdata references

What is S3? How is it different from HDFS?

49) AVRO - Schemas

16-Aug-17

AVRO - Schemas

50) Cassandra

25-Jul-17

Cassandra

Cloud, Salesforce, Amazon