"What if? Why not? Challenge the Convention! Let's do some incredible things!"
Pro Android 4
Our Android Books
Stuff I used to do
Download OSCON 2004 Presentation
A Shortcut to Big Data - Lesson Plan 1, Azure and Spark: Smart Programmer Series
A Shortcut to Big Data - Lesson Plan 2, Installing Spark stand alone on windows 10: Smart Programmer Series
Apache Pig, Grunt
Arima Models and Python
AVRO - Schemas
Cloud vendor space
Cloud, Salesforce, Amazon
Creating an EMR on aws
First mapreduce program
Generators in Python
How do you store a big CSV file in HDFS?
How is HDFS and HBase different?
How is HDFS fault tolerant?
How to upgrade an azure VM? I have a VM in azure. As I was looking at the bill I realized it is not an RI - Reserved instance. With a reserved instance prices can be half to a third. So I wanted to convert this VM to a 3 year reserved instance. By their cost calculator that will come to about 300 dollars for 3 years.
However when I tried to upgrade the VM (They call it resize), I have realized this is an older VM and I am not able to reserve it for 3 years. So this article goes into how to find a suitable VM that can be reserved for 3 years and how do I migrate my OS disk and the data to this new VM
In addition the VHD (hard disk) I had seemed to be a nonmanaged disk. I needed to convert that to a managed disk as well. this article will go into that as well with some useful reads from microsoft azure site.
Key Bigdata references
On Azure subscriptions
PySpark: PySpark on Windows 10: Installation Journal
Python Pending Research/Questions
Quick introduction to Spark
Resolving Imports and modules in Python
Spark on Azure
VSCode and python
What is a Hadoop Cluster?
What is a hadoop edge server or node?
What is AWS Athena?
what is AWS CLI?
What is clustered resource management and YARN?
What is equivalent to S3 in Azure?
What is HDInsight architecture in Azure?
What is S3? How is it different from HDFS?
What is the foundational Java API used to write to HDFS?
Where is the schema catalogue in AWS?
Working with Azure Cloud Shell
working with typestubs in python
Sort by Date
Sort by Name
My Web Logs
Made possible by