Working with Hadoop using python

Install hadoop on mac (remember to check hadoop version): https://towardsdatascience.com/installing-hadoop-on-a-mac-ec01c67b003c

Map reduce using python (word count problem): https://www.michael-noll.com/tutorials/writing-an-hadoop-mapreduce-program-in-python/

Python MapReduce Code

The “trick” behind the following Python code is that we will use the Hadoop Streaming API (see also the corresponding wiki entry) for helping us passing data…

Installing pip for Python 3

Ubuntu 18.04 ships with Python 3, as the default Python installation. Complete the following steps to install pip () for Python 3:

  1. Start by updating the package list using the following command:

2. Use the following command to install pip for Python 3:

Saksham Lakhera

Exploring and Analysing life with all my tech and soft skills.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store