Beginner

1. Install a VM of Ubuntu on PC, then install Hadoop in Ubuntu.

   • http://hadoop.apache.org/docs/r1.0.4/cn/quickstart.html

   • http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html

   • https://www.cloudera.com/developers/get-started-with-hadoop-tutorial.html

     ​

2. understand Map Reduce, and practice some “Hello World” cases, e.g. Word Count1, Word Count2, Weather Data.

   • http://hadoop.apache.org/docs/r1.0.4/cn/mapred_tutorial.html

   • http://hadoop.apache.org/docs/stable/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html

     ​

3. understand the HDFS

   • http://hadoop.apache.org/docs/r1.0.4/cn/hdfs_design.html
   • http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html
   • http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html

   ​

Junior

1. read book

   • Hadoop.The.Definitive.Guide.4th.Edition
   • Hadoop 技术内幕, HDFS & Map Reduce

   ​

Senior

1. Spark

   • https://spark.apache.org/docs/latest/
   • https://aiyanbo.gitbooks.io/spark-programming-guide-zh-cn/content/

   ​

2. Data Mining

   • https://dataminingguide.books.yourtion.com/
   • https://github.com/linyiqun/DataMiningAlgorithm