1.ClouderaçCDHåApacheçHadoopçåºå«
ClouderaçCDHåApacheçHadoopçåºå«
ããç®åèè¨ï¼ä¸æ¶è´¹çHadoopçæ¬ä¸»è¦æä¸ä¸ª(åæ¯å½å¤åå)ï¼åå«æ¯ï¼Apache(æåå§ççæ¬ï¼ææåè¡çååºäºè¿ä¸ªçæ¬è¿è¡æ¹è¿)ãClouderaçæ¬(Clouderaâs
Distribution Including Apache Hadoopï¼ç®ç§°CDH)ãHortonworksçæ¬(Hortonworks Data
Platformï¼ç®ç§°âHDPâ)ï¼å¯¹äºå½å èè¨ï¼ç»å¤§å¤æ°éæ©CDHçæ¬ï¼CDHåApacheçæ¬ä¸»è¦åºå«å¦ä¸ï¼
ãã(1) CDH对Hadoopçæ¬çååéå¸¸æ¸ æ°ï¼åªæ两个系åççæ¬ï¼åå«æ¯cdh3åcdh4ï¼åå«å¯¹åºç¬¬ä¸ä»£Hadoop(Hadoop
1.0)å第äºä»£Hadoop(Hadoop 2.0)ï¼ç¸æ¯èè¨ï¼Apacheçæ¬åæ··ä¹±å¾å¤;æ¯Apache
hadoopå¨å ¼å®¹æ§ï¼å®å ¨æ§ï¼ç¨³å®æ§ä¸æå¢å¼ºã
ãã(2)CDH3çæ¬æ¯åºäºApache hadoop 0..2æ¹è¿çï¼å¹¶èå ¥äºææ°çpatchï¼CDH4çæ¬æ¯åºäºApache hadoop
2.Xæ¹è¿ç,引擎中国源码CDHæ»æ¯å¹¶åºç¨äºææ°Bugä¿®å¤æè FeatureçPatchï¼å¹¶æ¯Apache
hadoopååè½çæ¬ææ©åå¸ï¼æ´æ°é度æ¯Apacheå®æ¹å¿«ã
ãã(3)å®å ¨ CDHæ¯æKerberoså®å ¨è®¤è¯ï¼apache hadoopå使ç¨ç®éçç¨æ·åå¹é 认è¯
ãã(4)CDHææ¡£æ¸ æ°ï¼å¾å¤éç¨Apacheçæ¬çç¨æ·é½ä¼é 读CDHæä¾çææ¡£ï¼å æ¬å®è£ ææ¡£ãå级ææ¡£çã
ãã(5)CDHæ¯æYum/Aptå ï¼Tarå ï¼RPMå ï¼Cloudera Manageråç§æ¹å¼å®è£ ,Apache
hadoopåªæ¯æTarå å®è£ ã
ãã注ï¼CDH使ç¨æ¨èçYum/Aptå å®è£ æ¶ï¼æ以ä¸å 个好å¤ï¼ 1ãèç½å®è£ ãå级ï¼é常æ¹ä¾¿ 2ãèªå¨ä¸è½½ä¾èµè½¯ä»¶å
ãã3ãHadoopçæç³»ç»å èªå¨å¹é ï¼ä¸éè¦ä½ 寻æ¾ä¸å½åHadoopå¹é çHbaseï¼Flumeï¼Hiveç软件ï¼Yum/Aptä¼æ ¹æ®å½åå®è£ Hadoopçæ¬èªå¨å¯»æ¾å¹é çæ¬ç软件å ï¼å¹¶ä¿è¯å ¼å®¹æ§ã
ãã4ãèªå¨å建ç¸å ³ç®å½å¹¶è½¯é¾å°åéçå°æ¹(å¦confålogsçç®å½);èªå¨å建hdfs,
mapredç¨æ·ï¼hdfsç¨æ·æ¯HDFSçæé«æéç¨æ·ï¼mapredç¨æ·åè´è´£mapreduceæ§è¡è¿ç¨ä¸ç¸å ³ç®å½çæéã