title
How to Install Hadoop on Windows 10 | Easy Steps to Install Hadoop | Hadoop Tutorial | Edureka

description
๐Ÿ”ฅEdureka Big Data Hadoop Certification Training (Use Code "๐˜๐Ž๐”๐“๐”๐๐„๐Ÿ๐ŸŽ") - https://www.edureka.co/big-data-hadoop-training-certification This Edureka video on "How to install Hadoop in Windows 10?" will provide you with detailed knowledge about the installation procedure of Hadoop in Windows 10. Prerequisites to install Hadoop in Windows Setting Environment variables Hadoop Configuration ***Important links*** ๐Ÿ”นJava 8 Link: https://www.oracle.com/java/technologies/javase-jdk8-downloads.html#license-lightbox ๐Ÿ”นHadoop download Homepage: https://hadoop.apache.org/releases.html ๐Ÿ”นHadoop 4 important xml files: https://drive.google.com/file/d/16vu5C4-bRQKVeDRgx1S8jRBEmg1UbLqE/view?usp=sharing ๐Ÿ”นUpdated Hadoop \bin Configuration File: https://drive.google.com/file/d/1AMqV4F5ybPF4ab4CeK8B3AsjdGtQCdvy/view Check our complete Hadoop Blog Series: http://bit.ly/2wO8l0y Check our complete Hadoop playlist here: https://youtu.be/zez2Tv-bcXY To subscribe to our channel and hit the bell icon to never miss an update from us in the future: https://goo.gl/6ohpTV #Edureka #EdurekaHadoop #HadoopInstallation #Hadoop2020 #installhadoopinwindows10 #hadoopwindows ---------------------------------------------------------------------------------------------------------- *** Big Data Podcast - https://castbox.fm/channel/id1814029 *** Instagram: https://www.instagram.com/edureka_learning Slideshare: https://www.slideshare.net/EdurekaIN/ Facebook: https://www.facebook.com/edurekaIN/ Twitter: https://twitter.com/edurekain LinkedIn: https://www.linkedin.com/company/edureka #edureka #hadoopedureka #installhadoop # ---------------------------------------------------------------------------------------------------------- About the Course: Edureka's Big Data Hadoop Training Course is curated by Hadoop industry experts, and it covers in-depth knowledge on Big Data and Hadoop Ecosystem tools such as HDFS, YARN, MapReduce, Hive, Pig, HBase, Spark, Oozie, Flume and Sqoop. Throughout this online instructor-led Hadoop Training, you will be working on real-life industry use cases in Retail, Social Media, Aviation, Tourism and Finance domain using Edureka's Cloud Lab. ---------------------------------------------------------------------------------------------------------- What are the skills that you will be learning with our Big Data Hadoop Certification Training? Big Data Hadoop Certification Training will help you to become a Big Data expert. It will hone your skills by offering you comprehensive knowledge on Hadoop framework, and the required hands-on experience for solving real-time industry-based Big Data projects. During Big Data & Hadoop course you will be trained by our expert instructors to: Master the concepts of HDFS (Hadoop Distributed File System), YARN (Yet Another Resource Negotiator), & understand how to work with Hadoop storage & resource management. Understand MapReduce Framework Implement complex business solution using MapReduce Learn data ingestion techniques using Sqoop and Flume Perform ETL operations & data analytics using Pig and Hive Implementing Partitioning, Bucketing and Indexing in Hive Understand HBase, i.e a NoSQL Database in Hadoop, HBase Architecture & Mechanisms Integrate HBase with Hive Schedule jobs using Oozie Implement best practices for Hadoop development Understand Apache Spark and its Ecosystem Learn how to work with RDD in Apache Spark Work on real-world Big Data Analytics Project Work on a real-time Hadoop cluster ---------------------------------------------------------------------------------------------------------- How will Big Data and Hadoop Training help your career? The below predictions will help you in understanding the growth of Big Data: Hadoop Market is expected to reach $99.31B by 2022 at a CAGR of 42.1% -Forbes McKinsey predicts that by 2018 there will be a shortage of 1.5M data experts Average Salary of Big Data Hadoop Developers is $97k Organisations are showing interest in Big Data and are adopting Hadoop to store & analyse it. Hence, the demand for jobs in Big Data and Hadoop is also rising rapidly. If you are interested in pursuing a career in this field, now is the right time to get started with online Hadoop Training. ---------------------------------------------------------------------------------------------------------- For more information, please write back to us at sales@edureka.in or call us at: IND: 9606058406 / US: 18338555775 (toll free)

detail
{'title': 'How to Install Hadoop on Windows 10 | Easy Steps to Install Hadoop | Hadoop Tutorial | Edureka', 'heatmap': [{'end': 280.694, 'start': 205.05, 'weight': 0.8}, {'end': 365.354, 'start': 347.9, 'weight': 0.711}, {'end': 451.104, 'start': 410.481, 'weight': 0.811}, {'end': 521.375, 'start': 498.182, 'weight': 0.705}, {'end': 714.445, 'start': 687.964, 'weight': 0.777}, {'end': 754.081, 'start': 718.006, 'weight': 0.802}, {'end': 886.923, 'start': 858.699, 'weight': 0.735}, {'end': 915.114, 'start': 889.765, 'weight': 0.805}], 'summary': 'Learn to install hadoop on windows 10 with an emphasis on prerequisites like java version 8, download process of java 8 and hadoop, selection of stable hadoop version, installation of jdk 8, java 1.8, and hadoop 3.1, configuring hadoop environment with java home and hadoop home, and ensuring proper functioning of hadoop.', 'chapters': [{'end': 205.05, 'segs': [{'end': 73.232, 'src': 'embed', 'start': 46.51, 'weight': 0, 'content': [{'end': 51.013, 'text': 'the Hadoop version that we are going to download and install in our system and the procedure.', 'start': 46.51, 'duration': 4.503}, {'end': 58.217, 'text': "Let's quickly begin with the prerequisites the prerequisites to install Hadoop in Windows operating system are Java.", 'start': 51.633, 'duration': 6.584}, {'end': 63.56, 'text': 'So we all know that Hadoop supports only Java version 8.', 'start': 58.677, 'duration': 4.883}, {'end': 69.51, 'text': 'So, firstly we need to download Java 8 version, followed by that a latest Hadoop version,', 'start': 63.56, 'duration': 5.95}, {'end': 73.232, 'text': 'which we need for our operating system than the configuration files.', 'start': 69.51, 'duration': 3.722}], 'summary': 'To install hadoop on windows, java 8 is required alongside the latest hadoop version.', 'duration': 26.722, 'max_score': 46.51, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s46510.jpg'}, {'end': 205.05, 'src': 'embed', 'start': 139.903, 'weight': 2, 'content': [{'end': 145.105, 'text': 'So this particular webpage belongs to Apache organization where we can download Hadoop for free.', 'start': 139.903, 'duration': 5.202}, {'end': 151.244, 'text': 'So these are the various versions available for Hadoop, which are 2.10 3.1.', 'start': 145.774, 'duration': 5.47}, {'end': 151.638, 'text': '3 3.2.', 'start': 151.244, 'duration': 0.394}, {'end': 152.616, 'text': '1 and many more.', 'start': 151.638, 'duration': 0.978}, {'end': 155.957, 'text': 'So we shall select the latest version of Hadoop.', 'start': 153.216, 'duration': 2.741}, {'end': 159.338, 'text': "But while you're selecting the latest version of Hadoop,", 'start': 156.497, 'duration': 2.841}, {'end': 164, 'text': "please make sure that you're not actually downloading the exact latest version of Hadoop here.", 'start': 159.338, 'duration': 4.662}, {'end': 166.643, 'text': 'You can see we have three different versions 3.1.', 'start': 164.42, 'duration': 2.223}, {'end': 166.809, 'text': '3 3.2.', 'start': 166.643, 'duration': 0.166}, {'end': 166.976, 'text': '1 3.1.', 'start': 166.809, 'duration': 0.167}, {'end': 167.611, 'text': '2 as you can see 3.2.', 'start': 166.976, 'duration': 0.635}, {'end': 179.284, 'text': '1 is the latest version we have to select the version which is earlier to it, which is 3.1.', 'start': 167.611, 'duration': 11.673}, {'end': 183.127, 'text': '3 because this particular version will be the stable version.', 'start': 179.284, 'duration': 3.843}, {'end': 185.989, 'text': 'Now we shall move ahead and select binary.', 'start': 183.748, 'duration': 2.241}, {'end': 192.495, 'text': 'Once you select binary, you will be redirected into a new web page where you will have a mirror link.', 'start': 186.71, 'duration': 5.785}, {'end': 198.8, 'text': 'select that mirror link and your Hadoop will be downloaded for your local system, as you can see Hadoop 3.1..', 'start': 192.495, 'duration': 6.305}, {'end': 200.722, 'text': '3 tar.gz is getting downloaded.', 'start': 198.8, 'duration': 1.922}, {'end': 205.05, 'text': 'Now here you can see I have successfully downloaded Hadoop version 3.1.', 'start': 201.727, 'duration': 3.323}], 'summary': "Apache's webpage offers free hadoop downloads; latest version 3.2.1, but 3.1.3 recommended for stability.", 'duration': 65.147, 'max_score': 139.903, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s139903.jpg'}], 'start': 11.496, 'title': 'Installing and downloading hadoop on windows 10', 'summary': 'Provides a comprehensive guide on installing hadoop in windows 10, emphasizing the prerequisites, such as java version 8, and demonstrates the process of downloading and installing java 8 and hadoop. it also covers the process of downloading hadoop from the apache website, highlighting the availability of versions such as 2.10, 3.1.3, and 3.2.1, and emphasizes the selection of a stable version, ultimately resulting in the successful download of hadoop version 3.1.', 'chapters': [{'end': 139.163, 'start': 11.496, 'title': 'Installing hadoop on windows 10', 'summary': 'Provides a guide on installing hadoop in windows 10, emphasizing the prerequisites including java version 8, and the process of downloading and installing java 8 and hadoop while demonstrating the download process.', 'duration': 127.667, 'highlights': ['The prerequisites to install Hadoop in Windows operating system are Java version 8, followed by the latest Hadoop version and the configuration files. The chapter emphasizes the prerequisites for installing Hadoop in Windows, highlighting the importance of Java version 8 and the necessary configuration files.', "The process includes downloading Java 8 version and the latest Hadoop version compatible with Windows, demonstrating the download process from Oracle's website. The detailed process of downloading Java 8 and the latest Hadoop version compatible with Windows is demonstrated, including the steps to download Java 8 from Oracle's website.", "The video encourages viewers to subscribe to Edureka's YouTube channel and offers an online certification in Hadoop with a link provided in the description box. The video encourages viewers to subscribe to Edureka's YouTube channel and offers an online certification in Hadoop with a link provided in the description box."]}, {'end': 205.05, 'start': 139.903, 'title': 'Downloading hadoop from apache', 'summary': 'Covers the process of downloading hadoop from the apache website, highlighting the availability of hadoop versions such as 2.10, 3.1.3, and 3.2.1, and emphasizes the selection of a stable version, ultimately resulting in the successful download of hadoop version 3.1.', 'duration': 65.147, 'highlights': ['The process involves selecting the latest stable version of Hadoop, which, in this case, is highlighted as version 3.1.3, and then proceeding to select the binary option for download.', 'The available versions of Hadoop mentioned are 2.10, 3.1.3, and 3.2.1, indicating the range of options provided by the Apache organization for downloading Hadoop.', 'The successful download of Hadoop version 3.1 is demonstrated, indicating the completion of the download process for the selected stable version.']}], 'duration': 193.554, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s11496.jpg', 'highlights': ['The prerequisites to install Hadoop in Windows are Java version 8 and the latest Hadoop version.', 'The detailed process of downloading Java 8 and the latest Hadoop version compatible with Windows is demonstrated.', 'The process involves selecting the latest stable version of Hadoop, highlighted as version 3.1.3, and then proceeding to select the binary option for download.', 'The available versions of Hadoop mentioned are 2.10, 3.1.3, and 3.2.1, indicating the range of options provided by the Apache organization for downloading Hadoop.', 'The successful download of Hadoop version 3.1 is demonstrated, indicating the completion of the download process for the selected stable version.']}, {'end': 676.658, 'segs': [{'end': 280.694, 'src': 'heatmap', 'start': 205.05, 'weight': 0.8, 'content': [{'end': 212.455, 'text': '3 tar file as well as JDK 8 and those two files are successfully moved into my C drive.', 'start': 205.05, 'duration': 7.405}, {'end': 219.58, 'text': "Now, let's install Java first now make sure you that you create a new folder for Java.", 'start': 213.216, 'duration': 6.364}, {'end': 230.609, 'text': 'So select change and here select Windows C drive then select make new folder now rename this new folder as Java click.', 'start': 220.041, 'duration': 10.568}, {'end': 237.052, 'text': 'Okay and now select next you can see the installation procedure has now been started.', 'start': 230.829, 'duration': 6.223}, {'end': 241.536, 'text': 'You can see Java development kit.', 'start': 239.274, 'duration': 2.262}, {'end': 243.478, 'text': 'It has been successfully installed.', 'start': 241.696, 'duration': 1.782}, {'end': 249.524, 'text': 'Now we shall enter into program files and move our JDK into Java file,', 'start': 244.339, 'duration': 5.185}, {'end': 254.889, 'text': 'because sometimes there will be an error while we set environment variables for Java.', 'start': 249.524, 'duration': 5.365}, {'end': 258.101, 'text': 'So you can see inside program files.', 'start': 256.041, 'duration': 2.06}, {'end': 260.063, 'text': 'We have another folder called Java.', 'start': 258.182, 'duration': 1.881}, {'end': 263.305, 'text': 'So inside Java there you have our JDK.', 'start': 260.583, 'duration': 2.722}, {'end': 271.469, 'text': "So now what I'll be doing is just moving this JDK into Java file, which we have created in C Drive this one.", 'start': 263.705, 'duration': 7.764}, {'end': 280.694, 'text': "Now you can just delete this Java file from your program files so that you don't have to mess with duplication of Java file.", 'start': 274.191, 'duration': 6.503}], 'summary': 'Successfully installed jdk 8 in c drive, moved to java folder, and deleted duplicate folder.', 'duration': 75.644, 'max_score': 205.05, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s205050.jpg'}, {'end': 271.469, 'src': 'embed', 'start': 239.274, 'weight': 1, 'content': [{'end': 241.536, 'text': 'You can see Java development kit.', 'start': 239.274, 'duration': 2.262}, {'end': 243.478, 'text': 'It has been successfully installed.', 'start': 241.696, 'duration': 1.782}, {'end': 249.524, 'text': 'Now we shall enter into program files and move our JDK into Java file,', 'start': 244.339, 'duration': 5.185}, {'end': 254.889, 'text': 'because sometimes there will be an error while we set environment variables for Java.', 'start': 249.524, 'duration': 5.365}, {'end': 258.101, 'text': 'So you can see inside program files.', 'start': 256.041, 'duration': 2.06}, {'end': 260.063, 'text': 'We have another folder called Java.', 'start': 258.182, 'duration': 1.881}, {'end': 263.305, 'text': 'So inside Java there you have our JDK.', 'start': 260.583, 'duration': 2.722}, {'end': 271.469, 'text': "So now what I'll be doing is just moving this JDK into Java file, which we have created in C Drive this one.", 'start': 263.705, 'duration': 7.764}], 'summary': 'Successfully installed java development kit and moved it to the designated java folder in the c drive.', 'duration': 32.195, 'max_score': 239.274, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s239274.jpg'}, {'end': 342.796, 'src': 'embed', 'start': 312.829, 'weight': 2, 'content': [{'end': 325.491, 'text': 'You need to set the Java home as well as path for Java now select new and here just type in Java home and here let us add the location of JDK bin.', 'start': 312.829, 'duration': 12.662}, {'end': 330.702, 'text': 'So here we will add in the variable value that is the JD King bin location.', 'start': 326.34, 'duration': 4.362}, {'end': 334.985, 'text': 'So our JDK bin location is in the C Drive and inside the C Drive.', 'start': 331.343, 'duration': 3.642}, {'end': 337.986, 'text': 'We have the Java folder and inside Java folder.', 'start': 335.005, 'duration': 2.981}, {'end': 340.251, 'text': 'We have our JDK 1.8.', 'start': 338.307, 'duration': 1.944}, {'end': 342.796, 'text': '0 and inside JDK file.', 'start': 340.251, 'duration': 2.545}], 'summary': 'Set java home and path by adding jdk bin location in variable value.', 'duration': 29.967, 'max_score': 312.829, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s312829.jpg'}, {'end': 370.478, 'src': 'heatmap', 'start': 347.9, 'weight': 0.711, 'content': [{'end': 357.228, 'text': 'Okay, and then now move into the next dialog box, which is the system variables, and inside that select path and select edit.', 'start': 347.9, 'duration': 9.328}, {'end': 365.354, 'text': 'here create a new path variable, which will be the JDK path, the same location, that is the bin of JDK, select.', 'start': 357.228, 'duration': 8.126}, {'end': 370.478, 'text': 'Okay, and now select okay again and now okay and close it.', 'start': 365.494, 'duration': 4.984}], 'summary': 'Add jdk path to system variables for configuration.', 'duration': 22.578, 'max_score': 347.9, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s347900.jpg'}, {'end': 455.087, 'src': 'heatmap', 'start': 394.918, 'weight': 3, 'content': [{'end': 396.98, 'text': 'so you can see Java is working just fine.', 'start': 394.918, 'duration': 2.062}, {'end': 400.704, 'text': 'Now Let us check the version of our Java installed into our local system.', 'start': 397.3, 'duration': 3.404}, {'end': 409.873, 'text': 'So this can be checked by typing in Java space hyphen version so you can see we have 1.8 version which is running in our local system.', 'start': 401.184, 'duration': 8.689}, {'end': 413.322, 'text': 'Now that we have successfully installed Java into our local system.', 'start': 410.481, 'duration': 2.841}, {'end': 416.523, 'text': 'Let us now move ahead and install Hadoop into a local system.', 'start': 413.702, 'duration': 2.821}, {'end': 420.444, 'text': 'You can see that we have downloaded the top version of Hadoop.', 'start': 417.363, 'duration': 3.081}, {'end': 423.044, 'text': 'So for that we need to extract it first.', 'start': 420.784, 'duration': 2.26}, {'end': 431.426, 'text': 'Now you can see that the process of extraction has been completely finished that is hundred person, but you have three errors.', 'start': 425.405, 'duration': 6.021}, {'end': 435.527, 'text': 'You can ignore these errors now just close the extracting process.', 'start': 431.827, 'duration': 3.7}, {'end': 437.428, 'text': 'Then you have your Hadoop file.', 'start': 436.128, 'duration': 1.3}, {'end': 443.158, 'text': 'Now, let us rename a Hadoop 3.1.', 'start': 440.416, 'duration': 2.742}, {'end': 448.783, 'text': '3 as just Hadoop to reduce the confusion now that we have successfully extracted Hadoop.', 'start': 443.158, 'duration': 5.625}, {'end': 451.104, 'text': "Let's set environment variables for Hadoop.", 'start': 449.163, 'duration': 1.941}, {'end': 455.087, 'text': "But before that let's set the configuration of Hadoop.", 'start': 451.705, 'duration': 3.382}], 'summary': 'Java 1.8 installed, hadoop 3.1.3 extracted and configured successfully.', 'duration': 60.169, 'max_score': 394.918, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s394918.jpg'}, {'end': 497.541, 'src': 'embed', 'start': 467.136, 'weight': 0, 'content': [{'end': 471.279, 'text': 'So out of these all folders, we have four important folders.', 'start': 467.136, 'duration': 4.143}, {'end': 478.726, 'text': 'They are core site.xml then HDFS site.xml followed by HDFS.', 'start': 471.819, 'duration': 6.907}, {'end': 485.511, 'text': 'We have another one which is mapperit site.xml and lastly the yarn site.xml file.', 'start': 478.946, 'duration': 6.565}, {'end': 493.618, 'text': 'So we need to edit all these four different files and once after we edit these four files, we need to edit one last file,', 'start': 486.112, 'duration': 7.506}, {'end': 497.541, 'text': 'which is the Hadoop ENV Windows command prompt file.', 'start': 493.618, 'duration': 3.923}], 'summary': 'There are four important folders: core site.xml, hdfs site.xml, mapperit site.xml, and yarn site.xml. these need to be edited, along with the hadoop env windows command prompt file.', 'duration': 30.405, 'max_score': 467.136, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s467136.jpg'}, {'end': 525.279, 'src': 'heatmap', 'start': 498.182, 'weight': 0.705, 'content': [{'end': 501.805, 'text': "So here you're just going to add in the Java home location.", 'start': 498.182, 'duration': 3.623}, {'end': 505.14, 'text': "Now, let's quickly edit all those four files.", 'start': 502.478, 'duration': 2.662}, {'end': 511.266, 'text': 'So we have successfully open our four important files, which are course I dot XML.', 'start': 505.801, 'duration': 5.465}, {'end': 512.527, 'text': 'MapReduce site dot.', 'start': 511.266, 'duration': 1.261}, {'end': 514.008, 'text': 'XML. yarn site dot.', 'start': 512.527, 'duration': 1.481}, {'end': 515.809, 'text': 'XML. HDFS site dot.', 'start': 514.008, 'duration': 1.801}, {'end': 521.375, 'text': 'XML, followed by the four important files, the last file, which is the Hadoop environment dot.', 'start': 515.809, 'duration': 5.566}, {'end': 522.676, 'text': 'cmd file here.', 'start': 521.375, 'duration': 1.301}, {'end': 525.279, 'text': 'We are going to set this Java home location.', 'start': 523.037, 'duration': 2.242}], 'summary': 'Editing four important files to set java home location for hadoop environment.', 'duration': 27.097, 'max_score': 498.182, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s498182.jpg'}, {'end': 628.079, 'src': 'embed', 'start': 598.752, 'weight': 4, 'content': [{'end': 601.154, 'text': 'This is Hadoop and inside this Hadoop file.', 'start': 598.752, 'duration': 2.402}, {'end': 605.637, 'text': 'You need to create a new folder with the name data inside data.', 'start': 601.194, 'duration': 4.443}, {'end': 610.84, 'text': 'You need to create two more new files, which are data node and name node.', 'start': 606.017, 'duration': 4.823}, {'end': 617.551, 'text': 'So the first folder will be name node and now another folder which will be our data node.', 'start': 611.28, 'duration': 6.271}, {'end': 622.915, 'text': "So now let's copy the location of data node and name node.", 'start': 618.972, 'duration': 3.943}, {'end': 628.079, 'text': 'So this location is the data node location and followed by that the name node location.', 'start': 623.335, 'duration': 4.744}], 'summary': "Create new folder 'data' inside hadoop, with files for data node and name node.", 'duration': 29.327, 'max_score': 598.752, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s598752.jpg'}], 'start': 205.05, 'title': 'Installing jdk, java, and hadoop', 'summary': 'Covers the installation of jdk 8, java 1.8, and hadoop 3.1 on a local system, including setting environment variables and editing configuration files for hadoop, ensuring a smooth installation process and avoiding file duplication.', 'chapters': [{'end': 370.478, 'start': 205.05, 'title': 'Installing jdk and setting environment variables for java', 'summary': "Explains the process of installing jdk 8 on the c drive, moving it into a new 'java' folder, and setting the environment variables, ensuring a smooth installation procedure and avoiding duplication of files.", 'duration': 165.428, 'highlights': ["The chapter explains the process of installing JDK 8 on the C drive, moving it into a new 'Java' folder, and setting the environment variables, ensuring a smooth installation procedure and avoiding duplication of files.", "The installation procedure for Java development kit (JDK) 8 is detailed, with emphasis on creating a new 'Java' folder and moving the JDK into it, preventing potential errors related to setting environment variables.", 'Instructions are provided for setting the Java home and path for Java, including adding the location of JDK bin, ensuring the correct configuration for the environment variables.']}, {'end': 676.658, 'start': 371.767, 'title': 'Installing java and hadoop on local system', 'summary': 'Discusses the successful installation of java 1.8 and hadoop 3.1 on a local system, including setting up environment variables and editing configuration files for hadoop, with a focus on core site.xml, hdfs site.xml, mapperit site.xml, yarn site.xml, and hadoop env windows command prompt file.', 'duration': 304.891, 'highlights': ['The chapter discusses the successful installation of Java 1.8 and Hadoop 3.1 on a local system, including setting up environment variables and editing configuration files for Hadoop, with a focus on core site.xml, HDFS site.xml, mapperit site.xml, yarn site.xml, and Hadoop ENV Windows command prompt file.', 'Java 1.8 version is confirmed to be running on the local system, and the successful installation of Hadoop 3.1 is demonstrated, despite encountering three errors during the extraction process.', 'Detailed steps for editing the configuration files for Hadoop, including core site.xml, MapReduce site.xml, yarn site.xml, and HDFS site.xml, are provided, with specific instructions on adding properties and setting values.', "Instructions for creating new folders and files within the Hadoop location, such as creating a 'data' folder and 'name node' and 'data node' files, are outlined, along with copying their respective locations and editing the HDFS site.xml configuration file accordingly."]}], 'duration': 471.608, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s205050.jpg', 'highlights': ['The chapter discusses the successful installation of Java 1.8 and Hadoop 3.1 on a local system, including setting up environment variables and editing configuration files for Hadoop, with a focus on core site.xml, HDFS site.xml, mapperit site.xml, yarn site.xml, and Hadoop ENV Windows command prompt file.', "The installation procedure for Java development kit (JDK) 8 is detailed, with emphasis on creating a new 'Java' folder and moving the JDK into it, preventing potential errors related to setting environment variables.", 'Instructions for setting the Java home and path for Java, including adding the location of JDK bin, ensuring the correct configuration for the environment variables.', 'Java 1.8 version is confirmed to be running on the local system, and the successful installation of Hadoop 3.1 is demonstrated, despite encountering three errors during the extraction process.', "Instructions for creating new folders and files within the Hadoop location, such as creating a 'data' folder and 'name node' and 'data node' files, are outlined, along with copying their respective locations and editing the HDFS site.xml configuration file accordingly."]}, {'end': 946.717, 'segs': [{'end': 714.445, 'src': 'heatmap', 'start': 687.964, 'weight': 0.777, 'content': [{'end': 693.087, 'text': "Let's get back to Hadoop ENV dot CMD file and edit the Java home location.", 'start': 687.964, 'duration': 5.123}, {'end': 698.31, 'text': "So for safer side, let's get back to environment variables and get our JDK location.", 'start': 693.767, 'duration': 4.543}, {'end': 704.92, 'text': 'So this particular location is the location for Java home.', 'start': 702.039, 'duration': 2.881}, {'end': 707.481, 'text': 'We might want to remove the bin over here.', 'start': 705.661, 'duration': 1.82}, {'end': 714.445, 'text': 'So only see Java JDK is enough to set the Java home into our hadoopenv.cmd file.', 'start': 707.702, 'duration': 6.743}], 'summary': 'Edit java home location in hadoop env dot cmd file by getting jdk location and removing bin.', 'duration': 26.481, 'max_score': 687.964, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s687964.jpg'}, {'end': 754.081, 'src': 'heatmap', 'start': 718.006, 'weight': 0.802, 'content': [{'end': 720.587, 'text': 'So all the important files have been now successfully edited.', 'start': 718.006, 'duration': 2.581}, {'end': 724.549, 'text': "Now, let's go back to environment variables and set home and path for Hadoop.", 'start': 720.927, 'duration': 3.622}, {'end': 728.871, 'text': 'Now select new and write in Hadoop home.', 'start': 726.21, 'duration': 2.661}, {'end': 738.794, 'text': 'So this particular location that is see Hadoop when is the location for Hadoop home now select.', 'start': 732.571, 'duration': 6.223}, {'end': 745.157, 'text': "Okay Now, let's get back to path and set path for Hadoop files in here.", 'start': 738.954, 'duration': 6.203}, {'end': 754.081, 'text': "Let's set up a new path variable that is Hadoop bin and now remember to create another path variable that is your S pin.", 'start': 745.637, 'duration': 8.444}], 'summary': 'Successfully edited important files and set hadoop environment variables with new paths.', 'duration': 36.075, 'max_score': 718.006, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s718006.jpg'}, {'end': 762.025, 'src': 'embed', 'start': 732.571, 'weight': 0, 'content': [{'end': 738.794, 'text': 'So this particular location that is see Hadoop when is the location for Hadoop home now select.', 'start': 732.571, 'duration': 6.223}, {'end': 745.157, 'text': "Okay Now, let's get back to path and set path for Hadoop files in here.", 'start': 738.954, 'duration': 6.203}, {'end': 754.081, 'text': "Let's set up a new path variable that is Hadoop bin and now remember to create another path variable that is your S pin.", 'start': 745.637, 'duration': 8.444}, {'end': 762.025, 'text': 'So to locate S bin get back into Hadoop and select S bin and this will be the location or path value for your S pin.', 'start': 754.762, 'duration': 7.263}], 'summary': 'Configuring path variables for hadoop and s bin location.', 'duration': 29.454, 'max_score': 732.571, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s732571.jpg'}, {'end': 813.678, 'src': 'embed', 'start': 781.325, 'weight': 1, 'content': [{'end': 783.806, 'text': 'You can see that inside the bin folder of Hadoop.', 'start': 781.325, 'duration': 2.481}, {'end': 787.807, 'text': 'We are missing some important configuration files to fix this.', 'start': 784.166, 'duration': 3.641}, {'end': 792.609, 'text': 'We need a new configuration file, which will be available in the description box below.', 'start': 788.208, 'duration': 4.401}, {'end': 798.472, 'text': 'You can click on that particular link and the required configuration file will be downloaded into your local system.', 'start': 793.109, 'duration': 5.363}, {'end': 803.453, 'text': 'And all you need to do is just replace that particular file with your bin folder in your Hadoop.', 'start': 798.912, 'duration': 4.541}, {'end': 808.395, 'text': 'You can see that there is a new file in my Hadoop, which is Hadoop configuration FIX bin 1.rar.', 'start': 803.874, 'duration': 4.521}, {'end': 813.678, 'text': 'Now all you need to do is just extract this particular folder.', 'start': 810.575, 'duration': 3.103}], 'summary': 'Missing hadoop configuration files can be downloaded and replaced in the bin folder to fix the issue.', 'duration': 32.353, 'max_score': 781.325, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s781325.jpg'}, {'end': 915.114, 'src': 'heatmap', 'start': 858.699, 'weight': 2, 'content': [{'end': 866.995, 'text': "Let's open cmd and type in HDFS space name node space hyphen format.", 'start': 858.699, 'duration': 8.296}, {'end': 873.738, 'text': 'If you see a set of files popping up on your terminal, that means you have successfully installed Hadoop.', 'start': 869.055, 'duration': 4.683}, {'end': 876.639, 'text': 'You can see that the name node has been successfully getting started.', 'start': 874.118, 'duration': 2.521}, {'end': 881.281, 'text': "Now, let's open a new terminal and start all the Hadoop demons here.", 'start': 877.079, 'duration': 4.202}, {'end': 886.923, 'text': 'You just need to enter your Hadoop location file that is CD space Hadoop.', 'start': 881.301, 'duration': 5.622}, {'end': 901.678, 'text': 'Now you are inside Hadoop and inside Hadoop enter a spin Now your inside has been now you need to type in start all dot sh are start all dot cmd.', 'start': 889.765, 'duration': 11.913}, {'end': 906.664, 'text': 'And there you go.', 'start': 906.003, 'duration': 0.661}, {'end': 908.906, 'text': 'All your demons are getting started.', 'start': 907.084, 'duration': 1.822}, {'end': 915.114, 'text': "So that's how you install Hadoop into your local Windows operating system with the version Windows 10.", 'start': 909.747, 'duration': 5.367}], 'summary': 'Successfully install hadoop on windows 10 with hdfs and start all demons.', 'duration': 47.965, 'max_score': 858.699, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s858699.jpg'}], 'start': 677.058, 'title': 'Configuring and installing hadoop', 'summary': 'Covers configuring the hadoop environment, setting up java home and hadoop home, and installing hadoop on a windows 10 system, including necessary configuration files replacement and ensuring proper functioning of hadoop.', 'chapters': [{'end': 780.685, 'start': 677.058, 'title': 'Configuring hadoop environment', 'summary': 'Explains the process of configuring the hadoop environment, including setting up java home location, hadoop home, and path variables for hadoop files and s bin.', 'duration': 103.627, 'highlights': ['Editing Hadoop ENV dot CMD file and setting the Java home location by removing the bin and saving the file.', 'Setting Hadoop home and path for Hadoop files in environment variables by selecting new and writing in Hadoop home and setting up a new path variable for Hadoop bin.', 'Fixing the configuration files after successfully setting home and path for Hadoop by going back to environment variables.']}, {'end': 946.717, 'start': 781.325, 'title': 'Installing hadoop on windows 10', 'summary': 'Demonstrates the process of installing hadoop on a local windows 10 system, including downloading and replacing necessary configuration files, and starting hadoop demons, ensuring successful installation by checking for the proper functioning of hadoop.', 'duration': 165.392, 'highlights': ['Replacing missing configuration files and starting Hadoop demons are crucial steps in the installation process.', 'Successfully starting the name node and Hadoop demons indicate the successful installation of Hadoop.', 'Providing instructions to viewers on how to seek further assistance and expressing gratitude for watching the tutorial.']}], 'duration': 269.659, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/g7Qpnmi0Q-s/pics/g7Qpnmi0Q-s677058.jpg', 'highlights': ['Setting Hadoop home and path for Hadoop files in environment variables', 'Replacing missing configuration files and starting Hadoop demons are crucial steps', 'Successfully starting the name node and Hadoop demons indicate the successful installation']}], 'highlights': ['The prerequisites to install Hadoop in Windows are Java version 8 and the latest Hadoop version.', 'The detailed process of downloading Java 8 and the latest Hadoop version compatible with Windows is demonstrated.', 'The process involves selecting the latest stable version of Hadoop, highlighted as version 3.1.3, and then proceeding to select the binary option for download.', 'The available versions of Hadoop mentioned are 2.10, 3.1.3, and 3.2.1, indicating the range of options provided by the Apache organization for downloading Hadoop.', 'The successful download of Hadoop version 3.1 is demonstrated, indicating the completion of the download process for the selected stable version.', 'The chapter discusses the successful installation of Java 1.8 and Hadoop 3.1 on a local system, including setting up environment variables and editing configuration files for Hadoop, with a focus on core site.xml, HDFS site.xml, mapperit site.xml, yarn site.xml, and Hadoop ENV Windows command prompt file.', "The installation procedure for Java development kit (JDK) 8 is detailed, with emphasis on creating a new 'Java' folder and moving the JDK into it, preventing potential errors related to setting environment variables.", 'Instructions for setting the Java home and path for Java, including adding the location of JDK bin, ensuring the correct configuration for the environment variables.', 'Java 1.8 version is confirmed to be running on the local system, and the successful installation of Hadoop 3.1 is demonstrated, despite encountering three errors during the extraction process.', "Instructions for creating new folders and files within the Hadoop location, such as creating a 'data' folder and 'name node' and 'data node' files, are outlined, along with copying their respective locations and editing the HDFS site.xml configuration file accordingly.", 'Setting Hadoop home and path for Hadoop files in environment variables', 'Replacing missing configuration files and starting Hadoop demons are crucial steps', 'Successfully starting the name node and Hadoop demons indicate the successful installation']}