title
Elasticsearch Tutorial | Getting Started with Elasticsearch | ELK Stack Training | Edureka

description
( ELK Stack Training - https://www.edureka.co/elk-stack-training ) This Edureka video on Elasticsearch Tutorial will help you in understanding the fundamentals of Elasticsearch along with its practical usage and help you in building a strong foundation in ELK Stack. This video helps you to learn following topics: 1. What Is Elasticsearch? 2. Why Elasticsearch? 3. Elasticsearch Advantages 4. Elasticsearch Installation 5. API Conventions 6. Elasticsearch Query DSL 7. Mapping 8. Analysis 9 Modules Subscribe to our channel to get video updates. Hit the subscribe button above. #Elasticsearch #ElasticsearchTutorial #ELKStackOnlineTraining #Elasticsearchforbeginners ----------------------------------------------------------------- How it Works? 1. This is a 5 Week Instructor led Online Course, 30hrs of Online Live Instructor-led Classes. 2. We have a 24x7 One-on-One LIVE Technical Support to help you with any problems you might face or any clarifications you may require during the course. 3. At the end of the training you will be working on a real time project for which we will provide you a Grade and a Verifiable Certificate! -------------------------------------------------------------------- About The Course The ELK stack consists of Elasticsearch, Logstash, and Kibana. Although they've all been built to work exceptionally well together, each one is a separate tool that is driven by the open-source vendor Elastic. Elastic has created an end-to-end stack that delivers actionable insights in real time from almost any type of structured and unstructured data source. So the course can be summarized into: An overview of the key features of Elasticsearch, Logstash & Kibana A deep dive on how their powers combine to deliver an end to end solution for analytics, logging, search & visualization Extensive hands-on demo of the Elastic Stack in action ---------------------------------------------------------------------- Who should go for this course? The following professionals can go for this ELK Stack course: Big Data Analytics Engineer – Elastic Search Web Administrator System Log Analyst Full Stack Technical Architect Web Analyst ----------------------------------------------------------------------- Why learn ELK Stack? ELK Stack will help you find answers to the below questions that might be part of various Business Scenarios: How many users have signed up this week? When should we schedule the maintenance? Why is the database slow? How can I search in the Logs that are of different formats and have inconsistent data? How to deal with different types of Time Formats? How can I search logs that are spread across different locations? For more information, please write back to us at sales@edureka.co or call us at IND: 9606058406 / US: 18338555775 (toll free). Facebook: https://www.facebook.com/edurekaIN/ Twitter: https://twitter.com/edurekain LinkedIn: https://www.linkedin.com/company/edureka

detail
{'title': 'Elasticsearch Tutorial | Getting Started with Elasticsearch | ELK Stack Training | Edureka', 'heatmap': [{'end': 559.363, 'start': 462.923, 'weight': 0.828}, {'end': 642.453, 'start': 594.865, 'weight': 0.735}, {'end': 724.178, 'start': 666.606, 'weight': 0.812}, {'end': 789.861, 'start': 765.06, 'weight': 0.7}, {'end': 888.365, 'start': 853.721, 'weight': 0.774}, {'end': 1208.77, 'start': 1152.356, 'weight': 0.763}, {'end': 1555.833, 'start': 1502.436, 'weight': 0.773}], 'summary': 'Tutorial on elasticsearch covers the fundamentals, features, and advantages of elasticsearch, installation on windows, concepts and operations, securing elasticsearch indexes, crud operations, search api aggregations, functionalities, and mapping in elasticsearch, presented by the instructor hitesh in a detailed and comprehensive manner, highlighting key aspects like real-time distributed and analytic engine, support for full-text search, query capability, scalability, and security features.', 'chapters': [{'end': 67.562, 'segs': [{'end': 67.562, 'src': 'embed', 'start': 23.428, 'weight': 0, 'content': [{'end': 27.549, 'text': 'So Elasticsearch, let me give you a little bit idea about what Elasticsearch is.', 'start': 23.428, 'duration': 4.121}, {'end': 33.07, 'text': 'It is basically a search engine which is based on Apache Lucene.', 'start': 28.069, 'duration': 5.001}, {'end': 37.171, 'text': 'So it helps in performing various kind of searching.', 'start': 33.67, 'duration': 3.501}, {'end': 41.972, 'text': 'It does the full-text search of various kind of search mechanism it supports.', 'start': 37.791, 'duration': 4.181}, {'end': 46.813, 'text': 'So for now, this is the brief introduction about what Elasticsearch is.', 'start': 42.492, 'duration': 4.321}, {'end': 54.856, 'text': "Let's quickly dive into the slides and I'll be going through the more detailed depth of what Elasticsearch is.", 'start': 47.393, 'duration': 7.463}, {'end': 57.718, 'text': "So this will be the agenda for today's slide.", 'start': 55.917, 'duration': 1.801}, {'end': 61.82, 'text': 'So agenda include what is Elasticsearch?', 'start': 58.958, 'duration': 2.862}, {'end': 64.48, 'text': 'why we need Elasticsearch?', 'start': 61.82, 'duration': 2.66}, {'end': 67.562, 'text': 'what are the advantages of adopting Elasticsearch?', 'start': 64.48, 'duration': 3.082}], 'summary': 'Elasticsearch is a search engine based on apache lucene, supporting various search mechanisms and offering detailed insights.', 'duration': 44.134, 'max_score': 23.428, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y23428.jpg'}], 'start': 0.129, 'title': 'Elasticsearch fundamentals', 'summary': 'Covers the basics of elasticsearch, including its definition, features, and advantages, presented by the instructor hitesh in a webinar session.', 'chapters': [{'end': 67.562, 'start': 0.129, 'title': 'Elasticsearch webinar overview', 'summary': 'Covers the basics of elasticsearch, including its definition, features, and advantages, presented by the instructor hitesh in a webinar session.', 'duration': 67.433, 'highlights': ['The instructor Hitesh provides an overview of Elasticsearch, a search engine based on Apache Lucene, highlighting its capability for various kinds of searching.', 'The session agenda includes the definition of Elasticsearch, the reasons for its necessity, and the advantages of adopting Elasticsearch for search purposes.']}], 'duration': 67.433, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y129.jpg', 'highlights': ['Instructor Hitesh provides an overview of Elasticsearch, a search engine based on Apache Lucene, highlighting its capability for various kinds of searching.', 'The session agenda includes the definition of Elasticsearch, the reasons for its necessity, and the advantages of adopting Elasticsearch for search purposes.']}, {'end': 426.962, 'segs': [{'end': 93.805, 'src': 'embed', 'start': 67.562, 'weight': 0, 'content': [{'end': 79.015, 'text': 'installation of Elasticsearch, various API convention which are used, various APIs query, DSL mapping analysis and modules.', 'start': 67.562, 'duration': 11.453}, {'end': 81.378, 'text': 'So these will be the agenda for today.', 'start': 79.315, 'duration': 2.063}, {'end': 84.642, 'text': "So let's understand what is Elasticsearch.", 'start': 82.339, 'duration': 2.303}, {'end': 90.429, 'text': "So Elasticsearch is nothing but it's a real-time distributed and analytic engine.", 'start': 85.523, 'duration': 4.906}, {'end': 93.805, 'text': 'The best part about this product is it is an open source.', 'start': 90.962, 'duration': 2.843}], 'summary': "Today's agenda includes installation, apis, query, mapping analysis for elasticsearch, an open-source real-time distributed engine.", 'duration': 26.243, 'max_score': 67.562, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y67562.jpg'}, {'end': 231.358, 'src': 'embed', 'start': 193.113, 'weight': 1, 'content': [{'end': 194.634, 'text': 'Elasticsearch all supports that.', 'start': 193.113, 'duration': 1.521}, {'end': 203.582, 'text': 'And the best part about this is you can retrieve the result from the data which you import in any way you like.', 'start': 195.315, 'duration': 8.267}, {'end': 207.466, 'text': 'so it is all based on some structured query sets.', 'start': 203.582, 'duration': 3.884}, {'end': 211.79, 'text': 'so we write queries and we retrieve the results based on queries.', 'start': 207.466, 'duration': 4.324}, {'end': 216.555, 'text': 'so we can ask a query based on what you want from it.', 'start': 211.79, 'duration': 4.765}, {'end': 218.998, 'text': 'you can ask the query anyways you want.', 'start': 216.555, 'duration': 2.443}, {'end': 231.358, 'text': 'Second benefit of having Elasticsearch in places is let you understand billions of log lines easily because of the reason that it supports big volume of data.', 'start': 219.731, 'duration': 11.627}], 'summary': 'Elasticsearch supports structured queries and handles billions of log lines effectively.', 'duration': 38.245, 'max_score': 193.113, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y193113.jpg'}, {'end': 382.624, 'src': 'embed', 'start': 357.622, 'weight': 2, 'content': [{'end': 364.863, 'text': 'in terms of scalability and in terms of the performance, it is really fast as compared to other search engines which are available.', 'start': 357.622, 'duration': 7.241}, {'end': 370.038, 'text': 'Another advantage I should say of Elasticsearch is it is multilingual.', 'start': 365.555, 'duration': 4.483}, {'end': 379.623, 'text': 'Another advantage of having Elasticsearch in place is, whatever index which are created or whatever you can say,', 'start': 371.318, 'duration': 8.305}, {'end': 382.624, 'text': 'schema schemas are not generally used in Elasticsearch.', 'start': 379.623, 'duration': 3.001}], 'summary': 'Elasticsearch offers fast performance compared to other search engines and supports multilingual capabilities and flexible schema indexes.', 'duration': 25.002, 'max_score': 357.622, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y357622.jpg'}], 'start': 67.562, 'title': 'Introduction to elasticsearch', 'summary': 'Introduces elasticsearch as a real-time distributed and analytic engine, emphasizing its open-source nature, support for full-text search, query capability, and scalability across multiple nodes; highlighting its ability to handle structured, unstructured, geo-based, and metric-based data, as well as its support for aggregation, multilingualism, json format, auto-completion, and instant search.', 'chapters': [{'end': 426.962, 'start': 67.562, 'title': 'Introduction to elasticsearch', 'summary': 'Introduces elasticsearch as a real-time distributed and analytic engine, emphasizing its open-source nature, support for full-text search, query capability, and scalability across multiple nodes; highlighting its ability to handle structured, unstructured, geo-based, and metric-based data, as well as its support for aggregation, multilingualism, json format, auto-completion, and instant search.', 'duration': 359.4, 'highlights': ['Elasticsearch is a real-time distributed and analytic engine, open source, developed in Java, and based on the Lucene engine, providing RESTful interfaces for search base engine work, supporting full-text search completely document-based instead of tables and schemas.', 'Elasticsearch supports structured and unstructured searches, geo-based and metric-based data, allowing retrieval of results in any desired way, and can easily handle billions of log lines, providing aggregation for exploring trends and patterns in data.', 'Elasticsearch is scalable across multiple nodes, fast in performance, multilingual, stores data in the form of documents in a JSON format, supports auto-completion and instant search, making it widely accepted for integration with other applications.']}], 'duration': 359.4, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y67562.jpg', 'highlights': ['Elasticsearch is a real-time distributed and analytic engine, open source, developed in Java, and based on the Lucene engine, providing RESTful interfaces for search base engine work, supporting full-text search completely document-based instead of tables and schemas.', 'Elasticsearch supports structured and unstructured searches, geo-based and metric-based data, allowing retrieval of results in any desired way, and can easily handle billions of log lines, providing aggregation for exploring trends and patterns in data.', 'Elasticsearch is scalable across multiple nodes, fast in performance, multilingual, stores data in the form of documents in a JSON format, supports auto-completion and instant search, making it widely accepted for integration with other applications.']}, {'end': 790.662, 'segs': [{'end': 452.456, 'src': 'embed', 'start': 426.962, 'weight': 0, 'content': [{'end': 435.089, 'text': 'and last but not least, it is schema free, because it follows the Document oriented approach where instead of schemas and tables,', 'start': 426.962, 'duration': 8.127}, {'end': 439.032, 'text': 'we have documents where the data is stored.', 'start': 435.089, 'duration': 3.943}, {'end': 440.574, 'text': "Let's quickly go through the installation.", 'start': 439.032, 'duration': 1.542}, {'end': 450.035, 'text': 'So we will be going through the installation of Elasticsearch on a Windows platform where you need to have the Java installed first of all.', 'start': 441.229, 'duration': 8.806}, {'end': 452.456, 'text': 'So, once you install Java,', 'start': 450.615, 'duration': 1.841}], 'summary': 'Elasticsearch is schema free and requires java for installation on windows platform.', 'duration': 25.494, 'max_score': 426.962, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y426962.jpg'}, {'end': 559.363, 'src': 'heatmap', 'start': 462.923, 'weight': 0.828, 'content': [{'end': 467.946, 'text': 'This means that the Java is installed properly and the environment variables are properly set.', 'start': 462.923, 'duration': 5.023}, {'end': 473.781, 'text': 'One thing we have to keep in mind is Java version must be seven or more.', 'start': 468.82, 'duration': 4.961}, {'end': 475.581, 'text': 'It should not be less than seven.', 'start': 473.941, 'duration': 1.64}, {'end': 477.922, 'text': 'So this is something which you have to keep in mind.', 'start': 476.081, 'duration': 1.841}, {'end': 484.343, 'text': 'Next thing is install the Elasticsearch zip file from the website.', 'start': 478.802, 'duration': 5.541}, {'end': 492.804, 'text': "So once you'll download the zip file from the website, you need to unzip the file and you just have to go to the bin folder.", 'start': 484.923, 'duration': 7.881}, {'end': 500.968, 'text': 'So there will be a folder called bin where you have to go and then you have to run the elasticsearch.bat file.', 'start': 493.244, 'duration': 7.724}, {'end': 508.753, 'text': 'So this is nothing but a standard Windows batch file which contain the series of steps which it will be performing behind the scene.', 'start': 501.348, 'duration': 7.405}, {'end': 512.596, 'text': 'So it is just like a Windows script, which is when you double click it,', 'start': 508.833, 'duration': 3.763}, {'end': 522.523, 'text': 'it gets executed and it will be executing the task behind the scenes and eventually help in bringing up the Elasticsearch daemon on your machine.', 'start': 512.596, 'duration': 9.927}, {'end': 525.525, 'text': 'So you will be getting such kind of an output on your screen.', 'start': 523.043, 'duration': 2.482}, {'end': 529.467, 'text': 'and we have to wait for the Elasticsearch to start.', 'start': 526.225, 'duration': 3.242}, {'end': 536.77, 'text': 'So now the question which will be coming onto your mind is how do I get to know whether the Elasticsearch has started or it is running or not?', 'start': 529.947, 'duration': 6.823}, {'end': 540.292, 'text': 'So the best place to check is open the browser.', 'start': 537.31, 'duration': 2.982}, {'end': 545.234, 'text': 'On the same machine, you can type as localhost 9200.', 'start': 540.692, 'duration': 4.542}, {'end': 550.477, 'text': 'So if it will give you an output like this, saying the tagline that you know for search,', 'start': 545.234, 'duration': 5.243}, {'end': 554.839, 'text': 'this means that Elasticsearch is installed and it is running properly.', 'start': 550.477, 'duration': 4.362}, {'end': 559.363, 'text': 'So this is how you can check whether Elasticsearch daemon is running or not.', 'start': 555.519, 'duration': 3.844}], 'summary': 'Install java 7+, elasticsearch, run elasticsearch.bat, check status at localhost:9200.', 'duration': 96.44, 'max_score': 462.923, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y462923.jpg'}, {'end': 508.753, 'src': 'embed', 'start': 476.081, 'weight': 4, 'content': [{'end': 477.922, 'text': 'So this is something which you have to keep in mind.', 'start': 476.081, 'duration': 1.841}, {'end': 484.343, 'text': 'Next thing is install the Elasticsearch zip file from the website.', 'start': 478.802, 'duration': 5.541}, {'end': 492.804, 'text': "So once you'll download the zip file from the website, you need to unzip the file and you just have to go to the bin folder.", 'start': 484.923, 'duration': 7.881}, {'end': 500.968, 'text': 'So there will be a folder called bin where you have to go and then you have to run the elasticsearch.bat file.', 'start': 493.244, 'duration': 7.724}, {'end': 508.753, 'text': 'So this is nothing but a standard Windows batch file which contain the series of steps which it will be performing behind the scene.', 'start': 501.348, 'duration': 7.405}], 'summary': 'Install elasticsearch zip file, unzip, and run elasticsearch.bat on windows.', 'duration': 32.672, 'max_score': 476.081, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y476081.jpg'}, {'end': 604.347, 'src': 'embed', 'start': 571.013, 'weight': 2, 'content': [{'end': 575.658, 'text': 'which can help us to write queries and import the queries.', 'start': 571.013, 'duration': 4.645}, {'end': 578.019, 'text': 'There are two options to do that.', 'start': 576.358, 'duration': 1.661}, {'end': 584.241, 'text': 'So this is an approach which you have to follow when your Elasticsearch is local installed on the machine.', 'start': 578.099, 'duration': 6.142}, {'end': 594.245, 'text': 'But if in case the Elasticsearch is remote, well what I will be doing in my case is I have an Elasticsearch set up on my AWS cloud environment.', 'start': 584.701, 'duration': 9.544}, {'end': 604.347, 'text': 'and I will be accessing that Elasticsearch through the Kibana dashboard and I will be accessing the same Sense tool through the Kibana,', 'start': 594.865, 'duration': 9.482}], 'summary': 'Two options for querying elasticsearch: local or remote with aws cloud environment.', 'duration': 33.334, 'max_score': 571.013, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y571013.jpg'}, {'end': 642.453, 'src': 'heatmap', 'start': 594.865, 'weight': 0.735, 'content': [{'end': 604.347, 'text': 'and I will be accessing that Elasticsearch through the Kibana dashboard and I will be accessing the same Sense tool through the Kibana,', 'start': 594.865, 'duration': 9.482}, {'end': 608.548, 'text': 'because Kibana latest version nowadays support the Sense as well.', 'start': 604.347, 'duration': 4.201}, {'end': 610.128, 'text': 'So either way you can do.', 'start': 609.048, 'duration': 1.08}, {'end': 612.348, 'text': "Let's go to the basic concepts.", 'start': 610.888, 'duration': 1.46}, {'end': 616.769, 'text': 'So before we dive into Elasticsearch we need to have a few more core concept.', 'start': 612.549, 'duration': 4.22}, {'end': 619.97, 'text': 'We need to discuss a little bit more concept about the Elasticsearch.', 'start': 616.809, 'duration': 3.161}, {'end': 623.123, 'text': 'So basic concepts near real time.', 'start': 620.882, 'duration': 2.241}, {'end': 631.007, 'text': 'This means that the Elasticsearch is so quick that as soon as you put the data into the Elasticsearch, it is all available to work upon.', 'start': 623.163, 'duration': 7.844}, {'end': 642.453, 'text': 'So Elasticsearch is near real time search platform that there is a slightly change in terms of time when you index a document until the time it becomes searchable.', 'start': 631.508, 'duration': 10.945}], 'summary': 'Elasticsearch is a near real-time search platform, supporting sense through kibana.', 'duration': 47.588, 'max_score': 594.865, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y594865.jpg'}, {'end': 647.576, 'src': 'embed', 'start': 616.809, 'weight': 3, 'content': [{'end': 619.97, 'text': 'We need to discuss a little bit more concept about the Elasticsearch.', 'start': 616.809, 'duration': 3.161}, {'end': 623.123, 'text': 'So basic concepts near real time.', 'start': 620.882, 'duration': 2.241}, {'end': 631.007, 'text': 'This means that the Elasticsearch is so quick that as soon as you put the data into the Elasticsearch, it is all available to work upon.', 'start': 623.163, 'duration': 7.844}, {'end': 642.453, 'text': 'So Elasticsearch is near real time search platform that there is a slightly change in terms of time when you index a document until the time it becomes searchable.', 'start': 631.508, 'duration': 10.945}, {'end': 647.576, 'text': 'So as soon as you create an index or you upload a document, it becomes searchable.', 'start': 642.793, 'duration': 4.783}], 'summary': 'Elasticsearch is a near real-time search platform, allowing quick data indexing and availability for search.', 'duration': 30.767, 'max_score': 616.809, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y616809.jpg'}, {'end': 724.178, 'src': 'heatmap', 'start': 666.606, 'weight': 0.812, 'content': [{'end': 673.588, 'text': 'It provides the federated indexing and search capabilities across all nodes and is identified by a unique name.', 'start': 666.606, 'duration': 6.982}, {'end': 679.309, 'text': 'So by default it will take the unique name as Elasticsearch, but if, in case you want to rename the cluster name,', 'start': 673.968, 'duration': 5.341}, {'end': 682.65, 'text': 'you can do it by making certain changes in the configuration file.', 'start': 679.309, 'duration': 3.341}, {'end': 687.669, 'text': "Node is nothing but it's a single server which is participating in the cluster.", 'start': 683.385, 'duration': 4.284}, {'end': 693.894, 'text': "So it's a part of a cluster, it stores data and participates in the cluster indexing and search capabilities.", 'start': 688.069, 'duration': 5.825}, {'end': 696.436, 'text': "Now let's understand what index is.", 'start': 694.915, 'duration': 1.521}, {'end': 703.822, 'text': 'Index is basically a collection of documents with a similar characteristic and it is identified by a name.', 'start': 697.056, 'duration': 6.766}, {'end': 712.109, 'text': 'So whenever we want to work upon a collection of documents, it is we define the index on which we have to work.', 'start': 704.442, 'duration': 7.667}, {'end': 718.373, 'text': 'So you can consider it as an identification of certain type of documents.', 'start': 712.629, 'duration': 5.744}, {'end': 724.178, 'text': 'So we categorize certain type of documents into a category, into a major category, we call it as index.', 'start': 718.393, 'duration': 5.785}], 'summary': 'Elasticsearch allows federated search across nodes, with default cluster name as elasticsearch, and option to rename it in the configuration file. nodes are servers participating in the cluster, storing data and enabling indexing and search capabilities. an index is a collection of documents with a similar characteristic, identified by a name.', 'duration': 57.572, 'max_score': 666.606, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y666606.jpg'}, {'end': 789.861, 'src': 'heatmap', 'start': 765.06, 'weight': 0.7, 'content': [{'end': 772.062, 'text': "type is nothing, but it's a local category partition of index whose semantics is complete.", 'start': 765.06, 'duration': 7.002}, {'end': 776.083, 'text': 'it is defined for document that have set of common fields.', 'start': 772.062, 'duration': 4.021}, {'end': 782.546, 'text': "so type is nothing, but it's a category inside the index for partitioning of the index.", 'start': 776.083, 'duration': 6.463}, {'end': 784.506, 'text': 'so this is something which we will see.', 'start': 782.546, 'duration': 1.96}, {'end': 789.861, 'text': 'we can define one or more index type in one or more type in your index Documents.', 'start': 784.506, 'duration': 5.355}], 'summary': 'Type is a local category partition of index for document partitioning.', 'duration': 24.801, 'max_score': 765.06, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y765060.jpg'}], 'start': 426.962, 'title': 'Installing elasticsearch on windows', 'summary': 'Covers the installation of elasticsearch on a windows platform, requiring java version 7 or higher and utilizing a schema-free, document-oriented approach for data storage. it also includes accessing elasticsearch through kibana and introduces basic concepts like near real time, distributed system, cluster, node, index, and type.', 'chapters': [{'end': 475.581, 'start': 426.962, 'title': 'Elasticsearch installation on windows', 'summary': 'Covers the installation of elasticsearch on a windows platform, highlighting the requirement of java version 7 or higher and the use of a schema-free, document-oriented approach for data storage.', 'duration': 48.619, 'highlights': ['Java version must be seven or more for Elasticsearch installation.', 'Schema-free, document-oriented approach used for data storage in Elasticsearch.', 'Installation of Elasticsearch on Windows platform requires Java to be installed first.']}, {'end': 790.662, 'start': 476.081, 'title': 'Installing and understanding elasticsearch', 'summary': 'Covers the installation process of elasticsearch on windows, accessing it through kibana, and basic concepts such as near real time, distributed system, cluster, node, index, and type.', 'duration': 314.581, 'highlights': ['Elasticsearch Installation on Windows The process of installing Elasticsearch on a Windows platform is explained, including unzipping the file, running the elasticsearch.bat file, and verifying the installation using localhost 9200.', 'Accessing Elasticsearch through Kibana on AWS The method of accessing Elasticsearch on AWS cloud environment through Kibana dashboard and utilizing the Sense tool is detailed.', 'Basic Concepts of Elasticsearch Core concepts of Elasticsearch such as near real time, distributed system, cluster, node, index, and type are explained.']}], 'duration': 363.7, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y426962.jpg', 'highlights': ['Elasticsearch installation on Windows requires Java version 7 or higher.', 'Schema-free, document-oriented approach used for data storage in Elasticsearch.', 'Accessing Elasticsearch through Kibana on AWS is detailed.', 'Core concepts of Elasticsearch such as near real time, distributed system, cluster, node, index, and type are explained.', 'The process of installing Elasticsearch on a Windows platform is explained, including unzipping the file, running the elasticsearch.bat file, and verifying the installation using localhost 9200.']}, {'end': 1019.88, 'segs': [{'end': 888.365, 'src': 'heatmap', 'start': 811.818, 'weight': 1, 'content': [{'end': 819.304, 'text': 'So suppose if in case, shards are nothing but Elasticsearch, it provides you the ability to subdivide an index into multiple pieces.', 'start': 811.818, 'duration': 7.486}, {'end': 829.091, 'text': 'Like suppose if I have created an index of a larger size as compared to my capacity which is there on that particular Elasticsearch node.', 'start': 819.484, 'duration': 9.607}, {'end': 836.096, 'text': 'What will actually happen, the Elasticsearch will subdivide that complete index into smaller parts.', 'start': 829.531, 'duration': 6.565}, {'end': 840.557, 'text': 'which are called as shards, and these shards in itself.', 'start': 836.856, 'duration': 3.701}, {'end': 845.919, 'text': 'they are fully functional and independent indexes that can be hosted on any node within the cluster.', 'start': 840.557, 'duration': 5.362}, {'end': 853.721, 'text': 'So, generally, these nodes are distributed across and we also configure the replica of these shards.', 'start': 846.579, 'duration': 7.142}, {'end': 861.043, 'text': 'so if, in case someday, a node fails, you will always have a persistent copy of data available in your environment.', 'start': 853.721, 'duration': 7.322}, {'end': 868.096, 'text': 'So Elasticsearch allow you to make one or more copies of the index shards which are called replica shards or replica.', 'start': 861.744, 'duration': 6.352}, {'end': 872.304, 'text': "So let's now find out the API convention in Elasticsearch.", 'start': 869.118, 'duration': 3.186}, {'end': 874.72, 'text': 'So these are the API convention.', 'start': 873.399, 'duration': 1.321}, {'end': 879.761, 'text': 'The Elasticsearch REST API they accessed using the JSON over HTTP.', 'start': 874.74, 'duration': 5.021}, {'end': 888.365, 'text': "So it's a RESTful API and it supports HTTP and these are some of the conventions which are used throughout the REST APIs.", 'start': 880.362, 'duration': 8.003}], 'summary': 'Elasticsearch allows subdivision of indexes into shards, enabling distribution and replication for data availability.', 'duration': 49.225, 'max_score': 811.818, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y811818.jpg'}, {'end': 930.367, 'src': 'embed', 'start': 880.362, 'weight': 0, 'content': [{'end': 888.365, 'text': "So it's a RESTful API and it supports HTTP and these are some of the conventions which are used throughout the REST APIs.", 'start': 880.362, 'duration': 8.003}, {'end': 890.946, 'text': 'We will be covering each one of these one by one.', 'start': 888.785, 'duration': 2.161}, {'end': 899.809, 'text': "For now let's name them as multiple indices, date, math, support in index name, common option or URL based access control.", 'start': 891.406, 'duration': 8.403}, {'end': 902.23, 'text': "So let's talk about multiple indices.", 'start': 900.589, 'duration': 1.641}, {'end': 906.393, 'text': 'Most API support execution across multiple indices.', 'start': 902.851, 'duration': 3.542}, {'end': 912.097, 'text': 'So different notations can be used to perform the operation on multiple indices.', 'start': 906.973, 'duration': 5.124}, {'end': 917.461, 'text': 'So suppose, if, in case you want to perform an operation across multiple indexes,', 'start': 912.157, 'duration': 5.304}, {'end': 926.586, 'text': 'then in that case what you can do is you can make use of certain expressions or certain you know what we can say Operators like comma,', 'start': 917.461, 'duration': 9.125}, {'end': 930.367, 'text': 'wildcard notations or some kind of string parameter.', 'start': 926.586, 'duration': 3.781}], 'summary': 'The restful api supports operations across multiple indices using various notations and expressions.', 'duration': 50.005, 'max_score': 880.362, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y880362.jpg'}, {'end': 994.318, 'src': 'embed', 'start': 950.31, 'weight': 4, 'content': [{'end': 960.258, 'text': 'Or if, in case you want to specify certain string parameter like ignore, allow no indexes, expand wildcards.', 'start': 950.31, 'duration': 9.948}, {'end': 963.901, 'text': 'these are some of the string parameters which we can use in our queries.', 'start': 960.258, 'duration': 3.643}, {'end': 969.714, 'text': 'So next is Elasticsearch lets you search indexes according to date and time.', 'start': 964.77, 'duration': 4.944}, {'end': 973.336, 'text': 'You need to specify the date and time in the specific format.', 'start': 970.294, 'duration': 3.042}, {'end': 976.138, 'text': "So it's all the date and time.", 'start': 974.157, 'duration': 1.981}, {'end': 982.303, 'text': 'So whenever you want to search an index according to date and time, you have to specify in this format.', 'start': 976.559, 'duration': 5.744}, {'end': 986.566, 'text': 'These are some set of common operations for all the REST based APIs.', 'start': 983.163, 'duration': 3.403}, {'end': 994.318, 'text': 'So some of the operations which we will be using it like pretty results, human readable.', 'start': 987.373, 'duration': 6.945}], 'summary': 'Elasticsearch allows searching indexes by date and time; specific string parameters can be used in queries.', 'duration': 44.008, 'max_score': 950.31, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y950310.jpg'}], 'start': 790.662, 'title': 'Elasticsearch concepts and operations', 'summary': 'Covers elasticsearch shards, including their subdivision of indexes, node distribution, and replica shard configuration. it also explores querying operations on multiple indices, searching based on date and time, and common rest api operations.', 'chapters': [{'end': 906.393, 'start': 790.662, 'title': 'Elasticsearch shards and api convention', 'summary': 'Explains the concept of shards in elasticsearch, highlighting their ability to subdivide indexes, distribute nodes, and configure replica shards, along with the api conventions for accessing elasticsearch rest api using json over http.', 'duration': 115.731, 'highlights': ['Elasticsearch allows subdivide an index into smaller parts called shards, which are fully functional and independent indexes hosted on any node within the cluster. Elasticsearch provides the ability to subdivide an index into smaller parts called shards, which are fully functional and independent indexes that can be hosted on any node within the cluster.', 'Nodes are distributed across and replica of shards is configured to ensure persistent data availability in case of a node failure. Nodes are distributed across and replica of shards is configured to ensure persistent data availability in case of a node failure.', 'Elasticsearch REST API is accessed using JSON over HTTP, supporting HTTP and conventions such as multiple indices, date, math, and URL-based access control. Elasticsearch REST API is accessed using JSON over HTTP, supporting conventions such as multiple indices, date, math, and URL-based access control.']}, {'end': 1019.88, 'start': 906.973, 'title': 'Elasticsearch operations and querying', 'summary': 'Discusses performing operations on multiple indices using different notations like comma, wildcard, and string parameters, as well as searching indexes based on date and time format in elasticsearch, and common operations for rest apis including pretty results and human readable output.', 'duration': 112.907, 'highlights': ['The chapter discusses performing operations on multiple indices using different notations like comma, wildcard, and string parameters.', 'Elasticsearch lets you search indexes according to date and time in a specific format.', 'Common operations for all REST based APIs are explained, including pretty results and human readable output.']}], 'duration': 229.218, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y790662.jpg', 'highlights': ['Elasticsearch REST API is accessed using JSON over HTTP, supporting conventions such as multiple indices, date, math, and URL-based access control.', 'Nodes are distributed across and replica of shards is configured to ensure persistent data availability in case of a node failure.', 'Elasticsearch allows subdivide an index into smaller parts called shards, which are fully functional and independent indexes hosted on any node within the cluster.', 'The chapter discusses performing operations on multiple indices using different notations like comma, wildcard, and string parameters.', 'Common operations for all REST based APIs are explained, including pretty results and human readable output.', 'Elasticsearch lets you search indexes according to date and time in a specific format.']}, {'end': 1306.607, 'segs': [{'end': 1080.322, 'src': 'embed', 'start': 1019.88, 'weight': 0, 'content': [{'end': 1028.683, 'text': 'so user can also use a proxy with the URL based access control to secure the access of Elasticsearch indexes.', 'start': 1019.88, 'duration': 8.803}, {'end': 1031.604, 'text': 'so we can also make use of the proxies.', 'start': 1028.683, 'duration': 2.921}, {'end': 1043.641, 'text': 'so user has an option of specifying an index in the URL and on each individual request within the request body for some request like multi-search,', 'start': 1031.604, 'duration': 12.037}, {'end': 1044.902, 'text': 'multi-get or bulk.', 'start': 1043.641, 'duration': 1.261}, {'end': 1050.505, 'text': 'So this is done for secure access, where we are keeping a proxy.', 'start': 1045.422, 'duration': 5.083}, {'end': 1057.969, 'text': 'we are using a proxy which is further having a URL-based access and we can make use of that proxy to query the Elasticsearch.', 'start': 1050.505, 'duration': 7.464}, {'end': 1061.331, 'text': "So let's talk about the Elasticsearch APIs.", 'start': 1058.99, 'duration': 2.341}, {'end': 1066.434, 'text': 'These are the types of APIs which we have in Elasticsearch.', 'start': 1062.212, 'duration': 4.222}, {'end': 1076.818, 'text': 'The Document API, the Search API, the aggregation API, the cluster API, and last but not least the index API.', 'start': 1067.314, 'duration': 9.504}, {'end': 1080.322, 'text': "So let's quickly see what these are.", 'start': 1077.739, 'duration': 2.583}], 'summary': 'Using a proxy with url-based access control to secure elasticsearch indexes, and overview of elasticsearch apis.', 'duration': 60.442, 'max_score': 1019.88, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1019880.jpg'}, {'end': 1226.763, 'src': 'heatmap', 'start': 1152.356, 'weight': 3, 'content': [{'end': 1161.047, 'text': 'for if, in case you want to make use of querying across multiple documents, we make use of the multiple document API like multi.', 'start': 1152.356, 'duration': 8.691}, {'end': 1162.749, 'text': 'get API, bulk API.', 'start': 1161.047, 'duration': 1.702}, {'end': 1164.67, 'text': 'if, in case you want to bulk delete.', 'start': 1162.749, 'duration': 1.921}, {'end': 1167.031, 'text': 'if, in case you want to do bulk update.', 'start': 1164.67, 'duration': 2.361}, {'end': 1169.533, 'text': 'if, in case you want to do re-indexing.', 'start': 1167.031, 'duration': 2.502}, {'end': 1173.375, 'text': 'these are some of the queries which are implemented across bulk.', 'start': 1169.533, 'duration': 3.842}, {'end': 1177.984, 'text': 'So we will be doing this index API for creating a document.', 'start': 1174.281, 'duration': 3.703}, {'end': 1187.59, 'text': 'So if you would see here this query put put means see. these are some of the keywords which we use get put post, delete in making the REST API calls.', 'start': 1178.024, 'duration': 9.566}, {'end': 1190.512, 'text': 'So likewise here, put is the method which is used.', 'start': 1188.03, 'duration': 2.482}, {'end': 1199.778, 'text': 'So slash playlist is the name of the index, and song is the name of the document, and likewise, six is the ID.', 'start': 1191.032, 'duration': 8.746}, {'end': 1203.961, 'text': 'So if in case, let me show you these in my lab environment.', 'start': 1200.699, 'duration': 3.262}, {'end': 1208.77, 'text': 'So first of all let me give you an idea about what this particular query is doing.', 'start': 1204.747, 'duration': 4.023}, {'end': 1218.417, 'text': 'This particular query is, so what we are doing is we are putting, we are importing this document into the index.', 'start': 1209.631, 'duration': 8.786}, {'end': 1223.12, 'text': 'So the document will contain information like title, artist, album, and year.', 'start': 1219.438, 'duration': 3.682}, {'end': 1226.763, 'text': 'So I have this Kibana dashboard open.', 'start': 1224.341, 'duration': 2.422}], 'summary': 'Using elasticsearch for querying across multiple documents and implementing bulk operations for indexing, deleting, updating, and re-indexing.', 'duration': 22.016, 'max_score': 1152.356, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1152356.jpg'}], 'start': 1019.88, 'title': 'Securing elasticsearch and document apis', 'summary': 'Covers using proxy with url-based access control to secure elasticsearch indexes, and explains different elasticsearch apis including document, search, aggregation, cluster, and index apis. it also focuses on the use cases and query commands for creating and importing documents into the index.', 'chapters': [{'end': 1080.322, 'start': 1019.88, 'title': 'Proxy usage for secure elasticsearch access', 'summary': 'Discusses the usage of proxy with url-based access control for securing elasticsearch indexes, along with an overview of different types of elasticsearch apis including document, search, aggregation, cluster, and index apis.', 'duration': 60.442, 'highlights': ['The chapter discusses the usage of proxy with URL-based access control for securing Elasticsearch indexes, providing an option to specify an index in the URL and on each individual request within the request body.', 'Overview of different types of Elasticsearch APIs: Document API, Search API, Aggregation API, Cluster API, and Index API.']}, {'end': 1306.607, 'start': 1082.244, 'title': 'Understanding elasticsearch document apis', 'summary': 'Explains the different types of elasticsearch apis, including document apis, index api, cluster api, and their use cases, such as single api document and multiple api document, with a focus on creating and importing documents into the index using query commands like put and post.', 'duration': 224.363, 'highlights': ['Explanation of different types of Elasticsearch APIs, including document APIs, index API, and cluster API, and their use cases. N/A', 'Description of single API document and multiple API document, along with specific APIs like index API, get API, update, delete, multi.get API, bulk API, and their use cases. N/A', 'Demonstration of creating and importing documents into the index using query commands like put and post, including example commands and data fields like title, artist, album, and year. N/A']}], 'duration': 286.727, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1019880.jpg', 'highlights': ['The chapter discusses the usage of proxy with URL-based access control for securing Elasticsearch indexes, providing an option to specify an index in the URL and on each individual request within the request body.', 'Overview of different types of Elasticsearch APIs: Document API, Search API, Aggregation API, Cluster API, and Index API.', 'Explanation of different types of Elasticsearch APIs, including document APIs, index API, and cluster API, and their use cases.', 'Demonstration of creating and importing documents into the index using query commands like put and post, including example commands and data fields like title, artist, album, and year.']}, {'end': 1722.161, 'segs': [{'end': 1469.26, 'src': 'embed', 'start': 1411.411, 'weight': 1, 'content': [{'end': 1414.132, 'text': 'So this is how we perform these operations.', 'start': 1411.411, 'duration': 2.721}, {'end': 1420.295, 'text': 'Likewise, if in case you have a delete API, if in case you want to delete a document, you can do it similar way.', 'start': 1414.292, 'duration': 6.003}, {'end': 1426.047, 'text': 'So for deleting a document all you need to do is to document ID and you can very well delete it from here.', 'start': 1421.263, 'duration': 4.784}, {'end': 1430.691, 'text': 'So let me show you that as well.', 'start': 1427.148, 'duration': 3.543}, {'end': 1439.778, 'text': "Delete let's keep as document ID number seven.", 'start': 1430.711, 'duration': 9.067}, {'end': 1447.484, 'text': 'So if in case I want to delete it, successful one means this has been deleted.', 'start': 1439.798, 'duration': 7.686}, {'end': 1450.667, 'text': 'So these were the operations.', 'start': 1448.845, 'duration': 1.822}, {'end': 1453.61, 'text': "Now let's go to the search API.", 'start': 1451.849, 'duration': 1.761}, {'end': 1461.956, 'text': 'So search API, using a search API you can extend a search query and get back the search hits that matches the query.', 'start': 1454.531, 'duration': 7.425}, {'end': 1469.26, 'text': 'So search as per the name says it is used for getting the results from a set of data.', 'start': 1462.536, 'duration': 6.724}], 'summary': 'Demonstrating document deletion and search using apis.', 'duration': 57.849, 'max_score': 1411.411, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1411411.jpg'}, {'end': 1597.115, 'src': 'heatmap', 'start': 1502.436, 'weight': 0, 'content': [{'end': 1510.658, 'text': 'So this is what multi-type do and there are some set of parameters which you can pass in your search operation in the URI.', 'start': 1502.436, 'duration': 8.222}, {'end': 1520.901, 'text': 'So like these are some of the parameters which you can pass like queue, lenient, field, sort, timeout, terminate after, from, size, et cetera.', 'start': 1511.038, 'duration': 9.863}, {'end': 1522.862, 'text': 'So here is the example.', 'start': 1521.801, 'duration': 1.061}, {'end': 1528.507, 'text': 'So here what we are doing is we are fetching the information, we are reading a document.', 'start': 1523.402, 'duration': 5.105}, {'end': 1534.372, 'text': 'In fact we are searching a document which contain year as 2011.', 'start': 1528.827, 'duration': 5.545}, {'end': 1539.817, 'text': 'So if you see the output here it will show you year as 2011.', 'start': 1534.372, 'duration': 5.445}, {'end': 1542.079, 'text': 'So this is what search APIs do.', 'start': 1539.817, 'duration': 2.262}, {'end': 1545.582, 'text': "Alright so let's move on to aggregations.", 'start': 1543.46, 'duration': 2.122}, {'end': 1547.407, 'text': 'So what are aggregations??', 'start': 1546.286, 'duration': 1.121}, {'end': 1555.833, 'text': 'These are nothing, but if, in case you want to collect the data and you want to work upon multiple data sets, we make use of the aggregation.', 'start': 1547.487, 'duration': 8.346}, {'end': 1561.478, 'text': 'So aggregation, it collect all the data which is selected by a search query.', 'start': 1556.454, 'duration': 5.024}, {'end': 1564.814, 'text': 'So this framework consists of many building blocks.', 'start': 1562.333, 'duration': 2.481}, {'end': 1572.338, 'text': 'So these building blocks are known as aggregators, which help in building the complex summaries of data.', 'start': 1565.154, 'duration': 7.184}, {'end': 1577.261, 'text': 'So if you would see below, this is the syntax of the aggregation.', 'start': 1572.798, 'duration': 4.463}, {'end': 1586.025, 'text': 'So these are the aggregator types, bucket, metric, matrix, and last but not least, the pipeline.', 'start': 1578.361, 'duration': 7.664}, {'end': 1588.426, 'text': "So we'll see.", 'start': 1586.945, 'duration': 1.481}, {'end': 1591.948, 'text': 'So these are the different types of aggregation.', 'start': 1589.387, 'duration': 2.561}, {'end': 1597.115, 'text': 'I have some information regarding aggregation.', 'start': 1592.933, 'duration': 4.182}], 'summary': 'Elasticsearch search apis use parameters for query operations and aggregations for collecting and summarizing data from multiple datasets.', 'duration': 57.298, 'max_score': 1502.436, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1502436.jpg'}, {'end': 1722.161, 'src': 'embed', 'start': 1687.678, 'weight': 4, 'content': [{'end': 1703.233, 'text': 'this query is actually a range query, which is getting me the documents for the range of balance between 44,999 and somewhere around 90 lakhs.', 'start': 1687.678, 'duration': 15.555}, {'end': 1708.355, 'text': 'so GTE means greater than equal to, LTE means less than equal to.', 'start': 1703.233, 'duration': 5.122}, {'end': 1711.596, 'text': "so let's see.", 'start': 1708.355, 'duration': 3.241}, {'end': 1722.161, 'text': "so if you would see here I'm getting 94 search results, out of which they are giving me the balance as this alright.", 'start': 1711.596, 'duration': 10.565}], 'summary': 'Range query for balance between 44,999 and 90 lakhs yielding 94 search results.', 'duration': 34.483, 'max_score': 1687.678, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1687678.jpg'}], 'start': 1306.607, 'title': 'Elasticsearch operations and search api aggregations', 'summary': 'Covers elasticsearch operations including crud operations, search api for retrieving search hits, and demonstrates aggregations in search apis, explaining types of aggregators and providing examples such as retrieving specific documents and performing range queries on a bank dataset.', 'chapters': [{'end': 1539.817, 'start': 1306.607, 'title': 'Elasticsearch operations overview', 'summary': 'Explains the operations of creating, reading, updating, and deleting documents in elasticsearch, along with using the search api to retrieve search hits matching the query from a set of data, with examples and parameters provided.', 'duration': 233.21, 'highlights': ['The chapter explains the operations of creating, reading, updating, and deleting documents Describes the fundamental operations in Elasticsearch, including creating, reading, updating, and deleting documents.', 'using the search API to retrieve search hits matching the query from a set of data Illustrates the usage of the search API to retrieve search hits matching the query from a set of data in Elasticsearch.', 'with examples and parameters provided Provides examples and parameters for performing operations and using the search API in Elasticsearch.']}, {'end': 1722.161, 'start': 1539.817, 'title': 'Understanding aggregations in search apis', 'summary': 'Discusses the concept of aggregations in search apis, explaining the purpose and types of aggregators, while demonstrating example queries and their results, such as retrieving specific documents and performing range queries on a bank dataset.', 'duration': 182.344, 'highlights': ['Aggregations in search APIs help in building complex summaries of data by collecting and working upon multiple data sets. Aggregations in search APIs allow for working upon multiple data sets to build complex summaries, enhancing data analysis capabilities.', 'Types of aggregators include bucket, metric, matrix, and pipeline, each serving a distinct function. Aggregators are categorized into types such as bucket, metric, matrix, and pipeline, each serving a distinct function in data collection and analysis.', "The example query for retrieving documents with the first name 'Rovina' yielded one result with the index ID 145. An example query demonstrated the retrieval of documents with the first name 'Rovina', resulting in one match with the index ID 145.", 'The range query for balances between 44,999 and 90 lakhs returned 94 search results, demonstrating the use of range queries in data retrieval. A range query was used to retrieve documents with balances between 44,999 and 90 lakhs, resulting in 94 search results and showcasing the functionality of range queries in data retrieval.']}], 'duration': 415.554, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1306607.jpg', 'highlights': ['Aggregations in search APIs allow for working upon multiple data sets to build complex summaries, enhancing data analysis capabilities.', 'The chapter explains the operations of creating, reading, updating, and deleting documents.', 'Illustrates the usage of the search API to retrieve search hits matching the query from a set of data in Elasticsearch.', 'Aggregators are categorized into types such as bucket, metric, matrix, and pipeline, each serving a distinct function in data collection and analysis.', 'A range query was used to retrieve documents with balances between 44,999 and 90 lakhs, resulting in 94 search results and showcasing the functionality of range queries in data retrieval.']}, {'end': 2315.361, 'segs': [{'end': 1764.917, 'src': 'embed', 'start': 1722.161, 'weight': 1, 'content': [{'end': 1725.162, 'text': 'so likewise there are several queries which you can execute.', 'start': 1722.161, 'duration': 3.001}, {'end': 1727.791, 'text': "Let's jump to the slide again.", 'start': 1725.802, 'duration': 1.989}, {'end': 1729.713, 'text': 'What are index APIs?', 'start': 1728.712, 'duration': 1.001}, {'end': 1730.393, 'text': 'Index APIs?', 'start': 1729.793, 'duration': 0.6}, {'end': 1738.658, 'text': "they're responsible for managing all the expect of indexes like settings, aliases, mapping, index templates and all those stuff.", 'start': 1730.393, 'duration': 8.265}, {'end': 1743.041, 'text': 'So these are some of the keywords which we use in the API.', 'start': 1739.119, 'duration': 3.922}, {'end': 1745.143, 'text': 'We can create the index.', 'start': 1743.422, 'duration': 1.721}, {'end': 1751.827, 'text': 'so these operations which we can do, we can delete the index, we can get the index, we can open or close the index,', 'start': 1745.143, 'duration': 6.684}, {'end': 1756.21, 'text': 'we can get the list of the index templates or aliases or different stuff.', 'start': 1751.827, 'duration': 4.383}, {'end': 1758.651, 'text': "Let's talk about the cluster API.", 'start': 1757.19, 'duration': 1.461}, {'end': 1764.917, 'text': 'Cluster API, it is used for getting the information of the cluster and its node and making changes in them.', 'start': 1759.292, 'duration': 5.625}], 'summary': 'Index apis manage settings, aliases, mapping, index templates, and more. cluster api is used for retrieving cluster and node information and making changes.', 'duration': 42.756, 'max_score': 1722.161, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1722161.jpg'}, {'end': 1915.141, 'src': 'embed', 'start': 1859.914, 'weight': 0, 'content': [{'end': 1869.358, 'text': "Query DSL is nothing but it's a kind of domain specific language which we generally use in our environment to perform operations.", 'start': 1859.914, 'duration': 9.444}, {'end': 1872.54, 'text': 'Whatever queries we write it in this DSL.', 'start': 1869.398, 'duration': 3.142}, {'end': 1876.422, 'text': "DSL is nothing but it's a domain specific language.", 'start': 1873.48, 'duration': 2.942}, {'end': 1881.284, 'text': 'Elasticsearch provide a full query DSL based on JSON to define queries.', 'start': 1877.022, 'duration': 4.262}, {'end': 1887.374, 'text': 'Query DSL is an AST of queries consisting of two type of clauses.', 'start': 1881.932, 'duration': 5.442}, {'end': 1893.537, 'text': 'So there are two type of clauses majorly, the leave query clause and the compound query clause.', 'start': 1887.694, 'duration': 5.843}, {'end': 1899.615, 'text': 'So if I talk about the leave query clause, it look for a particular value in a particular field.', 'start': 1894.133, 'duration': 5.482}, {'end': 1901.836, 'text': 'So, for example.', 'start': 1900.195, 'duration': 1.641}, {'end': 1902.696, 'text': 'so whatever.', 'start': 1901.836, 'duration': 0.86}, {'end': 1913.08, 'text': 'with the help of this, if in case we are finding a particular value like suppose, I give you an example like match term, range or queries.', 'start': 1902.696, 'duration': 10.384}, {'end': 1915.141, 'text': 'so that is what leave query do.', 'start': 1913.08, 'duration': 2.061}], 'summary': 'Elasticsearch provides a query dsl based on json with two types of clauses: leave query and compound query.', 'duration': 55.227, 'max_score': 1859.914, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1859914.jpg'}, {'end': 2041.962, 'src': 'embed', 'start': 1988.274, 'weight': 4, 'content': [{'end': 1999.744, 'text': 'So these are some of the mapping parameters which we have, which we can use in our queries, like boost analyzer, copy to geo hash, if, in case,', 'start': 1988.274, 'duration': 11.47}, {'end': 2003.967, 'text': "you're working on geo hash for formatting.", 'start': 1999.744, 'duration': 4.223}, {'end': 2006.649, 'text': 'so if, in case, you want to make the output presentable.', 'start': 2003.967, 'duration': 2.682}, {'end': 2015.457, 'text': 'Likewise, there are some more, like include in all index options, fields, norms, null values, et cetera.', 'start': 2007.27, 'duration': 8.187}, {'end': 2019.864, 'text': "So let's find out how the data is configured.", 'start': 2016.201, 'duration': 3.663}, {'end': 2026.83, 'text': 'So the analysis plays a very important role with respect to how the data is actually stored.', 'start': 2020.725, 'duration': 6.105}, {'end': 2036.177, 'text': 'So during the search operation when a query is processed the content in the index is analyzed by a analysis module.', 'start': 2027.63, 'duration': 8.547}, {'end': 2041.962, 'text': 'So analysis module contains analyzer, tokenizer, token filter and character field.', 'start': 2036.618, 'duration': 5.344}], 'summary': 'Mapping parameters for queries include boost analyzer, copy to geo hash, and more. analysis module contains analyzer, tokenizer, token filter, and character field.', 'duration': 53.688, 'max_score': 1988.274, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1988274.jpg'}, {'end': 2277.988, 'src': 'embed', 'start': 2253.136, 'weight': 6, 'content': [{'end': 2261.18, 'text': 'So with respect to the static settings, they need to be configured in the YML file, the configuration file, before starting the Elasticsearch.', 'start': 2253.136, 'duration': 8.044}, {'end': 2267.763, 'text': 'So certain modules which are there by default, those are basically dynamic modules.', 'start': 2261.6, 'duration': 6.163}, {'end': 2274.787, 'text': 'But if, in case certain modules which you have to mention in the configuration file, that means the Elasticsearch.yml file,', 'start': 2267.823, 'duration': 6.964}, {'end': 2277.988, 'text': 'those are categorized as static modules.', 'start': 2274.787, 'duration': 3.201}], 'summary': 'Static settings in yml file need to be configured before starting elasticsearch.', 'duration': 24.852, 'max_score': 2253.136, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y2253136.jpg'}], 'start': 1722.161, 'title': 'Elasticsearch functionalities and mapping', 'summary': 'Covers index and cluster apis in elasticsearch, including managing indexes and cluster information, as well as using query dsl to define queries. additionally, it explains the mapping process, the role of analysis in data storage, and the types of modules in elasticsearch.', 'chapters': [{'end': 1942.13, 'start': 1722.161, 'title': 'Understanding elasticsearch api and query dsl', 'summary': 'Covers the functionalities of index apis and cluster api in elasticsearch, including managing indexes, cluster information, and using query dsl to define queries based on json, consisting of leave query clause and compound query clause.', 'duration': 219.969, 'highlights': ['Elasticsearch provide a full query DSL based on JSON to define queries. Elasticsearch provides a complete query DSL based on JSON for defining queries, allowing for flexible and powerful query operations.', 'Index APIs are responsible for managing all aspects of indexes like settings, aliases, mapping, and index templates. Index APIs handle various tasks related to indexes, including managing settings, aliases, mapping, and index templates.', 'Cluster API is used for getting information about the cluster and its nodes in a distributed environment. The Cluster API is essential for retrieving information about the cluster and its nodes in a distributed environment.', 'Query DSL consists of two types of clauses: leave query clause and compound query clause. The Query DSL in Elasticsearch is comprised of leave query clauses and compound query clauses, providing a versatile approach for defining queries.']}, {'end': 2315.361, 'start': 1943.571, 'title': 'Elasticsearch mapping and analysis', 'summary': 'Explains the mapping process in elasticsearch, the role of analysis in data storage, and the types of modules in elasticsearch, including static and dynamic modules.', 'duration': 371.79, 'highlights': ['The role of analysis in data storage is crucial, as the content in the index is analyzed by an analysis module during the search operation, and this analysis module contains analyzer, tokenizer, token filter, and character field.', 'The chapter also explains the different field types like meta field, geo data, specific data type, complex data type, and core data type, which are categorized as different field data types.', 'The mapping parameters discussed include boost analyzer, copy to geo hash, include in all index options, fields, norms, null values, among others, that can be used in queries to configure the data.', 'The types of modules in Elasticsearch are categorized as static and dynamic, with static settings needing to be configured in the YML file before starting Elasticsearch, while dynamic modules are there by default.', 'The chapter concludes by encouraging viewers to share or like the YouTube channel, the video, and to look out for more videos in the playlist and subscribe to the Edureka channel for more learning opportunities.']}], 'duration': 593.2, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/1EnvkPf7t6Y/pics/1EnvkPf7t6Y1722161.jpg', 'highlights': ['Elasticsearch provides a complete query DSL based on JSON for defining queries, allowing for flexible and powerful query operations.', 'Index APIs handle various tasks related to indexes, including managing settings, aliases, mapping, and index templates.', 'The Cluster API is essential for retrieving information about the cluster and its nodes in a distributed environment.', 'The Query DSL in Elasticsearch is comprised of leave query clauses and compound query clauses, providing a versatile approach for defining queries.', 'The role of analysis in data storage is crucial, as the content in the index is analyzed by an analysis module during the search operation.', 'The mapping parameters discussed include boost analyzer, copy to geo hash, include in all index options, fields, norms, null values, among others, that can be used in queries to configure the data.', 'The types of modules in Elasticsearch are categorized as static and dynamic, with static settings needing to be configured in the YML file before starting Elasticsearch, while dynamic modules are there by default.']}], 'highlights': ['Elasticsearch is a real-time distributed and analytic engine, open source, developed in Java, and based on the Lucene engine, providing RESTful interfaces for search base engine work, supporting full-text search completely document-based instead of tables and schemas.', 'Instructor Hitesh provides an overview of Elasticsearch, a search engine based on Apache Lucene, highlighting its capability for various kinds of searching.', 'Elasticsearch supports structured and unstructured searches, geo-based and metric-based data, allowing retrieval of results in any desired way, and can easily handle billions of log lines, providing aggregation for exploring trends and patterns in data.', 'Elasticsearch is scalable across multiple nodes, fast in performance, multilingual, stores data in the form of documents in a JSON format, supports auto-completion and instant search, making it widely accepted for integration with other applications.', 'The session agenda includes the definition of Elasticsearch, the reasons for its necessity, and the advantages of adopting Elasticsearch for search purposes.', 'Elasticsearch installation on Windows requires Java version 7 or higher.', 'Accessing Elasticsearch through Kibana on AWS is detailed.', 'Core concepts of Elasticsearch such as near real time, distributed system, cluster, node, index, and type are explained.', 'The process of installing Elasticsearch on a Windows platform is explained, including unzipping the file, running the elasticsearch.bat file, and verifying the installation using localhost 9200.', 'Elasticsearch REST API is accessed using JSON over HTTP, supporting conventions such as multiple indices, date, math, and URL-based access control.', 'Nodes are distributed across and replica of shards is configured to ensure persistent data availability in case of a node failure.', 'Elasticsearch allows subdivide an index into smaller parts called shards, which are fully functional and independent indexes hosted on any node within the cluster.', 'The chapter discusses performing operations on multiple indices using different notations like comma, wildcard, and string parameters.', 'Common operations for all REST based APIs are explained, including pretty results and human readable output.', 'Elasticsearch lets you search indexes according to date and time in a specific format.', 'The chapter discusses the usage of proxy with URL-based access control for securing Elasticsearch indexes, providing an option to specify an index in the URL and on each individual request within the request body.', 'Overview of different types of Elasticsearch APIs: Document API, Search API, Aggregation API, Cluster API, and Index API.', 'Explanation of different types of Elasticsearch APIs, including document APIs, index API, and cluster API, and their use cases.', 'Demonstration of creating and importing documents into the index using query commands like put and post, including example commands and data fields like title, artist, album, and year.', 'Aggregations in search APIs allow for working upon multiple data sets to build complex summaries, enhancing data analysis capabilities.', 'The chapter explains the operations of creating, reading, updating, and deleting documents.', 'Illustrates the usage of the search API to retrieve search hits matching the query from a set of data in Elasticsearch.', 'Aggregators are categorized into types such as bucket, metric, matrix, and pipeline, each serving a distinct function in data collection and analysis.', 'A range query was used to retrieve documents with balances between 44,999 and 90 lakhs, resulting in 94 search results and showcasing the functionality of range queries in data retrieval.', 'Elasticsearch provides a complete query DSL based on JSON for defining queries, allowing for flexible and powerful query operations.', 'Index APIs handle various tasks related to indexes, including managing settings, aliases, mapping, and index templates.', 'The Cluster API is essential for retrieving information about the cluster and its nodes in a distributed environment.', 'The Query DSL in Elasticsearch is comprised of leave query clauses and compound query clauses, providing a versatile approach for defining queries.', 'The role of analysis in data storage is crucial, as the content in the index is analyzed by an analysis module during the search operation.', 'The mapping parameters discussed include boost analyzer, copy to geo hash, include in all index options, fields, norms, null values, among others, that can be used in queries to configure the data.', 'The types of modules in Elasticsearch are categorized as static and dynamic, with static settings needing to be configured in the YML file before starting Elasticsearch, while dynamic modules are there by default.']}