title
OpenAI DevDay: Opening Keynote

description
Join us for the opening keynote from OpenAI DevDay — OpenAI’s first developer conference. We’re gathering developers from around the world for an in-person day of programming to learn about the latest AI advancements and explore what lies ahead. New models and developer products announced at DevDay: https://openai.com/blog/new-models-and-developer-products-announced-at-devday Introducing GPTs: https://openai.com/blog/introducing-gpts

detail
{'title': 'OpenAI DevDay: Opening Keynote', 'heatmap': [{'end': 444.175, 'start': 409.499, 'weight': 0.947}, {'end': 1176.506, 'start': 1148.403, 'weight': 0.716}, {'end': 1560.854, 'start': 1503.706, 'weight': 1}, {'end': 1889.781, 'start': 1858.769, 'weight': 0.752}, {'end': 2108.977, 'start': 2079.446, 'weight': 0.728}], 'summary': "Openai's devday opening keynote presented the latest innovations such as gpt-4, voice and vision capabilities for chatgpt, and dolly 3, with a success record of over 2 million developers, 92% fortune 500 companies, and 100 million weekly active users. the event also covered updates to chatgpt and the launch of gpt-4 turbo, as well as collaborations with microsoft ceo to prioritize safety and empower developers. additionally, it discussed the use of gpts for tailored chat, startups, and enhancing developer experience through assistance api and stateful api.", 'chapters': [{'end': 182.405, 'segs': [{'end': 88.015, 'src': 'embed', 'start': 58.328, 'weight': 1, 'content': [{'end': 64.47, 'text': 'In March, we followed that up with the launch of GPT-4, still the most capable model out in the world.', 'start': 58.328, 'duration': 6.142}, {'end': 78.294, 'text': 'And in the last few months, we launched voice and vision capabilities so that ChatGPT can now see, hear, and speak.', 'start': 71.272, 'duration': 7.022}, {'end': 80.675, 'text': 'And more recent..', 'start': 80.095, 'duration': 0.58}, {'end': 82.132, 'text': "There's a lot.", 'start': 81.772, 'duration': 0.36}, {'end': 83.093, 'text': "You don't have to clap each time.", 'start': 82.152, 'duration': 0.941}, {'end': 88.015, 'text': "And more recently, we launched Dolly 3, the world's most advanced image model.", 'start': 84.574, 'duration': 3.441}], 'summary': 'In recent months, launched gpt-4, with voice and vision capabilities, and dolly 3, the most advanced image model.', 'duration': 29.687, 'max_score': 58.328, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk58328.jpg'}, {'end': 163.257, 'src': 'embed', 'start': 111.718, 'weight': 0, 'content': [{'end': 115.58, 'text': 'Over 92% of Fortune 500 companies building on our products.', 'start': 111.718, 'duration': 3.862}, {'end': 120.642, 'text': 'And we have about 100 million weekly active users now on ChatGPT.', 'start': 116.86, 'duration': 3.782}, {'end': 128.865, 'text': "And what's incredible on that is we got there entirely through word of mouth.", 'start': 125.764, 'duration': 3.101}, {'end': 131.466, 'text': 'People just find it useful and tell their friends.', 'start': 128.985, 'duration': 2.481}, {'end': 137.149, 'text': 'OpenAI is the most advanced and the most widely used AI platform in the world now.', 'start': 132.467, 'duration': 4.682}, {'end': 141.515, 'text': 'But numbers never tell the whole picture on something like this.', 'start': 138.712, 'duration': 2.803}, {'end': 146.08, 'text': "What's really important is how people use the products, how people are using AI.", 'start': 142.756, 'duration': 3.324}, {'end': 148.122, 'text': "And so I'd like to show you a quick video.", 'start': 146.66, 'duration': 1.462}, {'end': 153.194, 'text': 'I actually wanted to write something to my dad in Tagalog.', 'start': 149.833, 'duration': 3.361}, {'end': 163.257, 'text': 'I want a non-romantic way to tell my parent that I love him and I also want to tell him that he can rely on me,', 'start': 153.594, 'duration': 9.663}], 'summary': 'Over 92% fortune 500 companies use products, 100m weekly users on chatgpt, growth through word of mouth.', 'duration': 51.539, 'max_score': 111.718, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk111718.jpg'}], 'start': 1.722, 'title': "Openai's innovations and ai impact", 'summary': "Highlights openai's latest innovations, including the launch of gpt-4, voice and vision capabilities for chatgpt, the release of dolly 3, and its success with over 2 million developers, 92% fortune 500 companies, and 100 million weekly active users. additionally, it discusses the impact of ai on language and culture, demonstrated through a personal example in tagalog, showing its potential impact on language and culture.", 'chapters': [{'end': 137.149, 'start': 1.722, 'title': 'Openai dev day: latest innovations and growth', 'summary': "Highlights openai's latest innovations, including the launch of gpt-4, voice and vision capabilities for chatgpt, the release of dolly 3, and the success with over 2 million developers, 92% fortune 500 companies, and 100 million weekly active users.", 'duration': 135.427, 'highlights': ['OpenAI has achieved over 2 million developers building on their API for a wide variety of use cases, with over 92% of Fortune 500 companies using their products, and about 100 million weekly active users on ChatGPT, all through word of mouth.', "The recent launches of Dolly 3, the world's most advanced image model, and ChatGPT Enterprise for enterprise customers, showcasing enterprise-grade security and privacy, higher-speed GPT-4 access, and longer context windows.", 'The introduction of voice and vision capabilities for ChatGPT, allowing it to see, hear, and speak, and the launch of GPT-4, which remains the most capable model globally.', 'The initial release of ChatGPT as a low-key research preview, followed by the successful launch of GPT-4, and the subsequent expansion of capabilities, including voice and vision, marking significant progress over the past year.']}, {'end': 182.405, 'start': 138.712, 'title': 'Ai impact on language and culture', 'summary': 'Highlights the importance of understanding how people use ai, demonstrated through a personal example of using ai to express love and respect in tagalog, showing the potential impact on language and culture.', 'duration': 43.693, 'highlights': ['The demonstration of using AI to express love and respect in Tagalog language highlights the potential impact of AI on cultural and linguistic expressions.', "The speaker's personal experience of using AI to convey a non-romantic message to a family member in Tagalog demonstrates the practical application of AI in language and cultural contexts.", 'The emphasis on maintaining the respect inherent in the Filipino culture and Tagalog grammar while using AI to convey a heartfelt message showcases the potential for AI to preserve cultural nuances in language expressions.', "The speaker's reflection on the translation's profound meaning and the realization of new linguistic possibilities signifies the transformative impact of AI on language and cultural communication."]}], 'duration': 180.683, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1722.jpg', 'highlights': ['OpenAI has achieved over 2 million developers building on their API for a wide variety of use cases, with over 92% of Fortune 500 companies using their products, and about 100 million weekly active users on ChatGPT, all through word of mouth.', "The recent launches of Dolly 3, the world's most advanced image model, and ChatGPT Enterprise for enterprise customers, showcasing enterprise-grade security and privacy, higher-speed GPT-4 access, and longer context windows.", 'The introduction of voice and vision capabilities for ChatGPT, allowing it to see, hear, and speak, and the launch of GPT-4, which remains the most capable model globally.', 'The initial release of ChatGPT as a low-key research preview, followed by the successful launch of GPT-4, and the subsequent expansion of capabilities, including voice and vision, marking significant progress over the past year.', 'The demonstration of using AI to express love and respect in Tagalog language highlights the potential impact of AI on cultural and linguistic expressions.', "The speaker's personal experience of using AI to convey a non-romantic message to a family member in Tagalog demonstrates the practical application of AI in language and cultural contexts.", 'The emphasis on maintaining the respect inherent in the Filipino culture and Tagalog grammar while using AI to convey a heartfelt message showcases the potential for AI to preserve cultural nuances in language expressions.', "The speaker's reflection on the translation's profound meaning and the realization of new linguistic possibilities signifies the transformative impact of AI on language and cultural communication."]}, {'end': 858.987, 'segs': [{'end': 274.783, 'src': 'embed', 'start': 248.743, 'weight': 1, 'content': [{'end': 253.306, 'text': 'When I started using ChatGPT, I realized I could ask ChatGPT that question.', 'start': 248.743, 'duration': 4.563}, {'end': 257.769, 'text': 'And not only does it give me an answer, but it gives me an explanation.', 'start': 253.966, 'duration': 3.803}, {'end': 259.51, 'text': "Didn't need tutoring as much.", 'start': 257.789, 'duration': 1.721}, {'end': 261.752, 'text': 'It gave me a life back.', 'start': 260.07, 'duration': 1.682}, {'end': 265.054, 'text': 'It gave me time for my family and time for me.', 'start': 262.472, 'duration': 2.582}, {'end': 266.516, 'text': 'I have a chronic nerve pain.', 'start': 265.515, 'duration': 1.001}, {'end': 269.338, 'text': 'On my whole left half of my body I have nerve damage.', 'start': 267.456, 'duration': 1.882}, {'end': 272, 'text': 'I had like a spine, a brain surgery.', 'start': 269.838, 'duration': 2.162}, {'end': 274.783, 'text': 'And so I have like limited use of my left hand.', 'start': 272.381, 'duration': 2.402}], 'summary': 'Using chatgpt saved time, provided answers, and reduced need for tutoring, benefiting family life. chatgpt helped with nerve pain and limited hand use.', 'duration': 26.04, 'max_score': 248.743, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk248743.jpg'}, {'end': 444.175, 'src': 'heatmap', 'start': 356.411, 'weight': 0, 'content': [{'end': 364.495, 'text': "GPT-4 supported up to 8K, and in some cases up to 32K context length, but we know that isn't enough for many of you and what you want to do.", 'start': 356.411, 'duration': 8.084}, {'end': 367.736, 'text': 'GPT-4 Turbo supports up to 128,000 tokens of context.', 'start': 365.515, 'duration': 2.221}, {'end': 375.54, 'text': "That's 300 pages of a standard book, 16 times longer than our 8K context.", 'start': 367.776, 'duration': 7.764}, {'end': 386.752, 'text': "And in addition to longer context length, you'll notice that the model is much more accurate over a long context.", 'start': 380.868, 'duration': 5.884}, {'end': 390.875, 'text': 'Number two, more control.', 'start': 388.893, 'duration': 1.982}, {'end': 397.099, 'text': "We've heard loud and clear that developers need more control over the model's responses and outputs.", 'start': 392.115, 'duration': 4.984}, {'end': 399.5, 'text': "So we've addressed that in a number of ways.", 'start': 397.919, 'duration': 1.581}, {'end': 406.105, 'text': 'We have a new feature called JSON mode, which ensures that the model will respond with valid JSON.', 'start': 401.182, 'duration': 4.923}, {'end': 408.879, 'text': 'This has been a huge developer request.', 'start': 407.298, 'duration': 1.581}, {'end': 411.22, 'text': "It'll make calling APIs much easier.", 'start': 409.499, 'duration': 1.721}, {'end': 415.322, 'text': 'The model is also much better at function calling.', 'start': 413.341, 'duration': 1.981}, {'end': 420.144, 'text': "You can now call many functions at once, and it'll do better at following instructions in general.", 'start': 415.742, 'duration': 4.402}, {'end': 425.006, 'text': "We're also introducing a new feature called reproducible outputs.", 'start': 422.205, 'duration': 2.801}, {'end': 429.048, 'text': "You can pass a seed parameter, and it'll make the model return consistent outputs.", 'start': 425.807, 'duration': 3.241}, {'end': 432.59, 'text': 'This, of course, gives you a higher degree of control over model behavior.', 'start': 429.789, 'duration': 2.801}, {'end': 434.151, 'text': 'This rolls out in beta today.', 'start': 433.05, 'duration': 1.101}, {'end': 444.175, 'text': "And in the coming weeks, we'll roll out a feature to let you view log probes in the API.", 'start': 440.233, 'duration': 3.942}], 'summary': 'Gpt-4 turbo supports up to 128,000 tokens, offering 16x longer context, better accuracy, and more developer control with features like json mode and reproducible outputs.', 'duration': 54.809, 'max_score': 356.411, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk356411.jpg'}, {'end': 462.385, 'src': 'embed', 'start': 433.05, 'weight': 5, 'content': [{'end': 434.151, 'text': 'This rolls out in beta today.', 'start': 433.05, 'duration': 1.101}, {'end': 444.175, 'text': "And in the coming weeks, we'll roll out a feature to let you view log probes in the API.", 'start': 440.233, 'duration': 3.942}, {'end': 450.458, 'text': 'All right, number three, better world knowledge.', 'start': 448.057, 'duration': 2.401}, {'end': 454.741, 'text': 'You want these models to be able to access better knowledge about the world, so do we.', 'start': 451.579, 'duration': 3.162}, {'end': 457.922, 'text': "So we're launching retrieval in the platform.", 'start': 456.362, 'duration': 1.56}, {'end': 462.385, 'text': "You can bring knowledge from outside documents or databases into whatever you're building.", 'start': 458.903, 'duration': 3.482}], 'summary': 'Beta rollout today, upcoming api feature, retrieval of external knowledge launched.', 'duration': 29.335, 'max_score': 433.05, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk433050.jpg'}, {'end': 516.804, 'src': 'embed', 'start': 487.581, 'weight': 6, 'content': [{'end': 496.197, 'text': 'Surprising no one, DALI 3, GPT-4 Turbo with vision, and the new text-to-speech model are all going into the API today.', 'start': 487.581, 'duration': 8.616}, {'end': 510.273, 'text': 'We have a handful of customers that have just started using DALI 3 to programmatically generate images and designs.', 'start': 504.026, 'duration': 6.247}, {'end': 516.804, 'text': 'Today, Coke is launching a campaign that lets its customers generate Diwali cards using DALI 3.', 'start': 511.277, 'duration': 5.527}], 'summary': 'Dali 3, gpt-4 turbo, and new text-to-speech model added to api. coke launches campaign using dali 3 for diwali cards.', 'duration': 29.223, 'max_score': 487.581, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk487581.jpg'}, {'end': 649.461, 'src': 'embed', 'start': 621.488, 'weight': 7, 'content': [{'end': 629.012, 'text': 'The fine-tuning API is great for adapting our models to achieve better performance in a wide variety of applications with a relatively small amount of data.', 'start': 621.488, 'duration': 7.524}, {'end': 635.507, 'text': 'You may want a model to learn a completely new knowledge domain or to use a lot of proprietary data.', 'start': 630.902, 'duration': 4.605}, {'end': 639.09, 'text': "So today we're launching a new program called Custom Models.", 'start': 636.428, 'duration': 2.662}, {'end': 641.933, 'text': 'With Custom Models.', 'start': 640.552, 'duration': 1.381}, {'end': 649.461, 'text': 'our researchers will work closely with a company to help them make a great custom model, especially for them and their use case, using our tools.', 'start': 641.933, 'duration': 7.528}], 'summary': 'Introducing custom models program for tailored model adaptation.', 'duration': 27.973, 'max_score': 621.488, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk621488.jpg'}, {'end': 711.593, 'src': 'embed', 'start': 680.731, 'weight': 8, 'content': [{'end': 685.774, 'text': "We're doubling the tokens per minute for all of our established GPT-4 customers so that it's easier to do more.", 'start': 680.731, 'duration': 5.043}, {'end': 691.657, 'text': "And you'll be able to request changes to further rate limits and quotas directly in your API account settings.", 'start': 686.734, 'duration': 4.923}, {'end': 699.901, 'text': "In addition to these rate limits, it's important to do everything we can do to make you successful building on our platform.", 'start': 692.978, 'duration': 6.923}, {'end': 702.863, 'text': "So we're introducing Copyright Shield.", 'start': 701.522, 'duration': 1.341}, {'end': 711.593, 'text': 'Copyright shield means that we will step in and defend our customers and pay the costs incurred if you face legal claims around copyright infringement.', 'start': 704.11, 'duration': 7.483}], 'summary': 'Doubling tokens for gpt-4 customers; introducing copyright shield for legal defense.', 'duration': 30.862, 'max_score': 680.731, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk680731.jpg'}, {'end': 788.313, 'src': 'embed', 'start': 752.114, 'weight': 3, 'content': [{'end': 757.338, 'text': "We've heard from developers that there are a lot of things that they want to build, but GPT-4 just costs too much.", 'start': 752.114, 'duration': 5.224}, {'end': 764.195, 'text': "They've told us that if we could decrease the cost by 20%, 25%, that would be great, a huge leap forward.", 'start': 758.373, 'duration': 5.822}, {'end': 774.578, 'text': "I'm super excited to announce that we worked really hard on this, and GPT-4 Turbo, a better model, is considerably cheaper than GPT-4.", 'start': 766.115, 'duration': 8.463}, {'end': 788.313, 'text': 'By a factor of 3x for prompt tokens, and two X for completion tokens starting today.', 'start': 775.918, 'duration': 12.395}], 'summary': "Gpt-4 turbo is 3x cheaper for prompt tokens and 2x for completion tokens, fulfilling developers' request for cost reduction.", 'duration': 36.199, 'max_score': 752.114, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk752114.jpg'}], 'start': 182.785, 'title': 'Chatgpt and gpt-4 turbo updates', 'summary': 'Discusses how chatgpt enhances creativity and productivity, citing examples of improved productivity and academic success. it also covers the launch of the new gpt-4 turbo model, supporting up to 128,000 tokens of context. additionally, the chapter highlights updates to gpt-4 turbo, including more control with json mode, better world knowledge with retrieval, new modalities like dali 3 and text-to-speech, customization through fine-tuning and custom models, and higher rate limits and decreased pricing for gpt-4 turbo and gpt-3.5 turbo 16k.', 'chapters': [{'end': 386.752, 'start': 182.785, 'title': 'Chatgpt: enhancing creativity and productivity', 'summary': 'Discusses how chatgpt has empowered individuals to enhance their creativity and productivity, with examples of improved productivity, academic success, and the launch of the new gpt-4 turbo model supporting up to 128,000 tokens of context.', 'duration': 203.967, 'highlights': ['The launch of GPT-4 Turbo model supporting up to 128,000 tokens of context The new GPT-4 Turbo model supports up to 128,000 tokens of context, which is 16 times longer than the previous 8K context, and it is much more accurate over a long context.', 'Examples of improved productivity and academic success using ChatGPT Individuals have reported improved productivity, academic success, and regained time for family and personal activities, with one individual being a 4.0 student and a parent of four children.', 'Empowerment of individuals to enhance creativity and productivity with ChatGPT ChatGPT has empowered individuals to enhance their creativity and productivity by providing assistance in various tasks such as building sickling hemoglobin representation, grocery planning, and academic support, thereby boosting their confidence and providing more time for personal and family activities.']}, {'end': 858.987, 'start': 388.893, 'title': 'Gpt-4 turbo update announcement', 'summary': 'Highlights updates to gpt-4 turbo, including more control with json mode and reproducible outputs, better world knowledge with retrieval and updated knowledge cutoff, new modalities like dali 3 and text-to-speech, customization through fine-tuning and custom models, and higher rate limits and decreased pricing for gpt-4 turbo and gpt-3.5 turbo 16k.', 'duration': 470.094, 'highlights': ['GPT-4 Turbo is considerably cheaper than GPT-4, with pricing at one cent per thousand prompt tokens and three cents per thousand completion tokens, making it more than 2.75 times cheaper to use than GPT-4. The new pricing for GPT-4 Turbo is a factor of 3x cheaper for prompt tokens and 2x cheaper for completion tokens, offering a blended rate more than 2.75 times cheaper than GPT-4.', 'Updates include new control features such as JSON mode for valid JSON responses, better function calling, and reproducible outputs with a seed parameter for consistent outputs. The update introduces JSON mode for valid JSON responses, improved function calling, and reproducible outputs with a seed parameter for consistent model behavior.', 'The introduction of retrieval in the platform allows bringing knowledge from outside documents or databases, while the knowledge cutoff is updated to provide world knowledge up to April 2023. The platform now supports retrieval of knowledge from external sources and has updated the knowledge cutoff to provide world knowledge up to April 2023.', 'New modalities like DALI 3 and text-to-speech are added to the API, enabling capabilities such as programmatically generating images and designs, generating natural-sounding audio from text, and releasing the next version of the open source speech recognition model, Whisper V3. The API now supports DALI 3 for image and design generation, text-to-speech for natural-sounding audio, and the next version of Whisper V3 for improved speech recognition across many languages.', 'Customization options are expanded with fine-tuning for the 16K version of the model and the launch of the Custom Models program, allowing companies to work with researchers for domain-specific custom models. Fine-tuning is expanded to the 16K version of the model, and the Custom Models program is introduced for companies to collaborate with researchers on domain-specific custom models.', 'The rate limits for GPT-4 customers are doubled, and a Copyright Shield is introduced to defend customers against legal claims around copyright infringement. The rate limits for GPT-4 customers are doubled, and a Copyright Shield is introduced to protect customers and cover costs in case of legal claims related to copyright infringement.']}], 'duration': 676.202, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk182785.jpg', 'highlights': ['The launch of GPT-4 Turbo model supporting up to 128,000 tokens of context', 'Examples of improved productivity and academic success using ChatGPT', 'Empowerment of individuals to enhance creativity and productivity with ChatGPT', 'GPT-4 Turbo is considerably cheaper than GPT-4', 'Updates include new control features such as JSON mode for valid JSON responses', 'The introduction of retrieval in the platform allows bringing knowledge from outside documents or databases', 'New modalities like DALI 3 and text-to-speech are added to the API', 'Customization options are expanded with fine-tuning for the 16K version of the model', 'The rate limits for GPT-4 customers are doubled']}, {'end': 1249.444, 'segs': [{'end': 973.782, 'src': 'embed', 'start': 944.87, 'weight': 0, 'content': [{'end': 952.639, 'text': 'And so the first thing that we have been doing is building, in partnership with you, the system all the way from thinking from power to the DC,', 'start': 944.87, 'duration': 7.769}, {'end': 955.322, 'text': 'to the rack, to the accelerators, to the network.', 'start': 952.639, 'duration': 2.683}, {'end': 965.253, 'text': "Just really the shape of Azure is drastically changed and is changing rapidly in support of these models that you're building.", 'start': 956.182, 'duration': 9.071}, {'end': 973.782, 'text': 'So our job number one is to build the best system so that you can build the best models and then make that all available to developers.', 'start': 966.194, 'duration': 7.588}], 'summary': 'Azure system is rapidly changing to support building best models for developers.', 'duration': 28.912, 'max_score': 944.87, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk944870.jpg'}, {'end': 1014.335, 'src': 'embed', 'start': 988.339, 'weight': 1, 'content': [{'end': 995.704, 'text': 'And so we want to build our co-pilot, GitHub co-pilot, all as developers on top of OpenAI APIs.', 'start': 988.339, 'duration': 7.365}, {'end': 997.285, 'text': 'And so we are very, very committed to that.', 'start': 995.824, 'duration': 1.461}, {'end': 1005.45, 'text': 'And what does that mean to developers? You know, look, I always think of Microsoft as a platform company, a developer company, and a partner company.', 'start': 997.345, 'duration': 8.105}, {'end': 1010.873, 'text': 'And so we want to make you know, for example, we want to make GitHub available, GitHub co-pilot available,', 'start': 1005.51, 'duration': 5.363}, {'end': 1014.335, 'text': 'the Enterprise Edition available to all the attendees here, so that they can try it out.', 'start': 1010.873, 'duration': 3.462}], 'summary': 'Microsoft is committed to building github co-pilot on openai apis, making it available to all attendees.', 'duration': 25.996, 'max_score': 988.339, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk988339.jpg'}, {'end': 1119.866, 'src': 'embed', 'start': 1095.096, 'weight': 2, 'content': [{'end': 1101.578, 'text': 'And to me, ultimately, AI is only going to be useful if it truly does empower, right? I mean, I saw the video you played early.', 'start': 1095.096, 'duration': 6.482}, {'end': 1102.838, 'text': 'I mean, that was fantastic.', 'start': 1101.638, 'duration': 1.2}, {'end': 1109.221, 'text': 'to hear those voices, describe what AI meant for them and what they were able to achieve.', 'start': 1103.018, 'duration': 6.203}, {'end': 1116.564, 'text': "So ultimately, it's about being able to get the benefits of AI broadly disseminated to everyone, I think is going to be the goal for us.", 'start': 1109.261, 'duration': 7.303}, {'end': 1119.866, 'text': "And then the last thing is, of course, we're very grounded in the fact that safety matters.", 'start': 1116.644, 'duration': 3.222}], 'summary': 'Ai should empower and benefit everyone while prioritizing safety.', 'duration': 24.77, 'max_score': 1095.096, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1095096.jpg'}, {'end': 1176.506, 'src': 'heatmap', 'start': 1148.403, 'weight': 0.716, 'content': [{'end': 1153.346, 'text': "but even though this is developer conference, we can't resist making some improvements to chat gpt.", 'start': 1148.403, 'duration': 4.943}, {'end': 1163.236, 'text': "So a small one ChatGPT now uses GPT-4 Turbo with all the latest improvements, including the latest knowledge cutoff, which we'll continue to update.", 'start': 1155.43, 'duration': 7.806}, {'end': 1164.417, 'text': "That's all live today.", 'start': 1163.596, 'duration': 0.821}, {'end': 1171.682, 'text': 'It can now browse the web when it needs to, write and run code, analyze data, take and generate images, and much more.', 'start': 1165.738, 'duration': 5.944}, {'end': 1176.506, 'text': 'And we heard your feedback, that model picker, extremely annoying, that is gone starting today.', 'start': 1172.083, 'duration': 4.423}], 'summary': 'Chatgpt now uses gpt-4 turbo, live today, with added functionalities and removal of the annoying model picker.', 'duration': 28.103, 'max_score': 1148.403, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1148403.jpg'}, {'end': 1260.435, 'src': 'embed', 'start': 1229.046, 'weight': 3, 'content': [{'end': 1231.367, 'text': 'The upsides of this are going to be tremendous.', 'start': 1229.046, 'duration': 2.321}, {'end': 1239.629, 'text': 'At OpenAI, we really believe that gradual iterative deployment is the best way to address the safety issues, the safety challenges with AI.', 'start': 1232.367, 'duration': 7.262}, {'end': 1244.319, 'text': "We think it's especially important to move carefully towards this future of agents.", 'start': 1240.796, 'duration': 3.523}, {'end': 1249.444, 'text': "It's gonna require a lot of technical work and a lot of thoughtful consideration by society.", 'start': 1244.92, 'duration': 4.524}, {'end': 1255.19, 'text': "So today, we're taking our first small step that moves us towards this future.", 'start': 1250.866, 'duration': 4.324}, {'end': 1260.435, 'text': "We're thrilled to introduce GPTs.", 'start': 1256.171, 'duration': 4.264}], 'summary': 'Openai introduces gpts, emphasizing gradual iterative deployment for addressing safety challenges with ai.', 'duration': 31.389, 'max_score': 1229.046, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1229046.jpg'}], 'start': 859.367, 'title': "Microsoft ceo's partnership with openai", 'summary': "Highlights microsoft ceo satya nadella's partnership with openai, emphasizing infrastructure improvements, commitment to developers, and the goal to empower every person and organization with ai while prioritizing safety.", 'chapters': [{'end': 1249.444, 'start': 859.367, 'title': 'Microsoft ceo on partnership with openai', 'summary': "Highlights microsoft ceo satya nadella's discussion about the partnership with openai, focusing on infrastructure improvements, commitment to developers, and the future of ai, emphasizing the goal to empower every person and organization with ai while prioritizing safety.", 'duration': 390.077, 'highlights': ["Microsoft's focus on building the best system in partnership with OpenAI to support large, synchronous, and data parallel training jobs, resulting in a drastic transformation of Azure's infrastructure to enable the development of best models. Microsoft's commitment to building the best system for large training jobs, synchronous and data parallel workloads, leading to a significant transformation of Azure infrastructure.", "Microsoft's dedication to building products, such as GitHub co-pilot, on top of OpenAI APIs, and making them available to developers, showcasing their commitment as a platform and developer company. Microsoft's commitment to building products on top of OpenAI APIs and making them available to developers, demonstrating their role as a platform and developer company.", "Satya Nadella's emphasis on empowering every person and every organization with AI, underlining the importance of AI being useful and disseminated broadly while prioritizing safety in the development process. Satya Nadella's focus on empowering every person and organization with AI, highlighting the importance of broad dissemination and safety in the development process.", "OpenAI's focus on gradual iterative deployment as the best approach to address safety challenges with AI, especially in moving carefully towards the future of agents, requiring technical work and societal consideration. OpenAI's emphasis on gradual iterative deployment to address safety challenges with AI, particularly in the context of moving towards the future of agents, necessitating technical work and societal consideration."]}], 'duration': 390.077, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk859367.jpg', 'highlights': ["Microsoft's commitment to building the best system for large training jobs, synchronous and data parallel workloads, leading to a significant transformation of Azure infrastructure.", "Microsoft's dedication to building products on top of OpenAI APIs and making them available to developers, demonstrating their role as a platform and developer company.", "Satya Nadella's focus on empowering every person and organization with AI, highlighting the importance of broad dissemination and safety in the development process.", "OpenAI's emphasis on gradual iterative deployment to address safety challenges with AI, particularly in the context of moving towards the future of agents, necessitating technical work and societal consideration."]}, {'end': 1529.947, 'segs': [{'end': 1278.056, 'src': 'embed', 'start': 1250.866, 'weight': 1, 'content': [{'end': 1255.19, 'text': "So today, we're taking our first small step that moves us towards this future.", 'start': 1250.866, 'duration': 4.324}, {'end': 1260.435, 'text': "We're thrilled to introduce GPTs.", 'start': 1256.171, 'duration': 4.264}, {'end': 1265.94, 'text': 'GPTs are tailored versions of ChatGPT for a specific purpose.', 'start': 1261.716, 'duration': 4.224}, {'end': 1276.515, 'text': 'You can build a GPT, a customized version of ChatGPT for almost anything, with instructions, expanded knowledge and actions,', 'start': 1267.13, 'duration': 9.385}, {'end': 1278.056, 'text': 'and then you can publish it for others to use.', 'start': 1276.515, 'duration': 1.541}], 'summary': 'Introducing gpts, tailored versions of chatgpt for specific purposes, allowing customization and publishing for others to use.', 'duration': 27.19, 'max_score': 1250.866, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1250866.jpg'}, {'end': 1334.616, 'src': 'embed', 'start': 1303.037, 'weight': 0, 'content': [{'end': 1305.398, 'text': "It's easy to customize the behavior so that it fits what you want.", 'start': 1303.037, 'duration': 2.361}, {'end': 1309.639, 'text': 'This makes building them very accessible, and it gives agency to everyone.', 'start': 1306.058, 'duration': 3.581}, {'end': 1319.242, 'text': "So we're gonna show you what GPTs are, how to use them, how to build them, and then we're gonna talk about how they'll be distributed and discovered.", 'start': 1311.12, 'duration': 8.122}, {'end': 1325.29, 'text': "And then after that, for developers, we're gonna show you how to build these agent-like experiences into your own apps.", 'start': 1320.247, 'duration': 5.043}, {'end': 1328.232, 'text': "So first, let's look at a few examples.", 'start': 1325.811, 'duration': 2.421}, {'end': 1334.616, 'text': 'Our partners at Code.org are working hard to expand computer science in schools.', 'start': 1329.693, 'duration': 4.923}], 'summary': 'Customize and build accessible gpts, distribute them, and integrate into apps. code.org expanding computer science in schools.', 'duration': 31.579, 'max_score': 1303.037, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1303037.jpg'}, {'end': 1385.307, 'src': 'embed', 'start': 1339.94, 'weight': 2, 'content': [{'end': 1345.824, 'text': 'Code.org crafted Lesson Planner GPT to help teachers provide a more engaging experience for middle schoolers.', 'start': 1339.94, 'duration': 5.884}, {'end': 1351.677, 'text': 'If a teacher asks it to explain for loops in a creative way, it does just that.', 'start': 1347.455, 'duration': 4.222}, {'end': 1358.719, 'text': "In this case, it'll do it in terms of a video game character repeatedly picking up coins, super easy to understand for an eighth grader.", 'start': 1352.437, 'duration': 6.282}, {'end': 1368.063, 'text': "As you can see, this GPT brings together code.org's extensive curriculum and expertise and lets teachers adapt it to their needs quickly and easily.", 'start': 1360.12, 'duration': 7.943}, {'end': 1376.546, 'text': 'Next, Canva has built a GPT that lets you start designing by describing what you want in natural language.', 'start': 1369.703, 'duration': 6.843}, {'end': 1385.307, 'text': "If you say make a poster for a Dev Day reception this afternoon, this evening, and you give it some details, it'll generate a few options,", 'start': 1377.762, 'duration': 7.545}], 'summary': "Code.org's lesson planner gpt engages middle schoolers, canva's gpt designs posters from natural language.", 'duration': 45.367, 'max_score': 1339.94, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1339940.jpg'}, {'end': 1432.403, 'src': 'embed', 'start': 1407.856, 'weight': 3, 'content': [{'end': 1415.538, 'text': 'Zapier has built a GPT that lets you perform actions across 6,000 applications to unlock all kinds of integration possibilities.', 'start': 1407.856, 'duration': 7.682}, {'end': 1420.62, 'text': "I'd like to introduce Jessica, one of our solutions architects, who is going to drive this demo.", 'start': 1416.318, 'duration': 4.302}, {'end': 1421.3, 'text': 'Welcome, Jessica.', 'start': 1420.7, 'duration': 0.6}, {'end': 1423.681, 'text': 'Thank you, Sam.', 'start': 1421.32, 'duration': 2.361}, {'end': 1427.022, 'text': 'Thank you all.', 'start': 1423.701, 'duration': 3.321}, {'end': 1431.143, 'text': 'Thank you all for being here.', 'start': 1430.243, 'duration': 0.9}, {'end': 1432.403, 'text': 'My name is Jessica Shea.', 'start': 1431.383, 'duration': 1.02}], 'summary': "Zapier's gpt allows actions across 6,000 apps for diverse integrations.", 'duration': 24.547, 'max_score': 1407.856, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1407856.jpg'}], 'start': 1250.866, 'title': 'Gpts for customized chat and agent-like experiences', 'summary': 'Introduces gpts for tailored chat purposes and discusses how various companies have leveraged gpts to enhance computer science education, streamline design processes, and integrate across 6,000 applications.', 'chapters': [{'end': 1319.242, 'start': 1250.866, 'title': 'Introducing gpts for customized chat', 'summary': 'Introduces gpts, tailored versions of chatgpt for specific purposes, making it easier to accomplish tasks or have fun by combining instructions, expanded knowledge, and actions, allowing users to program a gpt with language and customize its behavior.', 'duration': 68.376, 'highlights': ['Users can build a customized version of ChatGPT (GPT) for almost anything, combining instructions, expanded knowledge, and actions, making it more helpful and easier to use.', 'GPTs can work better in many contexts, giving users better control and making it easier to accomplish tasks or just have more fun.', 'GPTs allow users to program a GPT with language just by talking to it, making it easy to customize the behavior to fit specific needs, providing accessibility and agency to everyone.', 'The chapter covers how to use GPTs, how to build them, and their distribution and discovery processes, enabling users to understand and utilize this new feature effectively.']}, {'end': 1529.947, 'start': 1320.247, 'title': 'Building agent-like experiences with gpts', 'summary': 'Discusses how code.org, canva, and zapier have built gpts to enhance computer science education, streamline design processes, and enable seamless integration across 6,000 applications, with examples and benefits highlighted.', 'duration': 209.7, 'highlights': ["Code.org's Lesson Planner GPT engages middle schoolers with interactive explanations for computer science concepts, used by tens of millions of students worldwide.", "Canva's GPT enables natural language-based design creation, generating options for specific requests, streamlining the design process.", "Zapier's GPT allows performing actions across 6,000 applications, ensuring security and user permission before executing tasks, exemplified by calendar management and real-time communication integration."]}], 'duration': 279.081, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1250866.jpg', 'highlights': ['GPTs allow users to program a GPT with language just by talking to it, making it easy to customize the behavior to fit specific needs, providing accessibility and agency to everyone.', 'Introduces gpts for tailored chat purposes and discusses how various companies have leveraged gpts to enhance computer science education, streamline design processes, and integrate across 6,000 applications.', "Canva's GPT enables natural language-based design creation, generating options for specific requests, streamlining the design process.", "Zapier's GPT allows performing actions across 6,000 applications, ensuring security and user permission before executing tasks, exemplified by calendar management and real-time communication integration.", "Code.org's Lesson Planner GPT engages middle schoolers with interactive explanations for computer science concepts, used by tens of millions of students worldwide."]}, {'end': 1909.748, 'segs': [{'end': 1615.315, 'src': 'embed', 'start': 1567.297, 'weight': 2, 'content': [{'end': 1570.858, 'text': "We've made it so that you can program a GPT just by having a conversation.", 'start': 1567.297, 'duration': 3.561}, {'end': 1576.8, 'text': 'We believe that natural language is going to be a big part of how people use computers in the future,', 'start': 1572.359, 'duration': 4.441}, {'end': 1578.661, 'text': 'and we think this is an interesting early example.', 'start': 1576.8, 'duration': 1.861}, {'end': 1580.702, 'text': "So I'd like to show you how to build one.", 'start': 1579.561, 'duration': 1.141}, {'end': 1591.707, 'text': "All right, so I'm gonna create a GPT that helps give founders and developers advice when starting new projects.", 'start': 1585.964, 'duration': 5.743}, {'end': 1599.05, 'text': "I'm gonna go to create a GPT here, and this drops me into the GPT builder.", 'start': 1594.648, 'duration': 4.402}, {'end': 1603.992, 'text': 'I worked with founders for years at YC and still, whenever I meet developers,', 'start': 1600.391, 'duration': 3.601}, {'end': 1607.454, 'text': 'the questions I get are always about how do I think about a business idea?', 'start': 1603.992, 'duration': 3.462}, {'end': 1608.234, 'text': 'can you give me some advice?', 'start': 1607.454, 'duration': 0.78}, {'end': 1611.096, 'text': "I'm gonna see if I can build a GPT to help with that.", 'start': 1609.315, 'duration': 1.781}, {'end': 1615.315, 'text': 'So to start, GPT Builder asks me what I want to make.', 'start': 1612.133, 'duration': 3.182}], 'summary': 'Building a gpt to provide advice for founders and developers using natural language interaction.', 'duration': 48.018, 'max_score': 1567.297, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1567297.jpg'}, {'end': 1839.152, 'src': 'embed', 'start': 1807.631, 'weight': 0, 'content': [{'end': 1813.172, 'text': "Now we could go on and it would start following the other instructions and grill me on why I'm not growing faster,", 'start': 1807.631, 'duration': 5.541}, {'end': 1815.152, 'text': "but in the interest of time I'm gonna skip that.", 'start': 1813.172, 'duration': 1.98}, {'end': 1817.773, 'text': "I'm gonna publish this only to me for now.", 'start': 1815.992, 'duration': 1.781}, {'end': 1825.148, 'text': 'I can work on it later, I can add more content, I can add a few actions that I think would be useful, and then I can share it publicly.', 'start': 1819.346, 'duration': 5.802}, {'end': 1827.569, 'text': "So that's what it looks like to create a GPT.", 'start': 1826.048, 'duration': 1.521}, {'end': 1830.29, 'text': 'Thank you.', 'start': 1830.07, 'duration': 0.22}, {'end': 1839.152, 'text': 'By the way, I always wanted to do that.', 'start': 1836.892, 'duration': 2.26}], 'summary': 'Skipping instructions to save time, planning to add more content and share gpt publicly.', 'duration': 31.521, 'max_score': 1807.631, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1807631.jpg'}, {'end': 1889.781, 'src': 'heatmap', 'start': 1858.769, 'weight': 0.752, 'content': [{'end': 1862.251, 'text': 'Or you can share your creations publicly with a link for anyone to use.', 'start': 1858.769, 'duration': 3.482}, {'end': 1868.615, 'text': "Or if you're on ChatGPT Enterprise, you can make GPTs just for your company.", 'start': 1864.133, 'duration': 4.482}, {'end': 1873.779, 'text': "And later this month, we're gonna launch the GPT Store.", 'start': 1870.597, 'duration': 3.182}, {'end': 1877.635, 'text': 'You can list a GP..', 'start': 1875.734, 'duration': 1.901}, {'end': 1879.036, 'text': 'Thank you, I appreciate that.', 'start': 1877.635, 'duration': 1.401}, {'end': 1889.781, 'text': "You can list a GPT there and we'll be able to feature the best and the most popular GPTs.", 'start': 1885.339, 'duration': 4.442}], 'summary': 'Share creations publicly, gpts for company, gpt store launching this month', 'duration': 31.012, 'max_score': 1858.769, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1858769.jpg'}, {'end': 1916.194, 'src': 'embed', 'start': 1890.742, 'weight': 1, 'content': [{'end': 1895.584, 'text': "Of course, we'll make sure that GPTs in the store follow our policies before they're accessible.", 'start': 1890.742, 'duration': 4.842}, {'end': 1899.026, 'text': 'Revenue sharing is important to us.', 'start': 1897.565, 'duration': 1.461}, {'end': 1905.309, 'text': "We're gonna pay people who build the most useful and the most used GPTs a portion of our revenue.", 'start': 1900.286, 'duration': 5.023}, {'end': 1909.748, 'text': "We're excited to foster a vibrant ecosystem with the GPT store.", 'start': 1906.425, 'duration': 3.323}, {'end': 1914.072, 'text': "Just from what we've been building ourselves over the weekend, we're confident there's gonna be a lot of great stuff.", 'start': 1910.089, 'duration': 3.983}, {'end': 1916.194, 'text': "We're excited to share more information soon.", 'start': 1914.533, 'duration': 1.661}], 'summary': 'Gpt store will ensure policy adherence, revenue sharing, and foster a vibrant ecosystem.', 'duration': 25.452, 'max_score': 1890.742, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1890742.jpg'}], 'start': 1531.508, 'title': 'Creating gpts for startups', 'summary': 'Explores creating gpts without coding, exemplifying building a gpt to offer advice to startup founders and developers. additionally, it delves into the process of creating gpts for startups, involving uploading lectures, adding custom actions, and fostering a vibrant ecosystem through the gpt store with revenue sharing.', 'chapters': [{'end': 1700.893, 'start': 1531.508, 'title': 'Creating gpts without coding', 'summary': 'Discusses the potential of creating gpts without coding, showcasing an example of building a gpt to provide advice to startup founders and developers, highlighting the ease of creating gpts through natural language and the impact on future computer usage.', 'duration': 169.385, 'highlights': ['The chapter discusses the potential of creating GPTs without coding It showcases an example of building a GPT to provide advice to startup founders and developers, demonstrating the ease of creating GPTs through natural language.', 'The impact on future computer usage It emphasizes that natural language will be a significant part of how people use computers in the future, indicating a shift in interaction methods.', 'Showcasing an example of building a GPT to provide advice to startup founders and developers It illustrates the process of creating a GPT to offer guidance on business ideas and growth, catering to the needs of startup founders and developers.']}, {'end': 1909.748, 'start': 1700.893, 'title': 'Creating gpts for startups', 'summary': 'Explains the process of creating gpts for startups, including uploading lectures, adding custom actions, and sharing publicly, aiming to foster a vibrant ecosystem through the gpt store with revenue sharing.', 'duration': 208.855, 'highlights': ['The process involves uploading lectures, adding custom actions, and sharing publicly to create GPTs for startups.', 'The GPT store will be launched later this month, allowing users to list and feature GPTs, and revenue sharing will be provided to those who build useful and popular GPTs.', 'The chapter emphasizes fostering a vibrant ecosystem through the GPT store and revenue sharing.']}], 'duration': 378.24, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1531508.jpg', 'highlights': ['The process involves uploading lectures, adding custom actions, and sharing publicly to create GPTs for startups.', 'The GPT store will be launched later this month, allowing users to list and feature GPTs, and revenue sharing will be provided to those who build useful and popular GPTs.', 'Showcasing an example of building a GPT to provide advice to startup founders and developers It illustrates the process of creating a GPT to offer guidance on business ideas and growth, catering to the needs of startup founders and developers.', 'The chapter discusses the potential of creating GPTs without coding It showcases an example of building a GPT to provide advice to startup founders and developers, demonstrating the ease of creating GPTs through natural language.', 'The chapter emphasizes fostering a vibrant ecosystem through the GPT store and revenue sharing.', 'The impact on future computer usage It emphasizes that natural language will be a significant part of how people use computers in the future, indicating a shift in interaction methods.']}, {'end': 2225.85, 'segs': [{'end': 1985.024, 'src': 'embed', 'start': 1935.211, 'weight': 0, 'content': [{'end': 1939.272, 'text': 'Many of you have already been building agent-like experiences on the API.', 'start': 1935.211, 'duration': 4.061}, {'end': 1945.274, 'text': 'For example, Shopify Sidekick, which lets you take actions on the platform.', 'start': 1940.373, 'duration': 4.901}, {'end': 1952.196, 'text': "Discord's Clyde lets Discord moderators create custom personalities for, and Snap's MyAI,", 'start': 1945.274, 'duration': 6.922}, {'end': 1955.717, 'text': 'a customized chatbot that can be added to group chats and make recommendations.', 'start': 1952.196, 'duration': 3.521}, {'end': 1959.751, 'text': 'These experiences are great, but they have been hard to build.', 'start': 1956.518, 'duration': 3.233}, {'end': 1966.935, 'text': "Sometimes taking months, teams of dozens of engineers, there's a lot to handle to make this custom Assistant experience.", 'start': 1960.492, 'duration': 6.443}, {'end': 1972.438, 'text': "So today we're making that a lot easier with our new Assistance API.", 'start': 1968.956, 'duration': 3.482}, {'end': 1985.024, 'text': "The Assistance API includes persistent threads so they don't have to figure out how to deal with long conversation history.", 'start': 1978.32, 'duration': 6.704}], 'summary': 'New assistance api makes building custom chatbots easier and faster.', 'duration': 49.813, 'max_score': 1935.211, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1935211.jpg'}, {'end': 2057.469, 'src': 'embed', 'start': 2013.444, 'weight': 2, 'content': [{'end': 2017.709, 'text': "It's been so inspiring to see so many of you infusing AI into your apps.", 'start': 2013.444, 'duration': 4.265}, {'end': 2021.874, 'text': "Today we're launching new modalities in the API,", 'start': 2018.57, 'duration': 3.304}, {'end': 2027.741, 'text': 'but we are also very excited to improve the developer experience for you all to build assistive agents.', 'start': 2021.874, 'duration': 5.867}, {'end': 2029.123, 'text': "So let's dive right in.", 'start': 2028.402, 'duration': 0.721}, {'end': 2035.488, 'text': "Imagine I'm building Wanderlust, a travel app for global explorers, and this is the landing page.", 'start': 2030.925, 'duration': 4.563}, {'end': 2039.15, 'text': "I've actually used GPT-4 to come up with these destination ideas.", 'start': 2036.289, 'duration': 2.861}, {'end': 2047.516, 'text': 'And for those of you with a keen eye, these illustrations are generated programmatically using the new DALI 3 API available to all of you today.', 'start': 2039.23, 'duration': 8.286}, {'end': 2049.097, 'text': "So it's pretty remarkable.", 'start': 2047.816, 'duration': 1.281}, {'end': 2054.67, 'text': "But let's enhance this app by adding a very simple assistant to it.", 'start': 2051.069, 'duration': 3.601}, {'end': 2056.03, 'text': 'This is the screen.', 'start': 2055.27, 'duration': 0.76}, {'end': 2057.469, 'text': "We're gonna come back to it in a second.", 'start': 2056.05, 'duration': 1.419}], 'summary': 'New modalities in api, improving developer experience for building assistive agents, using gpt-4 and dali 3 api for app enhancement.', 'duration': 44.025, 'max_score': 2013.444, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk2013444.jpg'}, {'end': 2199.572, 'src': 'heatmap', 'start': 2079.446, 'weight': 4, 'content': [{'end': 2085.25, 'text': 'Next, I can integrate with two new primitives of this assistance API, threads and messages.', 'start': 2079.446, 'duration': 5.804}, {'end': 2087.011, 'text': "Let's take a quick look at the code.", 'start': 2085.87, 'duration': 1.141}, {'end': 2090.393, 'text': 'The process here is very simple.', 'start': 2089.032, 'duration': 1.361}, {'end': 2093.315, 'text': 'For each new user, I will create a new thread.', 'start': 2090.853, 'duration': 2.462}, {'end': 2098.299, 'text': 'And as these users engage with their assistant, I will add their messages to these threads.', 'start': 2094.056, 'duration': 4.243}, {'end': 2099.628, 'text': 'Very simple.', 'start': 2099.127, 'duration': 0.501}, {'end': 2105.593, 'text': 'And then I can simply run the assistant at any time to stream the responses back to the app.', 'start': 2100.288, 'duration': 5.305}, {'end': 2108.977, 'text': 'So we can return to the app and try that in action.', 'start': 2106.354, 'duration': 2.623}, {'end': 2112.36, 'text': "If I say, hey, let's go to Paris.", 'start': 2110.218, 'duration': 2.142}, {'end': 2117.144, 'text': "All right, that's it.", 'start': 2115.943, 'duration': 1.201}, {'end': 2122.67, 'text': 'With just a few lines of code, users can now have a very specialized assistant right inside the app.', 'start': 2117.225, 'duration': 5.445}, {'end': 2127.241, 'text': "And I'd like to highlight one of my favorite features here, function calling.", 'start': 2124.158, 'duration': 3.083}, {'end': 2130.984, 'text': 'If you have not used it yet, function calling is really powerful.', 'start': 2127.841, 'duration': 3.143}, {'end': 2134.267, 'text': "And as Sam mentioned, we're taking it a step further today.", 'start': 2131.504, 'duration': 2.763}, {'end': 2141.793, 'text': 'It now guarantees the JSON output with no added latency, and you can invoke multiple functions at once for the first time.', 'start': 2135.007, 'duration': 6.786}, {'end': 2151.862, 'text': "So here, if I carry on and say, hey, what are the top 10 things to do? We're gonna have the assistant respond to that again.", 'start': 2142.914, 'duration': 8.948}, {'end': 2159.094, 'text': "And here what's interesting is that the assistant knows about functions, including those to annotate the map that you see on the right.", 'start': 2153.464, 'duration': 5.63}, {'end': 2162.94, 'text': 'And so now all of these pins are dropping in real time here.', 'start': 2159.975, 'duration': 2.965}, {'end': 2165.485, 'text': "Yeah, it's pretty cool.", 'start': 2164.423, 'duration': 1.062}, {'end': 2176.348, 'text': 'And that integration allows our natural language interface to interact fluidly with components and features of our app.', 'start': 2169.625, 'duration': 6.723}, {'end': 2183.992, 'text': 'And it truly showcases now the harmony you can build between AI and UI where the assistant is actually taking action.', 'start': 2176.788, 'duration': 7.204}, {'end': 2187.383, 'text': "But next, let's talk about retrieval.", 'start': 2185.282, 'duration': 2.101}, {'end': 2192.627, 'text': 'And retrieval is about giving our assistant more knowledge beyond these immediate user messages.', 'start': 2187.844, 'duration': 4.783}, {'end': 2196.63, 'text': 'In fact, I got inspired and I already booked my tickets to Paris.', 'start': 2193.307, 'duration': 3.323}, {'end': 2199.572, 'text': "So I'm just gonna drag and drop here this PDF.", 'start': 2197.13, 'duration': 2.442}], 'summary': 'Integrating new primitives for creating threads and messages, showcasing function calling, and highlighting the harmony between ai and ui.', 'duration': 120.126, 'max_score': 2079.446, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk2079446.jpg'}], 'start': 1910.089, 'title': 'Enhancing developer experience with assistance api', 'summary': 'Introduces the assistance api, highlighting its features such as persistent threads, built-in retrieval code interpreter, improved function calling, new ai modalities, and specialized assistant integration, reducing development time and showcasing usage of gpt-4 and dali 3 api.', 'chapters': [{'end': 2011.816, 'start': 1910.089, 'title': 'Introducing assistance api for developer conference', 'summary': 'Introduces the assistance api, highlighting its features such as persistent threads, built-in retrieval code interpreter, and improved function calling, which will make it easier and faster for developers to build agent-like experiences, reducing development time from months to days.', 'duration': 101.727, 'highlights': ["The Assistance API includes persistent threads so they don't have to figure out how to deal with long conversation history, a built-in retrieval code interpreter, a working Python interpreter in a sandbox environment, and improved function calling, making it easier and faster for developers to build agent-like experiences, reducing development time from months to days.", "Examples of agent-like experiences built on the API include Shopify Sidekick, Discord's Clyde, and Snap's MyAI, which have been hard to build, taking months and teams of dozens of engineers, but with the introduction of the Assistance API, this will be a lot easier and faster for developers.", "We're confident there's gonna be a lot of great stuff, excited to share more information soon, and can't wait to see what developers will build using GPTs at the developer conference."]}, {'end': 2099.628, 'start': 2013.444, 'title': 'Ai modality launch and developer experience improvement', 'summary': 'Introduces new ai modalities in the api and emphasizes on improving the developer experience to build assistive agents, showcasing the usage of gpt-4 and dali 3 api for generating content in a travel app, along with the simple process of creating and integrating an assistant using the new primitives of the assistance api.', 'duration': 86.184, 'highlights': ['The chapter introduces new AI modalities in the API and emphasizes on improving the developer experience to build assistive agents The introduction of new AI modalities in the API is highlighted, along with the focus on improving the developer experience to build assistive agents.', 'Showcasing the usage of GPT-4 and DALI 3 API for generating content in a travel app The speaker showcases the usage of GPT-4 and DALI 3 API for generating destination ideas and programmatically creating illustrations for a travel app.', 'The simple process of creating and integrating an assistant using the new primitives of the assistance API The process of creating an assistant is explained, including giving it a name, initial instructions, selecting a model, tools, and integrating with new primitives of the assistance API for creating threads and adding messages.']}, {'end': 2225.85, 'start': 2100.288, 'title': 'Enhancing app with specialized assistant', 'summary': 'Discusses the integration of a specialized assistant in the app, showcasing features such as function calling, json output with no added latency, invoking multiple functions at once, and retrieval of knowledge from files, including parsing long-form documents.', 'duration': 125.562, 'highlights': ['The integration of a specialized assistant in the app allows users to have a very specialized assistant right inside the app, with just a few lines of code.', 'Function calling is now more powerful, guaranteeing the JSON output with no added latency, and enabling the invocation of multiple functions at once for the first time.', 'The assistant can interact fluidly with components and features of the app, showcasing the harmony between AI and UI.', 'Retrieval feature allows the assistant to parse long-form documents from extensive text to intricate product specs, providing extended knowledge beyond immediate user messages.']}], 'duration': 315.761, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk1910089.jpg', 'highlights': ['The Assistance API includes persistent threads, a built-in retrieval code interpreter, improved function calling, and new AI modalities, reducing development time from months to days.', "Examples of agent-like experiences built on the API include Shopify Sidekick, Discord's Clyde, and Snap's MyAI, making development a lot easier and faster for developers.", 'The chapter introduces new AI modalities in the API and emphasizes on improving the developer experience to build assistive agents.', 'Showcasing the usage of GPT-4 and DALI 3 API for generating content in a travel app.', 'The simple process of creating and integrating an assistant using the new primitives of the assistance API is explained.', 'The integration of a specialized assistant in the app allows users to have a very specialized assistant right inside the app, with just a few lines of code.', 'Function calling is now more powerful, guaranteeing the JSON output with no added latency, and enabling the invocation of multiple functions at once for the first time.', 'The assistant can interact fluidly with components and features of the app, showcasing the harmony between AI and UI.', 'Retrieval feature allows the assistant to parse long-form documents from extensive text to intricate product specs, providing extended knowledge beyond immediate user messages.']}, {'end': 2721.972, 'segs': [{'end': 2320.446, 'src': 'embed', 'start': 2246.385, 'weight': 0, 'content': [{'end': 2253.47, 'text': 'With every API call, you usually need to resend the entire conversation history, which means, you know, setting up a key value store.', 'start': 2246.385, 'duration': 7.085}, {'end': 2257.513, 'text': 'That means like handling the context window, serializing messages and so forth.', 'start': 2253.79, 'duration': 3.723}, {'end': 2261.856, 'text': 'That complexity now completely goes away with this new stateful API.', 'start': 2258.073, 'duration': 3.783}, {'end': 2266.74, 'text': "But just because OpenAI is managing this API does not mean it's a black box.", 'start': 2262.977, 'duration': 3.763}, {'end': 2271.383, 'text': 'In fact, you can see the steps that the tools are taking right inside your developer dashboard.', 'start': 2267.38, 'duration': 4.003}, {'end': 2281.15, 'text': "So here, if I go ahead and click on threads, This is the thread I believe we're currently working on and see, like these are all the steps,", 'start': 2271.963, 'duration': 9.187}, {'end': 2286.352, 'text': "including the functions being called, with the right parameters and the PDFs I've just uploaded.", 'start': 2281.15, 'duration': 5.202}, {'end': 2291.774, 'text': "But let's move on to a new capability that many of you have been requesting for a while.", 'start': 2288.032, 'duration': 3.742}, {'end': 2295.535, 'text': 'Code interpreter is now available today in the API as well.', 'start': 2292.454, 'duration': 3.081}, {'end': 2301.536, 'text': 'That gives the AI the ability to write and execute code on the fly, but even generate files.', 'start': 2296.835, 'duration': 4.701}, {'end': 2303.297, 'text': "So let's see that in action.", 'start': 2302.177, 'duration': 1.12}, {'end': 2320.446, 'text': "If I say here, hey, we'll be four friends staying at this Airbnb, what's my share of it plus my flights? All right.", 'start': 2304.474, 'duration': 15.972}], 'summary': "Openai's new stateful api simplifies handling conversation history, code interpreter available, visible tool steps in developer dashboard.", 'duration': 74.061, 'max_score': 2246.385, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk2246385.jpg'}, {'end': 2482.604, 'src': 'embed', 'start': 2433.944, 'weight': 4, 'content': [{'end': 2442.108, 'text': 'You have six unique and rich voices to choose from in the API, each speaking multiple languages, so you can really find the perfect fit for your app.', 'start': 2433.944, 'duration': 8.164}, {'end': 2446.43, 'text': "And on my laptop here on the left, you can see the logs of what's happening behind the scenes too.", 'start': 2442.848, 'duration': 3.582}, {'end': 2454.453, 'text': "So I'm using Whisper to convert the voice inputs into text, an assistant with GPT-4 Turbo, and finally the new TTS API to make it speak.", 'start': 2446.49, 'duration': 7.963}, {'end': 2463.987, 'text': 'But thanks to function calling, things get even more interesting when the Assistant can connect to the internet and take real actions for users.', 'start': 2456.36, 'duration': 7.627}, {'end': 2467.75, 'text': "So let's do something even more exciting here together.", 'start': 2464.668, 'duration': 3.082}, {'end': 2468.551, 'text': 'How about this?', 'start': 2467.991, 'duration': 0.56}, {'end': 2478.08, 'text': 'Hey, Assistant, can you randomly select five Dev Day attendees here and give them $500 in OpenAI credits?', 'start': 2470.433, 'duration': 7.647}, {'end': 2482.604, 'text': 'Yes, checking the list of attendees.', 'start': 2480.742, 'duration': 1.862}], 'summary': 'Api offers 6 voices, supports multiple languages. assistant can perform actions like giving $500 to 5 attendees.', 'duration': 48.66, 'max_score': 2433.944, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk2433944.jpg'}], 'start': 2225.85, 'title': "Openai's stateful api and assistance api", 'summary': "Highlights the advantages of openai's stateful api, simplifying tasks for developers, eliminating certain computations and set-ups, and providing transparency. it also introduces the assistance api, showcasing code interpretation, voice interaction, function calling, and the distribution of openai credits, emphasizing the potential for creating assistive experiences and the gradual advancement of ai agents.", 'chapters': [{'end': 2286.352, 'start': 2225.85, 'title': "Openai's stateful api advantages", 'summary': "Highlights the advantages of openai's stateful api, such as simplifying complex tasks for developers, eliminating the need for certain computations and set-ups, and providing transparency through the developer dashboard.", 'duration': 60.502, 'highlights': ["OpenAI's stateful API simplifies tasks for developers by handling tasks such as computing embeddings, setting up chunking algorithms, and managing conversation history, eliminating the need for developers to handle these complexities.", 'The API eliminates the need to resend the entire conversation history with every API call, reducing the complexity of setting up a key value store and handling context window and message serialization.', 'Developers can see the steps and tools being used by the API in their developer dashboard, providing transparency into the processes and functions being called.']}, {'end': 2721.972, 'start': 2288.032, 'title': 'Assistance api and function calling', 'summary': 'Introduces the assistance api, showcasing the capability for code interpretation, voice interaction, function calling, and the distribution of openai credits, highlighting the potential for creating assistive experiences and the gradual advancement of ai agents.', 'duration': 433.94, 'highlights': ['The Assistance API introduces the capability for code interpretation, enabling the AI to write and execute code on the fly and perform tasks such as computing, exchange rate calculation, and managing state for user conversations. Code interpretation enables the AI to perform tasks such as computing, exchange rate calculation, and managing state for user conversations.', 'The demonstration of voice interaction using a custom assistant showcases the use of multiple voices and languages, along with the integration of Whisper for voice-to-text conversion and the TTS API for speech synthesis. Voice interaction demonstrates the use of multiple voices and languages, Whisper for voice-to-text conversion, and the TTS API for speech synthesis.', "Function calling is exemplified by the AI's ability to take real actions, such as randomly selecting attendees and distributing $500 in OpenAI credits, demonstrating the potential for connecting to the internet and performing tasks for users. Function calling enables the AI to take real actions, such as distributing $500 in OpenAI credits and connecting to the internet to perform tasks for users."]}], 'duration': 496.122, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/U9mJuUkhUzk/pics/U9mJuUkhUzk2225850.jpg', 'highlights': ["OpenAI's stateful API simplifies tasks for developers by handling tasks such as computing embeddings, setting up chunking algorithms, and managing conversation history, eliminating the need for developers to handle these complexities.", 'The Assistance API introduces the capability for code interpretation, enabling the AI to write and execute code on the fly and perform tasks such as computing, exchange rate calculation, and managing state for user conversations.', 'Developers can see the steps and tools being used by the API in their developer dashboard, providing transparency into the processes and functions being called.', 'The API eliminates the need to resend the entire conversation history with every API call, reducing the complexity of setting up a key value store and handling context window and message serialization.', 'The demonstration of voice interaction using a custom assistant showcases the use of multiple voices and languages, along with the integration of Whisper for voice-to-text conversion and the TTS API for speech synthesis.', "Function calling is exemplified by the AI's ability to take real actions, such as randomly selecting attendees and distributing $500 in OpenAI credits, demonstrating the potential for connecting to the internet and performing tasks for users."]}], 'highlights': ['OpenAI has achieved over 2 million developers building on their API for a wide variety of use cases, with over 92% of Fortune 500 companies using their products, and about 100 million weekly active users on ChatGPT, all through word of mouth.', "The recent launches of Dolly 3, the world's most advanced image model, and ChatGPT Enterprise for enterprise customers, showcasing enterprise-grade security and privacy, higher-speed GPT-4 access, and longer context windows.", 'The introduction of voice and vision capabilities for ChatGPT, allowing it to see, hear, and speak, and the launch of GPT-4, which remains the most capable model globally.', 'The launch of GPT-4 Turbo model supporting up to 128,000 tokens of context', "Microsoft's commitment to building the best system for large training jobs, synchronous and data parallel workloads, leading to a significant transformation of Azure infrastructure.", 'GPTs allow users to program a GPT with language just by talking to it, making it easy to customize the behavior to fit specific needs, providing accessibility and agency to everyone.', 'The process involves uploading lectures, adding custom actions, and sharing publicly to create GPTs for startups.', 'The Assistance API includes persistent threads, a built-in retrieval code interpreter, improved function calling, and new AI modalities, reducing development time from months to days.', "OpenAI's stateful API simplifies tasks for developers by handling tasks such as computing embeddings, setting up chunking algorithms, and managing conversation history, eliminating the need for developers to handle these complexities."]}