title
Jay McClelland: Neural Networks and the Emergence of Cognition | Lex Fridman Podcast #222

description
Jay McClelland is a cognitive scientist at Stanford. Please support this podcast by checking out our sponsors: - Paperspace: https://gradient.run/lex to get $15 credit - Skiff: https://skiff.org/lex to get early access - Uprising Food: https://uprisingfood.com/lex to get $10 off 1st starter bundle - Four Sigmatic: https://foursigmatic.com/lex and use code LexPod to get up to 60% off - Onnit: https://lexfridman.com/onnit to get up to 10% off EPISODE LINKS: Jay's Website: https://stanford.edu/~jlmcc/ PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ Full episodes playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 Clips playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41 OUTLINE: 0:00 - Introduction 0:43 - Beauty in neural networks 5:02 - Darwin and evolution 10:47 - The origin of intelligence 17:29 - Explorations in cognition 23:33 - Learning representations by back-propagating errors 29:58 - Dave Rumelhart and cognitive modeling 43:01 - Connectionism 1:05:54 - Geoffrey Hinton 1:07:49 - Learning in a neural network 1:24:42 - Mathematics & reality 1:31:50 - Modeling intelligence 1:42:28 - Noam Chomsky and linguistic cognition 1:56:49 - Advice for young people 2:07:56 - Psychiatry and exploring the mind 2:20:35 - Legacy 2:26:24 - Meaning of life SOCIAL: - Twitter: https://twitter.com/lexfridman - LinkedIn: https://www.linkedin.com/in/lexfridman - Facebook: https://www.facebook.com/lexfridman - Instagram: https://www.instagram.com/lexfridman - Medium: https://medium.com/@lexfridman - Reddit: https://reddit.com/r/lexfridman - Support on Patreon: https://www.patreon.com/lexfridman

detail
{'title': 'Jay McClelland: Neural Networks and the Emergence of Cognition | Lex Fridman Podcast #222', 'heatmap': [{'end': 9104.676, 'start': 9023.431, 'weight': 1}], 'summary': "Explores jay mcclelland's influence on ai and neural networks, the evolution of cognitive psychology, early biological theories, rummelhart's connectionism, semantic dementia, neural network learning, computational intelligence, mathematical systems, cognitive constructs, and human development, cognition, mortality, and legacy.", 'chapters': [{'end': 195.625, 'segs': [{'end': 31.041, 'src': 'embed', 'start': 0.069, 'weight': 0, 'content': [{'end': 3.472, 'text': 'The following is a conversation with Jay McClelland,', 'start': 0.069, 'duration': 3.403}, {'end': 11.841, 'text': 'a cognitive scientist at Stanford and one of the seminal figures in the history of artificial intelligence and specifically neural networks.', 'start': 3.472, 'duration': 8.369}, {'end': 20.69, 'text': 'Having written the parallel distributed processing book with David Rumelhart, who co-authored the back propagation paper with Jeff Hinton.', 'start': 12.381, 'duration': 8.309}, {'end': 23.299, 'text': 'In their collaborations,', 'start': 21.738, 'duration': 1.561}, {'end': 31.041, 'text': "they've paved the way for many of the ideas at the center of the neural network-based machine learning revolution of the past 15 years.", 'start': 23.299, 'duration': 7.742}], 'summary': 'Jay mcclelland, a seminal figure in ai and neural networks, has contributed to the machine learning revolution over the past 15 years.', 'duration': 30.972, 'max_score': 0.069, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY69.jpg'}, {'end': 116.675, 'src': 'embed', 'start': 47.448, 'weight': 1, 'content': [{'end': 50.529, 'text': 'At the intersection of cognitive psychology and computer science.', 'start': 47.448, 'duration': 3.081}, {'end': 59.286, 'text': 'What, to you, has, over the decades, emerged as the most beautiful aspect about neural networks, both artificial and biological?', 'start': 51.741, 'duration': 7.545}, {'end': 73.196, 'text': 'The fundamental thing I think about with neural networks is how they allow us to link biology with the mysteries of thought.', 'start': 60.927, 'duration': 12.269}, {'end': 89.477, 'text': 'When I was first entering the field myself in the late 60s, early 70s, cognitive psychology had just become a field.', 'start': 77.47, 'duration': 12.007}, {'end': 93.119, 'text': 'There was a book published in 67 called Cognitive Psychology.', 'start': 89.537, 'duration': 3.582}, {'end': 104.44, 'text': 'And the author said, that the study of the nervous system was only of peripheral interest.', 'start': 96.18, 'duration': 8.26}, {'end': 106.843, 'text': "It wasn't gonna tell us anything about the mind.", 'start': 104.52, 'duration': 2.323}, {'end': 111.769, 'text': "And I didn't agree with that.", 'start': 108.465, 'duration': 3.304}, {'end': 116.675, 'text': "I always felt, oh, look, I'm a physical being.", 'start': 112.41, 'duration': 4.265}], 'summary': 'Neural networks bridge biology and cognitive psychology, challenging traditional views.', 'duration': 69.227, 'max_score': 47.448, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY47448.jpg'}, {'end': 170.369, 'src': 'embed', 'start': 143.699, 'weight': 3, 'content': [{'end': 148.241, 'text': 'we might be able to get at least very close to understanding the fundamentals of the human mind.', 'start': 143.699, 'duration': 4.542}, {'end': 154.983, 'text': 'Yeah I used to think, um, where I used to talk about the idea of awakening from the Cartesian dream.', 'start': 148.321, 'duration': 6.662}, {'end': 161.186, 'text': 'So Descartes, um, thought about these things.', 'start': 156.663, 'duration': 4.523}, {'end': 170.369, 'text': 'He was walking in the gardens of Versailles one day and he stepped on a stone and a statue moved.', 'start': 161.906, 'duration': 8.463}], 'summary': "Efforts to understand human mind, reference to descartes' awakening, statue incident", 'duration': 26.67, 'max_score': 143.699, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY143699.jpg'}], 'start': 0.069, 'title': "Jay mcclelland's and cognitive psychology's evolution", 'summary': "Delves into jay mcclelland's influence on artificial intelligence and neural networks, and the evolution of cognitive psychology from its early days in the late 60s, emphasizing the shift in understanding the mind and the potential of the nervous system, referencing descartes' concept of awakening from the cartesian dream.", 'chapters': [{'end': 73.196, 'start': 0.069, 'title': 'Jay mcclelland on neural networks', 'summary': "Discusses jay mcclelland's role in the history of artificial intelligence and neural networks, highlighting his collaboration with influential figures and their impact on the machine learning revolution, emphasizing the link between biology and thought in neural networks.", 'duration': 73.127, 'highlights': ["Jay McClelland's collaboration with influential figures like David Rumelhart and Jeff Hinton has paved the way for ideas central to the neural network-based machine learning revolution of the past 15 years.", 'The fundamental beauty of neural networks lies in their ability to link biology with the mysteries of thought, as highlighted by Jay McClelland.']}, {'end': 195.625, 'start': 77.47, 'title': 'Evolution of cognitive psychology', 'summary': "Discusses the evolution of cognitive psychology from its early days in the late 60s, emphasizing the shift from dismissing the study of the nervous system to recognizing its potential in understanding the mind, with a reference to descartes' concept of awakening from the cartesian dream.", 'duration': 118.155, 'highlights': ["The initial dismissal of the nervous system's relevance to understanding the mind Late 60s, early 70s", 'Recognition of the potential of studying neural networks in understanding the human mind Evolution of cognitive psychology', "Reference to Descartes' concept of awakening from the Cartesian dream Philosophical influence on cognitive psychology"]}], 'duration': 195.556, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY69.jpg', 'highlights': ["Jay McClelland's collaboration with influential figures like David Rumelhart and Jeff Hinton has paved the way for ideas central to the neural network-based machine learning revolution of the past 15 years.", 'The fundamental beauty of neural networks lies in their ability to link biology with the mysteries of thought, as highlighted by Jay McClelland.', 'Recognition of the potential of studying neural networks in understanding the human mind Evolution of cognitive psychology', "Reference to Descartes' concept of awakening from the Cartesian dream Philosophical influence on cognitive psychology", "The initial dismissal of the nervous system's relevance to understanding the mind Late 60s, early 70s"]}, {'end': 2096.529, 'segs': [{'end': 287.507, 'src': 'embed', 'start': 259.798, 'weight': 0, 'content': [{'end': 272.689, 'text': 'And so the study of physiology at that time was the study of sensory systems and motor systems and things that you could directly measure when you stimulated neurons and stuff like that.', 'start': 259.798, 'duration': 12.891}, {'end': 281.998, 'text': 'And the study of cognition was something that was tied in with abstract computer algorithms and things like that.', 'start': 273.831, 'duration': 8.167}, {'end': 287.507, 'text': 'But when I was an undergraduate, I learned about the physiological mechanisms.', 'start': 283.305, 'duration': 4.202}], 'summary': 'Physiology focused on sensory and motor systems, while cognition was tied to abstract computer algorithms. undergraduates learned about physiological mechanisms.', 'duration': 27.709, 'max_score': 259.798, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY259798.jpg'}, {'end': 684.234, 'src': 'embed', 'start': 656.737, 'weight': 1, 'content': [{'end': 663.861, 'text': "And that's a really interesting question when thinking about alien life, or if there's other intelligent alien civilizations out there,", 'start': 656.737, 'duration': 7.124}, {'end': 665.522, 'text': 'is how special is this leap?', 'start': 663.861, 'duration': 1.661}, {'end': 668.824, 'text': 'So one special thing seems to be the origin of life itself.', 'start': 666.082, 'duration': 2.742}, {'end': 671.486, 'text': "However you define that, there's a gray area.", 'start': 669.364, 'duration': 2.122}, {'end': 676.048, 'text': 'And the other leap, this is very biased perspective of a human, is the..', 'start': 671.926, 'duration': 4.122}, {'end': 679.05, 'text': 'the origin of intelligence.', 'start': 677.029, 'duration': 2.021}, {'end': 684.234, 'text': "And again, from an engineer perspective, it's a difficult question to ask.", 'start': 679.811, 'duration': 4.423}], 'summary': 'Exploring the uniqueness of the origin of life and intelligence in the context of potential alien civilizations.', 'duration': 27.497, 'max_score': 656.737, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY656737.jpg'}, {'end': 906.633, 'src': 'embed', 'start': 874.012, 'weight': 2, 'content': [{'end': 895.202, 'text': 'But the concept of punctuated equilibrium was a very important concept in evolutionary biology and that also feels somehow right about you know the stages of our mental abilities.', 'start': 874.012, 'duration': 21.19}, {'end': 899.206, 'text': 'We seem to have a certain kind of mindset at a certain age.', 'start': 895.262, 'duration': 3.944}, {'end': 906.633, 'text': 'And then at another age we like look at that four-year-old and say oh my God, how could they have thought that way?', 'start': 899.246, 'duration': 7.387}], 'summary': 'Punctuated equilibrium is significant in evolutionary biology, reflecting stages of mental abilities.', 'duration': 32.621, 'max_score': 874.012, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY874012.jpg'}, {'end': 1336.264, 'src': 'embed', 'start': 1301.838, 'weight': 3, 'content': [{'end': 1304.979, 'text': 'I think that a lot of people were becoming excited about that.', 'start': 1301.838, 'duration': 3.141}, {'end': 1309.901, 'text': 'And one of those people was Jim Anderson, who I had mentioned.', 'start': 1305.159, 'duration': 4.742}, {'end': 1316.143, 'text': 'Another one was Steve Grossberg, who had been writing about neural networks since the 60s.', 'start': 1310.081, 'duration': 6.062}, {'end': 1320.444, 'text': 'And Jeff Hinton was yet another.', 'start': 1318.864, 'duration': 1.58}, {'end': 1336.264, 'text': 'And his PhD dissertation showed up in an applicant pool to a postdoctoral training program that Dave and Don, the two men I mentioned before,', 'start': 1320.904, 'duration': 15.36}], 'summary': 'Multiple individuals including jim anderson, steve grossberg, and jeff hinton were excited about neural networks.', 'duration': 34.426, 'max_score': 1301.838, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY1301838.jpg'}, {'end': 1660.075, 'src': 'embed', 'start': 1622.862, 'weight': 4, 'content': [{'end': 1634.351, 'text': 'but if i could just play this out a little bit um, a, a convolutional neural network or a cnn, which you know many people may have heard of,', 'start': 1622.862, 'duration': 11.489}, {'end': 1646.286, 'text': 'is You could think of it biologically as a set of collections of neurons.', 'start': 1634.351, 'duration': 11.935}, {'end': 1655.731, 'text': "Each collection has maybe 10,000 neurons in it, but there's many layers right?", 'start': 1646.466, 'duration': 9.265}, {'end': 1660.075, 'text': 'Some of these things are hundreds or even a thousand layers deep,', 'start': 1655.811, 'duration': 4.264}], 'summary': 'Cnn has many layers, each with 10,000 neurons, some are hundreds or even a thousand layers deep.', 'duration': 37.213, 'max_score': 1622.862, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY1622862.jpg'}], 'start': 197.126, 'title': 'Early biological theories of animal behavior, evolution and human intelligence, understanding evolution and development, neural networks in the 1980s, and neural networks and parallel computation', 'summary': "Covers early biological theories including descartes' mechanistic theory, darwin's struggles and insights, evolution's influence on human intelligence, piaget's stage theory, embryonic brain development, and the early days of neural networks in the 1980s, discussing key figures, pivotal moments, and the concept of simulating neurons with neural networks.", 'chapters': [{'end': 397.876, 'start': 197.126, 'title': 'Early biological theories of animal behavior', 'summary': "Discusses descartes' mechanistic theory of animal behavior and the intertwining of physiology and cognition, while also touching upon darwin's early struggles and insights into the theory of evolution.", 'duration': 200.75, 'highlights': ["Descartes' mechanistic theory of animal behavior posited the idea of little hydraulic tubes in the body sending pressure signals to cause action.", 'The study of physiology at the time focused on sensory and motor systems, while cognition was associated with abstract computer algorithms.', "Darwin's early struggles in understanding evolution led him to spend a lot of time working on the idea and drawing different birds that differed slightly from each other.", "Darwin had nightmares about the complexity of the eye and was initially scared to publish his ideas, believing they couldn't possibly be true."]}, {'end': 819.379, 'start': 398.337, 'title': 'Evolution and human intelligence', 'summary': "Discusses the concept of evolution and its influence on human intelligence, highlighting the similarities between human and non-human animals' visual systems and the leap in cognition, as well as the role of language in collective intelligence and the potential uniqueness of human intelligence.", 'duration': 421.042, 'highlights': ['The continuity between humans and non-human animals has been second nature in the study of vision, with extremely similar visual pathways and cortical areas.', 'The leap in cognition with humans is where the difference seems to occur, leading to questions about the uniqueness of human intelligence and the potential for alien civilizations to possess similar capabilities.', 'Chomsky argued that a genetic fluke occurring 100,000 years ago resulted in the development of language, which provided a special attribute separating humans from other animals.', 'Language is considered a tool for collective intelligence, with its evolution tied to mechanisms for organizing and understanding the world.', 'The discussion also touches on the process of embryological and brain development, emphasizing the complexity of various brains and the potential influence on human intelligence.']}, {'end': 1049.55, 'start': 819.439, 'title': 'Understanding evolution and development', 'summary': "Discusses punctuated equilibrium in evolution, piaget's stage theory of child development, and the fascinating process of embryonic brain development, highlighting the importance of transitions and insights in cognitive development and the complex systems approach to evolutionary and developmental biology.", 'duration': 230.111, 'highlights': ['The concept of punctuated equilibrium in evolutionary biology challenges the idea of continuous evolution, with hundreds of millions of years of stasis followed by sudden changes occurring over a million or even 10 million years.', "Piaget's stage theory of child development emphasizes the profound differences between stages, highlighting the importance of transitions and insights in cognitive development over several years of experience.", 'The process of embryonic brain development and the self-assembly of the brain from DNA material is fascinating, with brain organoids demonstrating the emergence of a robust learning mechanism from biological programs.', 'Evolution and development, including cognitive development, are approached as complex systems, providing insights into the emergence of mind from brain and the continuous nature of the process.']}, {'end': 1417.719, 'start': 1049.83, 'title': 'Neural networks in the 1980s', 'summary': 'Explores the early days of neural networks in the 1980s, discussing the key figures involved, pivotal moments of discovery, and the excitement surrounding the concept of simulating neurons with neural networks.', 'duration': 367.889, 'highlights': ['The chapter discusses the early days of neural networks in the 1980s, mentioning key figures such as David Rumelhart, Jeff Hinton, Don Norman, and James Anderson. This provides context on the notable individuals involved in pioneering neural network research during that period.', 'The excitement and impact of simulating neurons with neural networks are emphasized, with pivotal moments such as the realization of using neural networks to bridge the gap between the mind and the brain. This showcases the pivotal shift in mindset and the potential impact of neural networks on understanding cognition and neural processes.', 'The formation of a community of scholars exploring neural network ideas and the organization of a conference focused on parallel models of associative memory in 1979 or 1980 are discussed. This illustrates the collaborative and innovative environment that contributed to the development and resonance of neural network concepts during that time.']}, {'end': 2096.529, 'start': 1417.719, 'title': 'Neural networks and parallel computation', 'summary': 'Discusses the concept of neural networks and parallel computation, highlighting the revolutionary thinking behind computation, the structure and functioning of convolutional neural networks, and the influential figure of dave romahart in the development of cognitive modeling.', 'duration': 678.81, 'highlights': ['The chapter discusses the revolutionary thinking behind computation, emphasizing the shift from sequential to parallel computation and the emergence of certain characteristics of the human mind. Shift from sequential to parallel computation, emergence of human mind characteristics', "The structure and functioning of convolutional neural networks are explained, detailing the layers, number of neurons, and the system's capability to perform classification tasks akin to human cognition. Structure and functioning of convolutional neural networks, capability for classification tasks", 'The influential figure of Dave Romahart is introduced, focusing on his background, education, and contributions to cognitive modeling and understanding. Introduction of Dave Romahart, his background and contributions to cognitive modeling']}], 'duration': 1899.403, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY197126.jpg', 'highlights': ['The study of physiology at the time focused on sensory and motor systems, while cognition was associated with abstract computer algorithms.', 'The leap in cognition with humans is where the difference seems to occur, leading to questions about the uniqueness of human intelligence and the potential for alien civilizations to possess similar capabilities.', 'The concept of punctuated equilibrium in evolutionary biology challenges the idea of continuous evolution, with hundreds of millions of years of stasis followed by sudden changes occurring over a million or even 10 million years.', 'The chapter discusses the early days of neural networks in the 1980s, mentioning key figures such as David Rumelhart, Jeff Hinton, Don Norman, and James Anderson. This provides context on the notable individuals involved in pioneering neural network research during that period.', "The structure and functioning of convolutional neural networks are explained, detailing the layers, number of neurons, and the system's capability to perform classification tasks akin to human cognition."]}, {'end': 3330.185, 'segs': [{'end': 2186.34, 'src': 'embed', 'start': 2143.042, 'weight': 0, 'content': [{'end': 2146.963, 'text': 'how can they, like mechanistically be applied to build these knowledge,', 'start': 2143.042, 'duration': 3.921}, {'end': 2156.285, 'text': 'like to actually build something that looks like a web of knowledge and thereby from there emerges something like understanding?', 'start': 2146.963, 'duration': 9.322}, {'end': 2157.385, 'text': 'Yeah Whatever the heck that is.', 'start': 2156.305, 'duration': 1.08}, {'end': 2165.713, 'text': 'Yeah This was something that they grappled with at the end of that book that I was describing, Explorations in Cognition.', 'start': 2157.825, 'duration': 7.888}, {'end': 2174.001, 'text': "But he was realizing that the paradigm of good old-fashioned AI wasn't giving him the answers to these questions.", 'start': 2166.534, 'duration': 7.467}, {'end': 2178.596, 'text': "And- By the way, that's called good old-fashioned AI now.", 'start': 2175.894, 'duration': 2.702}, {'end': 2180.617, 'text': "It wasn't called that at the time.", 'start': 2178.876, 'duration': 1.741}, {'end': 2181.397, 'text': 'Well, it was.', 'start': 2180.637, 'duration': 0.76}, {'end': 2183.178, 'text': 'It was beginning to be called that.', 'start': 2181.557, 'duration': 1.621}, {'end': 2184.599, 'text': 'Oh, because it was from the 60s.', 'start': 2183.198, 'duration': 1.401}, {'end': 2186.34, 'text': 'Yeah, yeah.', 'start': 2184.719, 'duration': 1.621}], 'summary': 'Challenges in applying mechanistic knowledge to build a web of understanding in ai, as discussed in explorations in cognition.', 'duration': 43.298, 'max_score': 2143.042, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY2143042.jpg'}, {'end': 2501.896, 'src': 'embed', 'start': 2467.692, 'weight': 2, 'content': [{'end': 2475.759, 'text': 'was that he could replace those experts with neuron-like processing units, which just would have their connection weights that would do this job.', 'start': 2467.692, 'duration': 8.067}, {'end': 2489.13, 'text': 'So what ended up happening was that Romel Hart and I got together and we created a model called the Interactive Activation Model of Letter Perception,', 'start': 2476.66, 'duration': 12.47}, {'end': 2501.896, 'text': 'which takes these little pixel level inputs, constructs line segment, features letters and words,', 'start': 2489.13, 'duration': 12.766}], 'summary': 'Created a model to replace experts with neuron-like processing units for letter perception.', 'duration': 34.204, 'max_score': 2467.692, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY2467692.jpg'}, {'end': 2868.7, 'src': 'embed', 'start': 2836.581, 'weight': 3, 'content': [{'end': 2841.726, 'text': "The one that tells us that it's our dog or it's a cat or a dog.", 'start': 2836.581, 'duration': 5.145}, {'end': 2846.611, 'text': 'But each layer is probably equally as important in the grand scheme of things.', 'start': 2842.266, 'duration': 4.345}, {'end': 2853.08, 'text': "There's no reason why the cat versus dog is more important than the lower level activations.", 'start': 2848.393, 'duration': 4.687}, {'end': 2853.961, 'text': "It doesn't really matter.", 'start': 2853.14, 'duration': 0.821}, {'end': 2857.647, 'text': 'I mean, all of it is just this beautiful stacking on top of each other.', 'start': 2854.122, 'duration': 3.525}, {'end': 2860.331, 'text': 'And we humans live in this particular layers for us.', 'start': 2857.687, 'duration': 2.644}, {'end': 2868.7, 'text': "For us it's useful to, to survive, to use those cat versus dog, predator versus prey, all those kinds of things.", 'start': 2860.771, 'duration': 7.929}], 'summary': 'Different layers of categorization are equally important for survival and are stacked on top of each other, serving a useful purpose for humans.', 'duration': 32.119, 'max_score': 2836.581, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY2836581.jpg'}, {'end': 3028.79, 'src': 'embed', 'start': 3000.112, 'weight': 4, 'content': [{'end': 3009.455, 'text': 'So I think you know I would call myself in a radical emergentist, uh connectionist rather than eliminative connectionist, right?', 'start': 3000.112, 'duration': 9.343}, {'end': 3026.69, 'text': "Because I want to acknowledge that, uh, that these higher level kinds of aspects of our cognition are are real, but they're not, they're, they don't.", 'start': 3009.495, 'duration': 17.195}, {'end': 3028.79, 'text': "they don't exist as such.", 'start': 3026.69, 'duration': 2.1}], 'summary': 'Radical emergentist advocate acknowledges higher level aspects of cognition as real but not existing as such.', 'duration': 28.678, 'max_score': 3000.112, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY3000112.jpg'}], 'start': 2096.609, 'title': "Rummelhart's ai and connectionism", 'summary': "Discusses rummelhart's integration of cognition mechanisms in ai, the interactive model of reading, and the emergence of connectionism, providing insights into the shift from traditional ai, the development of neural network thinking, and the debate between emergentist and eliminative connectionist perspectives.", 'chapters': [{'end': 2208.054, 'start': 2096.609, 'title': "Rummelhart's ai exploration", 'summary': "Discusses rummelhart's exploration of the limitations of traditional ai models and his integration of cognition mechanisms to build a web of knowledge, as he grappled with the ineffectiveness of old-fashioned ai by the late 70s.", 'duration': 111.445, 'highlights': ["Rummelhart's exploration of integrating cognition mechanisms to build a web of knowledge", 'Recognition of the limitations of traditional AI models by the late 70s', 'Grapple with the ineffectiveness of old-fashioned AI', 'Interest in building AI-style models of representation of language and content']}, {'end': 2808.946, 'start': 2208.054, 'title': 'Interactive model of reading', 'summary': 'Outlines the concept of an interactive model of reading, which emphasizes the interconnectedness of various levels of analysis in reading, and the shift from expert-based to neuron-like processing units in the interactive activation model of letter perception, leading to the realization of the potential of neural network thinking in addressing cognitive psychology questions.', 'duration': 600.892, 'highlights': ['The chapter discusses the interactive model of reading, emphasizing the interconnectedness of various levels of analysis in reading, and the shift from expert-based to neuron-like processing units in the Interactive Activation Model of Letter Perception. Emphasizes interconnectedness of levels of analysis in reading, shift from expert-based to neuron-like processing units, potential of neural network thinking in addressing cognitive psychology questions.', 'The concept of the model is based on the idea that every aspect of interpretation when reading depends on all other levels of analysis, creating a completely interactive, bi-directional, parallel distributed process. Every aspect of interpretation when reading depends on all other levels of analysis, creating a completely interactive, bi-directional, parallel distributed process.', 'The shift from expert-based to neuron-like processing units in the Interactive Activation Model of Letter Perception led to the realization of the potential of neural network thinking in addressing cognitive psychology questions. Shift from expert-based to neuron-like processing units, realization of the potential of neural network thinking in addressing cognitive psychology questions.']}, {'end': 3330.185, 'start': 2810.447, 'title': 'Connectionism and emergent understanding', 'summary': 'Discusses the concept of connectionism and emergent understanding in the context of artificial intelligence, highlighting the importance of layers in cognition and the debate between emergentist and eliminative connectionist perspectives.', 'duration': 519.738, 'highlights': ['The importance of layers in cognition is emphasized, suggesting that each layer is equally important in the overall scheme of understanding.', 'The debate between emergentist and eliminative connectionist perspectives is discussed, with the speaker identifying as a radical emergentist connectionist, acknowledging the higher level aspects of cognition while emphasizing their fluid and emergent nature.', 'The concept of emergence in understanding, likened to the emergence of complex phenomena from simple rules in cellular automata, is explored, highlighting the human tendency to operate in the layer of the emergent and appreciate its magic.', 'The acknowledgment of the magic and trickery in creating illusions that move people, emphasizing the acceptance of emergent phenomena as given and not necessarily requiring deep understanding.']}], 'duration': 1233.576, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY2096609.jpg', 'highlights': ["Rummelhart's exploration of integrating cognition mechanisms to build a web of knowledge", 'Recognition of the limitations of traditional AI models by the late 70s', 'The shift from expert-based to neuron-like processing units in the Interactive Activation Model of Letter Perception led to the realization of the potential of neural network thinking in addressing cognitive psychology questions', 'The importance of layers in cognition is emphasized, suggesting that each layer is equally important in the overall scheme of understanding', 'The debate between emergentist and eliminative connectionist perspectives is discussed, with the speaker identifying as a radical emergentist connectionist, acknowledging the higher level aspects of cognition while emphasizing their fluid and emergent nature']}, {'end': 4065.783, 'segs': [{'end': 3474.893, 'src': 'embed', 'start': 3437.233, 'weight': 0, 'content': [{'end': 3446.867, 'text': "So it's a specific form of loss of mind related to meaning, semantic dementia.", 'start': 3437.233, 'duration': 9.634}, {'end': 3466.277, 'text': "And it's progressive in the sense that the patient loses the ability to appreciate the meaning of the experiences that they have, either from touch,", 'start': 3447.707, 'duration': 18.57}, {'end': 3470.971, 'text': 'from sight, from sound, from language.', 'start': 3466.277, 'duration': 4.694}, {'end': 3474.893, 'text': "they, I hear sounds, but I don't know what they mean, kind of thing.", 'start': 3470.971, 'duration': 3.922}], 'summary': 'Semantic dementia is a progressive loss of ability to appreciate meaning, affecting touch, sight, sound, and language.', 'duration': 37.66, 'max_score': 3437.233, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY3437233.jpg'}, {'end': 3634.587, 'src': 'embed', 'start': 3605.293, 'weight': 1, 'content': [{'end': 3607.715, 'text': "They can't relate the pictures to the words either.", 'start': 3605.293, 'duration': 2.422}, {'end': 3615.711, 'text': "They can't do word picture matching, but they've lost the conceptual grounding from either modality of input.", 'start': 3607.735, 'duration': 7.976}, {'end': 3619.792, 'text': "And so that's why it's called semantic dementia.", 'start': 3615.911, 'duration': 3.881}, {'end': 3622.513, 'text': 'The very semantics is disintegrating.', 'start': 3619.812, 'duration': 2.701}, {'end': 3634.587, 'text': 'And we understand this in terms of our idea that distributed representation, a pattern of activation, represents the concepts really similar ones.', 'start': 3623.554, 'duration': 11.033}], 'summary': 'Semantic dementia causes loss of conceptual grounding, affecting word-picture matching and semantic disintegration.', 'duration': 29.294, 'max_score': 3605.293, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY3605293.jpg'}, {'end': 3788.736, 'src': 'embed', 'start': 3754.189, 'weight': 3, 'content': [{'end': 3759.571, 'text': 'because I think Rumelhart is sort of like the Hawking of cognitive science to me in some ways.', 'start': 3754.189, 'duration': 5.382}, {'end': 3765.694, 'text': 'Both of them suffered from a degenerative condition.', 'start': 3761.432, 'duration': 4.262}, {'end': 3769.036, 'text': "In Hawking's case, it affected the motor system.", 'start': 3766.494, 'duration': 2.542}, {'end': 3785.274, 'text': "In Romel Hart's case, it's affecting the semantics and not just the pure object semantics, but maybe the self semantics as well.", 'start': 3770.248, 'duration': 15.026}, {'end': 3786.755, 'text': "And we don't understand that.", 'start': 3785.414, 'duration': 1.341}, {'end': 3788.736, 'text': 'Concepts broadly.', 'start': 3787.195, 'duration': 1.541}], 'summary': 'Rumelhart, like hawking, faced a degenerative condition, impacting semantics and concepts.', 'duration': 34.547, 'max_score': 3754.189, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY3754189.jpg'}, {'end': 3953.435, 'src': 'embed', 'start': 3928.145, 'weight': 4, 'content': [{'end': 3935.729, 'text': 'certain sort of Partial competencies still exist in the absence of other aspects of these competencies.', 'start': 3928.145, 'duration': 7.584}, {'end': 3949.354, 'text': 'So this is what always fascinated me about what used to be called cognitive neuropsychology, the effects of brain damage on cognition.', 'start': 3937.229, 'duration': 12.125}, {'end': 3953.435, 'text': 'But in particular this gradual disintegration part.', 'start': 3950.234, 'duration': 3.201}], 'summary': 'Cognitive neuropsychology explores effects of brain damage on cognition.', 'duration': 25.29, 'max_score': 3928.145, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY3928145.jpg'}, {'end': 4043.287, 'src': 'embed', 'start': 4017.252, 'weight': 5, 'content': [{'end': 4021.474, 'text': 'the papers on the interactive activation model that I was telling you about had just been published.', 'start': 4017.252, 'duration': 4.222}, {'end': 4027.337, 'text': 'And we both sort of saw a huge potential for this work and Jeff was there.', 'start': 4021.574, 'duration': 5.763}, {'end': 4038.264, 'text': 'And so the three of us started a research group, which we called the PDP Research Group and several other people came.', 'start': 4027.497, 'duration': 10.767}, {'end': 4043.287, 'text': 'Francis Crick, who was at the Salk Institute, heard about it from Jeff.', 'start': 4039.284, 'duration': 4.003}], 'summary': 'Papers on interactive activation model published, led to pdp research group formation.', 'duration': 26.035, 'max_score': 4017.252, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4017252.jpg'}], 'start': 3332.927, 'title': 'Semantic dementia and cognitive decline', 'summary': 'Delves into semantic dementia, a progressive neurological condition causing loss of concept appreciation, and discusses cognitive decline in cognitive scientist rumelhart, reflecting on the impact of degenerative conditions.', 'chapters': [{'end': 3634.587, 'start': 3332.927, 'title': 'Understanding semantic dementia', 'summary': 'Discusses the tragic case of a person succumbing to a progressive neurological condition, known as semantic dementia, which causes the loss of ability to appreciate the meaning of experiences and concepts, leading to an inability to relate concepts and recognize objects, such as animals, ultimately disintegrating the semantics.', 'duration': 301.66, 'highlights': ['Semantic dementia is a progressive neurological condition that leads to the loss of ability to appreciate the meaning of experiences and concepts. The disorder, known as semantic dementia, causes patients to progressively lose the ability to appreciate the meaning of experiences and concepts, impacting their understanding of touch, sight, sound, and language.', 'Patients suffering from semantic dementia struggle to differentiate between similar categories, eventually losing the ability to recognize common objects and relate concepts to each other. As the illness progresses, patients experience difficulty differentiating similar categories and recognizing common objects, ultimately losing the ability to relate concepts to one another.', 'The disorder is characterized by the disintegration of semantics, leading to an inability to relate concepts and recognize objects, ultimately impacting both language and visual comprehension. Semantic dementia results in the disintegration of semantics, causing patients to lose the ability to relate concepts and recognize objects, affecting both language and visual comprehension.']}, {'end': 4065.783, 'start': 3634.587, 'title': "Rumelhart's cognitive decline", 'summary': 'Discusses the cognitive decline of cognitive scientist rumelhart, reflecting on the impact of degenerative conditions and the gradual disintegration of cognition, highlighting partial competencies and the celebration of human experience.', 'duration': 431.196, 'highlights': ["Rumelhart's cognitive decline and its impact on cognition The discussion focuses on the cognitive decline of cognitive scientist Rumelhart, reflecting on the impact of degenerative conditions and the gradual disintegration of cognition.", 'Partial competencies and the celebration of human experience The transcript highlights the existence of partial competencies despite the absence of other aspects, emphasizing the celebration of human experience and the multifaceted nature of cognition.', "Formation of the PDP Research Group with notable members The formation of the PDP Research Group, including notable members such as Jeff Hinton and Francis Crick, is discussed, showcasing the collaboration and potential of the group's work."]}], 'duration': 732.856, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY3332927.jpg', 'highlights': ['Semantic dementia causes progressive loss of ability to appreciate meaning of experiences and concepts.', 'Patients with semantic dementia struggle to differentiate between similar categories and recognize common objects.', 'Semantic dementia results in disintegration of semantics, impacting language and visual comprehension.', 'Discussion focuses on cognitive decline of cognitive scientist Rumelhart and its impact on cognition.', 'Transcript highlights existence of partial competencies, emphasizing celebration of human experience and multifaceted nature of cognition.', 'Formation of PDP Research Group, including notable members Jeff Hinton and Francis Crick, is discussed.']}, {'end': 4595.459, 'segs': [{'end': 4343.051, 'src': 'embed', 'start': 4315.166, 'weight': 0, 'content': [{'end': 4324.332, 'text': 'what it meant was that, in order to figure out what the changes you needed to make to the connections from the input to the hidden layer,', 'start': 4315.166, 'duration': 9.166}, {'end': 4326.394, 'text': 'you had to back,', 'start': 4324.332, 'duration': 2.062}, {'end': 4340.37, 'text': 'propagate the error signals from the output layer through the connections from the hidden layer to the output to get the signals that would be the error signals for the hidden layer.', 'start': 4326.394, 'duration': 13.976}, {'end': 4343.051, 'text': "And that's how Rumelhart formulated it.", 'start': 4341.231, 'duration': 1.82}], 'summary': 'Rumelhart formulated the process for backpropagating error signals in neural networks.', 'duration': 27.885, 'max_score': 4315.166, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4315166.jpg'}, {'end': 4476.103, 'src': 'embed', 'start': 4439.977, 'weight': 1, 'content': [{'end': 4448.622, 'text': 'Have you debated over? What stands out to you in the full space of ideas here at the intersection of computation and cognition?', 'start': 4439.977, 'duration': 8.645}, {'end': 4456.646, 'text': 'Well so, Jeff has said many things to me that had a profound impact on my thinking.', 'start': 4450.223, 'duration': 6.423}, {'end': 4464.931, 'text': "And he's written several articles which were way ahead of their time.", 'start': 4458.988, 'duration': 5.943}, {'end': 4476.103, 'text': 'He had two papers in 1981, just to give one example.', 'start': 4467.817, 'duration': 8.286}], 'summary': "Jeff's impactful ideas and ahead-of-time articles, including two papers in 1981.", 'duration': 36.126, 'max_score': 4439.977, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4439977.jpg'}, {'end': 4573.636, 'src': 'embed', 'start': 4541.144, 'weight': 2, 'content': [{'end': 4556.669, 'text': "And it was a very clever idea that he's continued to explore over time, which was sort of the idea that when you call a subroutine,", 'start': 4541.144, 'duration': 15.525}, {'end': 4564.793, 'text': "you need to save the state that you had when you called it, so you can get back to where you were when you're finished with the subroutine.", 'start': 4556.669, 'duration': 8.124}, {'end': 4573.636, 'text': 'And the idea was that you would save the state of the calling routine by making fast changes to connection weights.', 'start': 4565.313, 'duration': 8.323}], 'summary': 'Exploring the concept of saving state when calling subroutines for efficient navigation.', 'duration': 32.492, 'max_score': 4541.144, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4541144.jpg'}], 'start': 4065.943, 'title': 'Neural network learning', 'summary': "Discusses the shift in thinking from seeking inspiration from biology to focusing on adjusting connection weights to solve problems, leading to the development of backpropagation algorithm by rumelhart and the significant impact of jeff hinton's ideas on semantic cognition and recursive computation.", 'chapters': [{'end': 4595.459, 'start': 4065.943, 'title': 'Neural network learning', 'summary': "Discusses the shift in thinking from seeking inspiration from biology to focusing on adjusting connection weights to solve problems, leading to the development of backpropagation algorithm by rumelhart and the significant impact of jeff hinton's ideas on semantic cognition and recursive computation.", 'duration': 529.516, 'highlights': ['The shift in thinking from seeking inspiration from biology to focusing on adjusting connection weights to solve problems led to the development of the backpropagation algorithm by Rumelhart. This shift in approach emphasized defining a problem and figuring out how the adjustment of connection weights would solve it, ultimately leading to the development of the backpropagation algorithm by Rumelhart.', "The significant impact of Jeff Hinton's ideas on semantic cognition and recursive computation, including early papers on semantic cognition and the concept of neural networks performing recursive computation. Jeff Hinton's ideas had a profound impact on semantic cognition and recursive computation, with early papers on semantic cognition and the concept of neural networks performing recursive computation, influencing thinking and research in the field.", "Jeff Hinton's early paper on semantic cognition and the concept of neural networks performing recursive computation, including the idea of saving the state of the calling routine by making fast changes to connection weights. Jeff Hinton's early paper described the idea of neural networks performing recursive computation and the concept of saving the state of the calling routine by making fast changes to connection weights, which has continued to be explored over time."]}], 'duration': 529.516, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4065943.jpg', 'highlights': ['The shift in thinking from seeking inspiration from biology to focusing on adjusting connection weights to solve problems led to the development of the backpropagation algorithm by Rumelhart.', "The significant impact of Jeff Hinton's ideas on semantic cognition and recursive computation, including early papers on semantic cognition and the concept of neural networks performing recursive computation.", "Jeff Hinton's early paper on semantic cognition and the concept of neural networks performing recursive computation, including the idea of saving the state of the calling routine by making fast changes to connection weights."]}, {'end': 5240.282, 'segs': [{'end': 4633.726, 'src': 'embed', 'start': 4595.78, 'weight': 0, 'content': [{'end': 4605.466, 'text': "And I always thought okay, that's really you know, he, just he had extremely creative ideas that were quite a lot ahead of his time,", 'start': 4595.78, 'duration': 9.686}, {'end': 4607.547, 'text': 'and many of them in the 1970s and early 1980s.', 'start': 4605.466, 'duration': 2.081}, {'end': 4628.093, 'text': "So another thing about Geoff Hinton's way of thinking, which has profoundly influenced my effort to understand human mathematical cognition,", 'start': 4612.964, 'duration': 15.129}, {'end': 4633.726, 'text': "is that he doesn't write too many equations.", 'start': 4628.093, 'duration': 5.633}], 'summary': 'Geoff hinton had creative ideas ahead of his time in the 1970s and 1980s, influencing human mathematical cognition.', 'duration': 37.946, 'max_score': 4595.78, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4595780.jpg'}, {'end': 4746.848, 'src': 'embed', 'start': 4724.669, 'weight': 2, 'content': [{'end': 4732.593, 'text': "And when you're around those people, for me in the engineering realm, there's a guy named Jim Keller, who is a chip designer, engineer.", 'start': 4724.669, 'duration': 7.924}, {'end': 4738.182, 'text': "Every time I talk to him, it doesn't matter what we're talking about.", 'start': 4734.173, 'duration': 4.009}, {'end': 4744.727, 'text': 'Just having experienced that unique way of thinking transforms you and makes your work much better.', 'start': 4738.282, 'duration': 6.445}, {'end': 4746.848, 'text': "And that's the magic.", 'start': 4745.387, 'duration': 1.461}], 'summary': 'Interacting with chip designer jim keller transforms engineering work for the better.', 'duration': 22.179, 'max_score': 4724.669, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4724669.jpg'}, {'end': 4893.427, 'src': 'embed', 'start': 4848.837, 'weight': 3, 'content': [{'end': 4871.266, 'text': 'And the work that Jeff was doing in the early to mid 80s on something called the Bolton machine was his way of connecting with that Boolean tradition and bringing it into the more continuous probabilistic graded constraint satisfaction realm.', 'start': 4848.837, 'duration': 22.429}, {'end': 4876.65, 'text': 'And it was beautiful.', 'start': 4872.867, 'duration': 3.783}, {'end': 4887.384, 'text': 'set of ideas linked with theoretical physics as well as with logic.', 'start': 4878.439, 'duration': 8.945}, {'end': 4893.427, 'text': "I've always been inspired by the Boltzmann machine too.", 'start': 4891.226, 'duration': 2.201}], 'summary': "Jeff's work in the 80s connected boolean tradition with probabilistic constraint satisfaction, linking theoretical physics and logic.", 'duration': 44.59, 'max_score': 4848.837, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4848837.jpg'}, {'end': 5026.539, 'src': 'embed', 'start': 4992.327, 'weight': 4, 'content': [{'end': 5026.539, 'text': "I feel like that's where a huge amount of the excitement of deep learning actually lies is in the idea that We may be able to even go beyond what we can achieve with our own nervous systems when we build computational intelligences that are not limited in the ways that we are by our own biology.", 'start': 4992.327, 'duration': 34.212}], 'summary': 'Deep learning may exceed human limits in computational intelligence.', 'duration': 34.212, 'max_score': 4992.327, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4992327.jpg'}], 'start': 4595.78, 'title': 'Influential thinkers and computational intelligence', 'summary': "Explores the impact of geoff hinton's intuitive approach on deep learning and the transformative power of unique thinking in engineering and computational intelligence, citing examples like jim keller and jeff hinton. it emphasizes the interconnection of boolean tradition with continuous probabilistic graded constraint satisfaction and the potential of computational intelligence to surpass human limitations.", 'chapters': [{'end': 4693.142, 'start': 4595.78, 'title': "Geoff hinton's intuitive approach", 'summary': "Discusses geoff hinton's influence on deep learning, highlighting his intuitive and visual approach, which has significantly impacted the understanding of human mathematical cognition and the explanation of deep learning concepts.", 'duration': 97.362, 'highlights': ["Geoff Hinton's intuitive and visual approach to explaining deep learning concepts has profoundly influenced the understanding of human mathematical cognition.", "In Hinton's lab meetings, equations are replaced by visual explanations and metaphors, such as using hand gestures to demonstrate the shape of a ravine to explain the gradient descent process.", "Hinton's use of geometrical metaphors, like the shape of a ravine, to explain the gradient descent process provides an intuitive understanding of the fundamental concepts, such as the need to adjust learning rates to prevent overshooting."]}, {'end': 5240.282, 'start': 4693.142, 'title': 'Magic of unique thinking', 'summary': 'Discusses the transformative power of unique thinking in engineering and computational intelligence, citing examples like jim keller and jeff hinton, and emphasizes the beauty of interconnecting boolean tradition with continuous probabilistic graded constraint satisfaction, and the potential of computational intelligence to surpass human limitations.', 'duration': 547.14, 'highlights': ['The transformative power of unique thinking in engineering and computational intelligence is exemplified through individuals like Jim Keller and Jeff Hinton, with the ability to significantly enhance the quality of work and inspire brilliance. Significant impact of unique thinking on work quality and inspiration', "The interconnectedness of Boolean tradition with continuous probabilistic graded constraint satisfaction, as demonstrated by Jeff Hinton's work on the Bolton machine in the early to mid-80s, is described as beautiful and inspiring, linking theoretical physics with logic. Interconnectedness of Boolean tradition with continuous probabilistic graded constraint satisfaction, beauty and inspiration of the work", 'The potential of computational intelligence to surpass human limitations and scale the mechanisms of human intelligence is highlighted, with a focus on the excitement of deep learning and the massive scale of computations at institutions like Google Brain, OpenAI, and DeepMind. Potential of computational intelligence to surpass human limitations, focus on deep learning and massive scale of computations']}], 'duration': 644.502, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY4595780.jpg', 'highlights': ["Geoff Hinton's intuitive and visual approach profoundly influences understanding of human mathematical cognition.", "Hinton's use of geometrical metaphors provides an intuitive understanding of fundamental concepts.", 'Unique thinking in engineering and computational intelligence exemplified by Jim Keller and Jeff Hinton significantly enhances work quality and inspires brilliance.', "Interconnectedness of Boolean tradition with continuous probabilistic graded constraint satisfaction, as demonstrated by Jeff Hinton's work, is described as beautiful and inspiring.", 'The potential of computational intelligence to surpass human limitations and scale the mechanisms of human intelligence is highlighted.']}, {'end': 5895.184, 'segs': [{'end': 5315.819, 'src': 'embed', 'start': 5242.093, 'weight': 0, 'content': [{'end': 5255.601, 'text': "We built bridges out of triangles and we understand how to measure the height of something we can't climb by extending these ideas about triangles a little further.", 'start': 5242.093, 'duration': 13.508}, {'end': 5275.644, 'text': 'All of the ability to get a tiny speck of matter launched from the planet Earth to intersect with some tiny,', 'start': 5261.844, 'duration': 13.8}, {'end': 5288.068, 'text': 'tiny little body way out in way beyond Pluto, somewhere at exactly a predicted time and date, is something that depends on these ideas.', 'start': 5275.644, 'duration': 12.424}, {'end': 5306.615, 'text': "It's actually happening in the real physical world that these ideas make contact with it in those kinds of instances.", 'start': 5289.809, 'duration': 16.806}, {'end': 5315.819, 'text': 'But there are these idealized objects, these triangles or these distances or these points, whatever they are,', 'start': 5307.916, 'duration': 7.903}], 'summary': 'Understanding triangles enables precise space launches and real-world applications.', 'duration': 73.726, 'max_score': 5242.093, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY5242093.jpg'}, {'end': 5388.204, 'src': 'embed', 'start': 5359.21, 'weight': 3, 'content': [{'end': 5362.831, 'text': 'Natural numbers, zero, one, two, three, four, five, six, seven, and so on.', 'start': 5359.21, 'duration': 3.621}, {'end': 5372.734, 'text': 'Yeah Because they give you the ability to be exact about..', 'start': 5363.151, 'duration': 9.583}, {'end': 5379.998, 'text': 'Like how many sheep you have? Like, you know, I sent you out this morning.', 'start': 5376.536, 'duration': 3.462}, {'end': 5381.639, 'text': 'There were 23 sheep.', 'start': 5380.038, 'duration': 1.601}, {'end': 5383.201, 'text': 'You came back with only 22.', 'start': 5381.7, 'duration': 1.501}, {'end': 5386.683, 'text': 'What happened? Right? The fundamental problem of physics.', 'start': 5383.201, 'duration': 3.482}, {'end': 5388.204, 'text': 'How many sheep you have? Yeah.', 'start': 5386.703, 'duration': 1.501}], 'summary': 'Using natural numbers for exactness in counting, as in the case of 23 sheep down to 22 sheep, presents a fundamental problem in physics.', 'duration': 28.994, 'max_score': 5359.21, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY5359210.jpg'}, {'end': 5473.736, 'src': 'embed', 'start': 5435.448, 'weight': 4, 'content': [{'end': 5458.855, 'text': 'makes for the incredible achievements of the human mind is the fact that humans invented these idealized systems that leverage the power of human thought in such a way as to allow all this kind of thing to happen.', 'start': 5435.448, 'duration': 23.407}, {'end': 5473.736, 'text': 'Mathematics. to me is the development of systems for thinking about the properties and relations among sets of idealized objects,', 'start': 5460.597, 'duration': 13.139}], 'summary': 'Humans invented idealized systems leveraging human thought for incredible achievements in mathematics.', 'duration': 38.288, 'max_score': 5435.448, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY5435448.jpg'}, {'end': 5552.502, 'src': 'embed', 'start': 5508.641, 'weight': 5, 'content': [{'end': 5518.183, 'text': "Yeah. So what's a good way to model such powerful mathematical reasoning, would you say?", 'start': 5508.641, 'duration': 9.542}, {'end': 5521.684, 'text': 'What are some ideas you have for capturing this in a model?', 'start': 5518.223, 'duration': 3.461}, {'end': 5534.151, 'text': 'The insights that human mathematicians have had is a combination of the kind of the intuitive,', 'start': 5522.505, 'duration': 11.646}, {'end': 5552.502, 'text': "kind of connectionist-like knowledge that makes it so that something is just like obviously true, so that you don't have to think about why it's true.", 'start': 5534.151, 'duration': 18.351}], 'summary': 'Model powerful mathematical reasoning with intuitive, connectionist-like knowledge.', 'duration': 43.861, 'max_score': 5508.641, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY5508641.jpg'}, {'end': 5785.836, 'src': 'embed', 'start': 5746.726, 'weight': 6, 'content': [{'end': 5760.216, 'text': 'neural networks that have been trained with massive amounts of text can be given a prompt, and they can then sort of generate some really interesting,', 'start': 5746.726, 'duration': 13.49}, {'end': 5762.918, 'text': 'fanciful, creative story from that prompt.', 'start': 5760.216, 'duration': 2.702}, {'end': 5780.014, 'text': "And There's kind of like a sense that they've somehow synthesized something like novel out of all of the particulars,", 'start': 5765.7, 'duration': 14.314}, {'end': 5785.836, 'text': 'of all of the billions and billions of experiences that went into the training data.', 'start': 5780.014, 'duration': 5.822}], 'summary': 'Trained neural networks can generate creative stories from prompts using massive text data.', 'duration': 39.11, 'max_score': 5746.726, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY5746726.jpg'}], 'start': 5242.093, 'title': 'Triangular concepts and mathematical systems', 'summary': 'Delves into the practical applications of understanding triangles and measurements, emphasizing their role in launching objects into space. it also discusses the leverage of mathematical systems, such as natural numbers, in enabling exact counting and capturing intuitive reasoning in deep learning systems, with insights from mathematicians like hinton, newton, and poincaré.', 'chapters': [{'end': 5315.819, 'start': 5242.093, 'title': 'Triangular concepts and real-world application', 'summary': 'Explores the practical applications of understanding triangles and measurements, highlighting their crucial role in launching objects into space and making real-world predictions.', 'duration': 73.726, 'highlights': ['Understanding triangles and measurements plays a crucial role in launching objects into space and making real-world predictions, such as intersecting with tiny bodies beyond Pluto at an exact predicted time and date.', 'Extending the concepts about triangles has practical applications, including measuring the height of objects that cannot be climbed.', 'The real physical world is impacted by these idealized objects such as triangles, distances, and points, particularly in instances involving launching objects into space and making accurate predictions.']}, {'end': 5895.184, 'start': 5315.819, 'title': 'Power of mathematical systems', 'summary': 'Discusses the leverage of mathematical systems like natural numbers in allowing exactness in counting and the potential of capturing intuitive reasoning in deep learning systems, exemplified by the insights of mathematicians like hinton, newton, and poincaré.', 'duration': 579.365, 'highlights': ['The fundamental role of natural numbers in allowing exactness in counting and facilitating commerce and contracts. The natural numbers, including zero, enable exactness in counting and are fundamental for commerce, contracts, and record-keeping.', 'The development of mathematical systems for thinking about the properties and relations among sets of idealized objects. Mathematics involves developing systems for reasoning about idealized objects and their properties and relations.', 'The combination of intuitive, connectionist-like knowledge in mathematical insights, aiding in intuitive discovery and reasoning. Insights in mathematics involve a combination of intuitive, connectionist-like knowledge that aids in intuitive discovery and reasoning.', 'The potential of deep learning systems, exemplified by neural networks, to capture intuitive reasoning and generate novel ideas, as seen in the synthesis of creative stories and chess strategies. Deep learning systems, such as neural networks, demonstrate the potential to capture intuitive reasoning and generate novel ideas, as shown in the synthesis of creative stories and chess strategies.']}], 'duration': 653.091, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY5242093.jpg', 'highlights': ['Understanding triangles and measurements crucial for launching objects into space and making real-world predictions.', 'Extending concepts about triangles has practical applications, including measuring the height of unclimbable objects.', 'Real physical world is impacted by idealized objects like triangles, distances, and points, particularly in instances involving launching objects into space and making accurate predictions.', 'Natural numbers enable exactness in counting and are fundamental for commerce, contracts, and record-keeping.', 'Mathematics involves developing systems for reasoning about idealized objects and their properties and relations.', 'Insights in mathematics involve a combination of intuitive, connectionist-like knowledge that aids in intuitive discovery and reasoning.', 'Deep learning systems, such as neural networks, demonstrate the potential to capture intuitive reasoning and generate novel ideas, as shown in the synthesis of creative stories and chess strategies.']}, {'end': 7157.085, 'segs': [{'end': 6090.57, 'src': 'embed', 'start': 6054.542, 'weight': 0, 'content': [{'end': 6069.737, 'text': 'formal way is a result of the same kind of immersion in experience, thinking in that way that you know.', 'start': 6054.542, 'duration': 15.195}, {'end': 6073.239, 'text': 'we now begin to think of our understanding of language as being right.', 'start': 6069.737, 'duration': 3.502}, {'end': 6082.305, 'text': 'so we immerse ourselves in in a particular language, in a particular world of objects and their relationships,', 'start': 6073.239, 'duration': 9.066}, {'end': 6090.57, 'text': 'and we learn to talk about that and we develop intuitive understanding of the real world in in a similar way,', 'start': 6082.305, 'duration': 8.265}], 'summary': 'Immersion in language and experience leads to intuitive understanding of the real world.', 'duration': 36.028, 'max_score': 6054.542, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY6054542.jpg'}, {'end': 6270.514, 'src': 'embed', 'start': 6233.374, 'weight': 1, 'content': [{'end': 6251.126, 'text': 'a culture of thought and reason and brought to the effort to understand natural language this profound engagement with these formal systems.', 'start': 6233.374, 'duration': 17.752}, {'end': 6265.036, 'text': 'I think that there was tremendous power in that and that Chomsky had some amazing insights into the structure of natural language.', 'start': 6253.208, 'duration': 11.828}, {'end': 6270.514, 'text': "but that and I'm gonna use the word,", 'start': 6267.352, 'duration': 3.162}], 'summary': 'Chomsky had amazing insights into the structure of natural language and fostered a culture of thought and reason.', 'duration': 37.14, 'max_score': 6233.374, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY6233374.jpg'}, {'end': 6666.418, 'src': 'embed', 'start': 6635.548, 'weight': 2, 'content': [{'end': 6643.65, 'text': 'to use the kind of phrases that Spelke and Carey used to talk about what they believe are the innate primitives of the human mind.', 'start': 6635.548, 'duration': 8.102}, {'end': 6647.131, 'text': 'And they no longer believe that.', 'start': 6644.351, 'duration': 2.78}, {'end': 6648.592, 'text': "It's actually..", 'start': 6647.932, 'duration': 0.66}, {'end': 6657.436, 'text': 'been more or less accepted by almost everyone that the natural numbers are actually a cultural construction.', 'start': 6650.855, 'duration': 6.581}, {'end': 6666.418, 'text': "And it's so interesting to go back and sort of like study those few people who still exist who don't have those systems.", 'start': 6658.216, 'duration': 8.202}], 'summary': "Spelke and carey's innate primitives theory debunked; natural numbers are cultural construction. few people still lack these systems.", 'duration': 30.87, 'max_score': 6635.548, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY6635548.jpg'}], 'start': 5895.184, 'title': 'Cognitive constructs', 'summary': 'Delves into the emergence of abstract thinking and formal systems, the influence of chomsky on linguistics, and the cultural construction of cognitive constructs, highlighting the relationship between mathematical and linguistic cognition, insights into natural language, and the impact of language and environment on cognitive development.', 'chapters': [{'end': 6186.823, 'start': 5895.184, 'title': 'Emergence of abstract thinking', 'summary': 'Discusses the emergence of abstract thinking and formal systems, emphasizing the development of mathematical cognition over 3,000 years ago, and the relationship between mathematical and linguistic cognition.', 'duration': 291.639, 'highlights': ["The development of formal systems for thinking gradually constructed the idea of thinking formally, with the establishment of coherent documents like Euclid's elements, over 3,000 years ago.", 'The immersion in experience and thinking in an abstract, formal way is akin to the process of understanding language and developing an intuitive understanding of the real world, emphasizing the interconnectedness between cognitive processes and immersion in experiences.', 'The discussion delves into the comparison between mathematical cognition and language linguistic cognition, emphasizing the importance of drawing a line between the two and highlighting the current interest in exploring this distinction.']}, {'end': 6543.44, 'start': 6187.912, 'title': "Chomsky's influence on linguistics", 'summary': "Discusses chomsky's profound insights into natural language and the discovery that formal training in linguistics may lead to a different intuition about language than that of ordinary individuals, potentially leading to limitations in understanding cognition.", 'duration': 355.528, 'highlights': ["Chomsky's profound insights into natural language Chomsky's academic upbringing and profound engagement with formal systems led to tremendous insights into the structure of natural language.", "Discovery of differences in intuition about language Lila Gleitman's discovery that linguists' intuitions about language meaning differ significantly from those of ordinary individuals, suggesting potential limitations in understanding cognition due to formal training.", 'The impact of formal training on understanding cognition Formally trained linguists and academics may have a mode of engagement with experience that differs from the natural human mind, potentially limiting their ability to understand cognition and leading to an expert blind spot.']}, {'end': 7157.085, 'start': 6543.64, 'title': 'The nature of cognitive constructs', 'summary': 'Discusses the cultural construction of natural numbers, the influence of language and environment on cognitive development, and the limitations of introspection and self-awareness in decision-making and belief formation.', 'duration': 613.445, 'highlights': ['The natural numbers are now widely accepted as a cultural construction, contrary to the previous belief of it being part of innate knowledge. It has been accepted by almost everyone that the natural numbers are actually a cultural construction, debunking the previous notion of it being part of innate endowment of core knowledge.', "The influence of language and environment on cognitive development is emphasized, with the Chomsky household's dinner conversations being cited as a potential factor in shaping cognitive predispositions. The difference in dinner table conversations at the Chomsky house is proposed as a potential factor in shaping cognitive predispositions, highlighting the influence of language and environment on cognitive development.", "The discussion delves into the limitations of introspection and self-awareness, emphasizing the challenge of stepping outside one's own cognitive constructs to gain a broader understanding of the world. The difficulty of stepping outside one's own cognitive constructs to gain a broader understanding of the world is emphasized, highlighting the limitations of introspection and self-awareness.", 'The concept of post hoc rationalizations in decision-making and belief formation is introduced, highlighting the idea that our own insights into our beliefs and choices are not entirely within our control and are influenced by cultural transmission. The concept of post hoc rationalizations in decision-making and belief formation is introduced, emphasizing that our insights into beliefs and choices are not entirely within our control and are influenced by cultural transmission.']}], 'duration': 1261.901, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY5895184.jpg', 'highlights': ['The immersion in experience and thinking in an abstract, formal way is akin to the process of understanding language and developing an intuitive understanding of the real world, emphasizing the interconnectedness between cognitive processes and immersion in experiences.', "Chomsky's profound insights into natural language Chomsky's academic upbringing and profound engagement with formal systems led to tremendous insights into the structure of natural language.", 'The natural numbers are now widely accepted as a cultural construction, contrary to the previous belief of it being part of innate knowledge. It has been accepted by almost everyone that the natural numbers are actually a cultural construction, debunking the previous notion of it being part of innate endowment of core knowledge.']}, {'end': 9108.379, 'segs': [{'end': 7300.514, 'src': 'embed', 'start': 7268.8, 'weight': 1, 'content': [{'end': 7270.141, 'text': 'So I mean,', 'start': 7268.8, 'duration': 1.341}, {'end': 7280.129, 'text': 'would it be fair to say you kind of stumbled around a little bit uh through accidents of uh too early morning of classes in physics and so on,', 'start': 7270.141, 'duration': 9.988}, {'end': 7285.372, 'text': "until you discovered intrinsic motivation, as you mentioned, and then that's it, it hooked you.", 'start': 7280.129, 'duration': 5.243}, {'end': 7289.194, 'text': 'And then you celebrate the fact that this happens to human beings.', 'start': 7285.412, 'duration': 3.782}, {'end': 7290.094, 'text': "And that's like, yeah.", 'start': 7289.554, 'duration': 0.54}, {'end': 7300.514, 'text': "Like, uh, and what is it that made what I did intrinsically motivating to me? Well, that's interesting and I don't know all the answers to it.", 'start': 7290.214, 'duration': 10.3}], 'summary': 'Discovered intrinsic motivation in physics, leading to strong interest.', 'duration': 31.714, 'max_score': 7268.8, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY7268800.jpg'}, {'end': 7499.509, 'src': 'embed', 'start': 7469.22, 'weight': 3, 'content': [{'end': 7471.803, 'text': 'stay with it a while and see where that takes you.', 'start': 7469.22, 'duration': 2.583}, {'end': 7479.232, 'text': 'uh, in life, yeah, and i think, i think the um, the motivational engagement,', 'start': 7471.803, 'duration': 7.429}, {'end': 7485.597, 'text': 'results in the immersion that then creates the opportunity to obtain the expertise.', 'start': 7479.232, 'duration': 6.365}, {'end': 7490.081, 'text': 'We could call it the Mozart effect.', 'start': 7485.918, 'duration': 4.163}, {'end': 7499.509, 'text': 'When I think about Mozart, I think about the person who was born as the fourth member of the family string quartet.', 'start': 7490.121, 'duration': 9.388}], 'summary': "Motivational engagement leads to expertise, like the 'mozart effect'.", 'duration': 30.289, 'max_score': 7469.22, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY7469220.jpg'}, {'end': 7574.441, 'src': 'embed', 'start': 7539.035, 'weight': 0, 'content': [{'end': 7541.357, 'text': "That's what I really considered to be the Mozart effect.", 'start': 7539.035, 'duration': 2.322}, {'end': 7550.685, 'text': "It's the synergy of something with experience that then results in the unique flowering of a particular mind.", 'start': 7541.417, 'duration': 9.268}, {'end': 7560.212, 'text': 'um. so i know my siblings and i are all very different from each other.', 'start': 7553.187, 'duration': 7.025}, {'end': 7564.915, 'text': "we've all gone in our own different directions and you know i mentioned my younger brother,", 'start': 7560.212, 'duration': 4.703}, {'end': 7574.441, 'text': 'who was very musical i had my other younger brother was like this amazing, like intuitive engineer, um, and um.', 'start': 7564.915, 'duration': 9.526}], 'summary': 'The mozart effect is the unique flowering of minds through synergy of experience. siblings have gone in different directions.', 'duration': 35.406, 'max_score': 7539.035, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY7539035.jpg'}, {'end': 7922.494, 'src': 'embed', 'start': 7894.464, 'weight': 5, 'content': [{'end': 7897.565, 'text': 'psychiatrists are the deep thinkers about the nature of the human mind.', 'start': 7894.464, 'duration': 3.101}, {'end': 7902.288, 'text': 'And I think that flag has been taken from them and carried by people like you.', 'start': 7897.965, 'duration': 4.323}, {'end': 7910.07, 'text': "It's like it's more in the cognitive psychology, especially when you have a foot in the computational view of the world,", 'start': 7903.068, 'duration': 7.002}, {'end': 7911.311, 'text': 'because you can both build it.', 'start': 7910.07, 'duration': 1.241}, {'end': 7919.373, 'text': 'you can like intuit about the functioning of the mind by building little models and be able to say mathematical things and then deploying those models,', 'start': 7911.311, 'duration': 8.062}, {'end': 7922.494, 'text': 'especially in computers, to say does this actually work??', 'start': 7919.373, 'duration': 3.121}], 'summary': "Psychiatrists' deep thinking on human mind carried on by cognitive psychologists like you, involving computational view and model building.", 'duration': 28.03, 'max_score': 7894.464, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY7894464.jpg'}, {'end': 8130.282, 'src': 'embed', 'start': 8104.069, 'weight': 6, 'content': [{'end': 8115.071, 'text': 'You can get derailed in neuroscience down to the bottom of the system, where you might find the cures of various conditions,', 'start': 8104.069, 'duration': 11.002}, {'end': 8118.113, 'text': "but you don't get a chance to think about the higher level stuff.", 'start': 8115.071, 'duration': 3.042}, {'end': 8125.659, 'text': "So it's in the systems and cognitive neuroscience and computational intelligence, miasma up there at the top,", 'start': 8118.153, 'duration': 7.506}, {'end': 8130.282, 'text': 'that I think these opportunities are most are richest right now.', 'start': 8125.659, 'duration': 4.623}], 'summary': 'Neuroscience research offers rich opportunities in systems and cognitive neuroscience and computational intelligence.', 'duration': 26.213, 'max_score': 8104.069, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY8104069.jpg'}, {'end': 8210.712, 'src': 'embed', 'start': 8165.617, 'weight': 7, 'content': [{'end': 8172.639, 'text': 'I would say that I am not as much afraid of death as I am of degeneration.', 'start': 8165.617, 'duration': 7.022}, {'end': 8187.147, 'text': 'I say that in part for reasons of having seen some tragic degenerative situations unfold.', 'start': 8175.521, 'duration': 11.626}, {'end': 8206.011, 'text': "It's exciting when you can continue to participate and feel like you're near the place where the wave is breaking on the shore, if you like.", 'start': 8188.163, 'duration': 17.848}, {'end': 8210.712, 'text': 'And I think about my own future potential.', 'start': 8206.031, 'duration': 4.681}], 'summary': 'Fear of degeneration overshadows fear of death. reflects on tragic situations. hopes to participate in breaking new ground.', 'duration': 45.095, 'max_score': 8165.617, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY8165617.jpg'}, {'end': 8353.085, 'src': 'embed', 'start': 8315.878, 'weight': 9, 'content': [{'end': 8324.882, 'text': 'I wonder what role mortality and our ability to be cognizant of it and anticipate it and perhaps be afraid of it.', 'start': 8315.878, 'duration': 9.004}, {'end': 8329.62, 'text': 'what role that plays in our reasoning of the world?', 'start': 8324.882, 'duration': 4.738}, {'end': 8335.147, 'text': 'I think that it can be motivating to people to think they have a limited period left.', 'start': 8329.641, 'duration': 5.506}, {'end': 8353.085, 'text': "I think in my own case it's like seven or eight years ago now that I was sitting around doing experiments on decision-making that were satisfying in a certain way,", 'start': 8336.529, 'duration': 16.556}], 'summary': 'Cognizance of mortality motivates decision-making, leading to satisfying experiments.', 'duration': 37.207, 'max_score': 8315.878, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY8315878.jpg'}, {'end': 8399.31, 'src': 'embed', 'start': 8370.894, 'weight': 8, 'content': [{'end': 8374.014, 'text': 'But I just realized hey, wait a minute.', 'start': 8370.894, 'duration': 3.12}, {'end': 8386.638, 'text': "I may only have about 10 or 15 years left here and I don't feel like I'm getting towards the answers to the really interesting questions while I'm doing this particular level of work.", 'start': 8374.014, 'duration': 12.624}, {'end': 8395.529, 'text': "And that's when I said to myself, Okay, let's pick something that's hard.", 'start': 8386.718, 'duration': 8.811}, {'end': 8399.31, 'text': "That's when I started working on mathematical cognition.", 'start': 8396.009, 'duration': 3.301}], 'summary': 'Realized limited time left, shifted focus to mathematical cognition.', 'duration': 28.416, 'max_score': 8370.894, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY8370894.jpg'}, {'end': 8537.078, 'src': 'embed', 'start': 8498.963, 'weight': 12, 'content': [{'end': 8501.806, 'text': 'and then I forget the exact wording,', 'start': 8498.963, 'duration': 2.843}, {'end': 8531.956, 'text': 'but I said in this preface that the joy of science is the moment in which you know a partially formed thought in the mind of one person gets crystallized a little better in the discourse and becomes the foundation of some exciting,', 'start': 8501.806, 'duration': 30.15}, {'end': 8535.317, 'text': 'concrete piece of actual scientific progress.', 'start': 8531.956, 'duration': 3.361}, {'end': 8537.078, 'text': 'And I feel like that.', 'start': 8535.897, 'duration': 1.181}], 'summary': 'The joy of science is crystallizing thoughts into scientific progress.', 'duration': 38.115, 'max_score': 8498.963, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY8498963.jpg'}, {'end': 8590.949, 'src': 'embed', 'start': 8565.541, 'weight': 11, 'content': [{'end': 8580.084, 'text': 'the idea that this is a person who contributed to science by finding exciting collaborative opportunities to engage with other people through is something that I certainly hope is part of the paragraph.', 'start': 8565.541, 'duration': 14.543}, {'end': 8587.547, 'text': 'And like you said, taking a step, maybe in directions that are non, not obvious.', 'start': 8580.544, 'duration': 7.003}, {'end': 8590.949, 'text': "So it's the the old Robert Frost road less taken.", 'start': 8587.767, 'duration': 3.182}], 'summary': 'Contributed to science through collaborative opportunities, embracing non-obvious directions.', 'duration': 25.408, 'max_score': 8565.541, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY8565541.jpg'}, {'end': 8743.697, 'src': 'embed', 'start': 8714.953, 'weight': 13, 'content': [{'end': 8721.276, 'text': 'which was the theoretical journal where I took that section and elaborated it and wrote it up and submitted it to them.', 'start': 8714.953, 'duration': 6.323}, {'end': 8726.2, 'text': "And they didn't accept that either, But they said, oh, this is interesting.", 'start': 8721.777, 'duration': 4.423}, {'end': 8728.243, 'text': 'You should keep thinking about it this time.', 'start': 8726.22, 'duration': 2.023}, {'end': 8732.788, 'text': 'And then that was what got me going to think, okay.', 'start': 8728.303, 'duration': 4.485}, {'end': 8738.195, 'text': "So it's not a superhuman thing to contribute to the development of theory.", 'start': 8733.549, 'duration': 4.646}, {'end': 8743.697, 'text': "You don't have to be You can do it as a mere mortal.", 'start': 8738.495, 'duration': 5.202}], 'summary': 'Theoretical journal rejected submission, but encouraged further development. realized anyone can contribute to theory.', 'duration': 28.744, 'max_score': 8714.953, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY8714953.jpg'}, {'end': 8876.119, 'src': 'embed', 'start': 8838.58, 'weight': 14, 'content': [{'end': 8860.558, 'text': 'The great religious thinkers of the first millennium BC and a few that came in the early part of the second millennium laid down some important foundations for us.', 'start': 8838.58, 'duration': 21.978}, {'end': 8876.119, 'text': 'But I do believe that you know we are an emergent result of a process that happened naturally without guidance,', 'start': 8863.812, 'duration': 12.307}], 'summary': 'Religious thinkers in first millennium bc laid foundations for emergent natural process.', 'duration': 37.539, 'max_score': 8838.58, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY8838580.jpg'}, {'end': 9104.676, 'src': 'heatmap', 'start': 9004.975, 'weight': 15, 'content': [{'end': 9015.704, 'text': "It's an emergent process that lives for a time, is defined by its local pocket and context in time and space, and then tells pretty stories.", 'start': 9004.975, 'duration': 10.729}, {'end': 9019.187, 'text': 'And we write those stories down and then we celebrate how nice the stories are.', 'start': 9015.784, 'duration': 3.403}, {'end': 9022.65, 'text': 'And then it continues, because we build stories on top of each other.', 'start': 9019.207, 'duration': 3.443}, {'end': 9033.34, 'text': "and eventually we'll colonize, hopefully, other planets, other solar systems, other galaxies, and we'll tell even better stories.", 'start': 9023.431, 'duration': 9.909}, {'end': 9036.564, 'text': 'But it all starts here on Earth.', 'start': 9034.041, 'duration': 2.523}, {'end': 9045.032, 'text': "Jay, you're speaking of peculiar emergent processes, that lived one heck of a story.", 'start': 9037.345, 'duration': 7.687}, {'end': 9056.522, 'text': "You're one of the great scientists of cognitive science, of psychology, of computation.", 'start': 9046.233, 'duration': 10.289}, {'end': 9061.846, 'text': "It's a huge honor you would talk to me today, that you spend your very valuable time.", 'start': 9057.102, 'duration': 4.744}, {'end': 9065.089, 'text': "I really enjoyed talking with you and thank you for all the work you've done.", 'start': 9062.407, 'duration': 2.682}, {'end': 9066.47, 'text': "I can't wait to see what you do next.", 'start': 9065.189, 'duration': 1.281}, {'end': 9068.262, 'text': 'Well, thank you so much.', 'start': 9067.202, 'duration': 1.06}, {'end': 9076.246, 'text': "And this has been an amazing opportunity for me to let ideas that I've never fully expressed before come out,", 'start': 9068.323, 'duration': 7.923}, {'end': 9083.449, 'text': "because you asked such a wide range of the deeper questions that we've all been thinking about for so long.", 'start': 9076.246, 'duration': 7.203}, {'end': 9084.77, 'text': 'So thank you very much for that.', 'start': 9083.589, 'duration': 1.181}, {'end': 9085.23, 'text': 'Thank you.', 'start': 9084.97, 'duration': 0.26}, {'end': 9089.083, 'text': 'Thanks for listening to this conversation with Jay McClelland.', 'start': 9086.581, 'duration': 2.502}, {'end': 9093.006, 'text': 'To support this podcast, please check out our sponsors in the description.', 'start': 9089.583, 'duration': 3.423}, {'end': 9096.289, 'text': 'And now let me leave you with some words from Jeffrey Hinton.', 'start': 9093.667, 'duration': 2.622}, {'end': 9100.332, 'text': 'In the long run, curiosity-driven research works best.', 'start': 9097.01, 'duration': 3.322}, {'end': 9104.676, 'text': "Real breakthroughs come from people focusing on what they're excited about.", 'start': 9100.933, 'duration': 3.743}], 'summary': 'Emergent processes lead to storytelling; colonizing other planets is envisioned. jay mcclelland discusses cognitive science and psychology, expressing gratitude and emphasizing the importance of curiosity-driven research.', 'duration': 51.547, 'max_score': 9004.975, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY9004975.jpg'}], 'start': 7158.005, 'title': 'Human development, cognition, mortality, and legacy', 'summary': "Discusses intrinsic motivation, genetics, and expertise acquisition, the shift in psychiatry, mortality's impact on decision-making, and the pursuit of legacy in the face of rejection, proposing creating meaning in human existence through natural processes and eventual colonization of other planets and galaxies.", 'chapters': [{'end': 7603.071, 'start': 7158.005, 'title': 'Intrinsic motivation and human development', 'summary': 'Discusses the journey of discovering intrinsic motivation, the importance of nurturing it, and the synergy of genetics and experience in creating unique talents, emphasizing the impact on human development and expertise acquisition.', 'duration': 445.066, 'highlights': ["The synergy of genetics and experience in creating unique talents, such as the 'Mozart effect,' is emphasized as a crucial factor in human development and expertise acquisition.", 'The significance of discovering intrinsic motivation and nurturing it is underscored, highlighting its impact on human development and the pursuit of expertise.', 'The chapter discusses the journey of discovering intrinsic motivation and its impact on human development, emphasizing the importance of nurturing it to foster unique talents and expertise acquisition.', "The author's personal experiences and observations regarding intrinsic motivation, human development, and expertise acquisition are shared, providing insights into the role of genetics and experience in shaping talents and passions.", 'The author reflects on the importance of recognizing and nurturing intrinsic motivation, highlighting its profound impact on human development and the pursuit of expertise.']}, {'end': 8130.282, 'start': 7603.071, 'title': 'Exploring human cognition and psychiatry', 'summary': 'Discusses the excitement about exploring human cognition and the disillusionment with the biological approach in psychiatry, highlighting the shift in the deep thinkers about the human mind from psychiatrists to cognitive psychologists and the opportunities in systems and cognitive neuroscience.', 'duration': 527.211, 'highlights': ['The chapter discusses the excitement about exploring human cognition and the disillusionment with the biological approach in psychiatry, highlighting the shift in the deep thinkers about the human mind from psychiatrists to cognitive psychologists. Excitement about exploring human cognition, disillusionment with biological approach in psychiatry, shift in deep thinkers from psychiatrists to cognitive psychologists', 'The opportunities in systems and cognitive neuroscience are highlighted, emphasizing the richness of opportunities in this field. Opportunities in systems and cognitive neuroscience, richness of opportunities']}, {'end': 8425.069, 'start': 8130.302, 'title': 'Contemplating mortality and motivation', 'summary': 'Delves into the fear of degeneration and the impact of mortality on decision-making, with the speaker reflecting on their remaining years and shifting focus in their work due to the realization of limited time.', 'duration': 294.767, 'highlights': ["The speaker fears degenerative conditions more than death, having witnessed tragic situations, and is concerned about losing cognitive abilities. The speaker expresses a fear of degenerative conditions like dementia and Alzheimer's disease, emphasizing the impact on cognitive abilities and the ability to engage, hinting at a personal experience with tragic degenerative situations.", 'Realization of limited time has motivated the speaker to shift focus in their work, transitioning to studying mathematical cognition and feeling the pressure of a looming deadline. The speaker reflects on the realization that they may have only 10-15 years left, prompting them to shift focus to more challenging work, leading to the study of mathematical cognition and a sense of a looming deadline.', "The speaker's contemplation of mortality has influenced their decision-making and work, leading them to pick something more challenging and significant. The speaker's contemplation of mortality has driven them to pick more challenging work, indicating the influence of mortality on their decision-making and the pursuit of more significant endeavors.", "The chapter also explores the speaker's view on the transition from life to death and the impact of anticipating mortality on reasoning and motivation. The speaker discusses the transition from life to death and its discreteness, along with the impact of anticipating mortality on reasoning and motivation, highlighting its potential to motivate individuals with a limited period left."]}, {'end': 8790.159, 'start': 8425.609, 'title': "Scientist's legacy and perseverance", 'summary': "Discusses the scientist's hope for his legacy, his joy of scientific progress, and perseverance in pursuing theoretical contributions despite initial rejection, emphasizing the importance of not succumbing to labels and venturing into new areas.", 'duration': 364.55, 'highlights': ['The scientist expresses his hope for his legacy to highlight his ability to see and pursue exciting paths in science, fostering collaborative opportunities and contributing to scientific progress.', 'The scientist recounts finding joy in scientific progress, particularly during the interactive activation model and the development of theory, emphasizing the importance of seeking such moments in collaborations with students.', "The scientist persevered in pursuing theoretical contributions despite initial rejection and labels, ultimately realizing that one need not be a superhuman to contribute to the development of theory and emphasizing the lesson of not succumbing to labels or reviewers' opinions."]}, {'end': 9108.379, 'start': 8790.159, 'title': 'The meaning of human existence', 'summary': 'Explores the concept of meaning in human existence, proposing that humans create their own meaning and that the process is an emergent result of natural occurrences without guidance, with the aim of making meaning for themselves, celebrating stories, and eventually colonizing other planets and galaxies.', 'duration': 318.22, 'highlights': ['Humans create their own meaning as an emergent result of natural occurrences without guidance. The speaker proposes that humans make meaning for themselves and that it is an emergent result of a process that happened naturally without guidance.', 'The process of creating meaning is celebrated through the telling of stories. The speaker mentions that humans tell fancy stories about themselves, celebrate the beauty of these stories, and continue to build stories on top of each other.', 'The eventual goal is to colonize other planets, solar systems, and galaxies. The speaker expresses the hope that humans will eventually colonize other planets, solar systems, and galaxies and tell even better stories.']}], 'duration': 1950.374, 'thumbnail': 'https://coursnap.oss-ap-southeast-1.aliyuncs.com/video-capture/Ui38ZzTymDY/pics/Ui38ZzTymDY7158005.jpg', 'highlights': ["The synergy of genetics and experience in creating unique talents, such as the 'Mozart effect,' is emphasized as a crucial factor in human development and expertise acquisition.", 'The significance of discovering intrinsic motivation and nurturing it is underscored, highlighting its impact on human development and the pursuit of expertise.', 'The chapter discusses the journey of discovering intrinsic motivation and its impact on human development, emphasizing the importance of nurturing it to foster unique talents and expertise acquisition.', "The author's personal experiences and observations regarding intrinsic motivation, human development, and expertise acquisition are shared, providing insights into the role of genetics and experience in shaping talents and passions.", 'The author reflects on the importance of recognizing and nurturing intrinsic motivation, highlighting its profound impact on human development and the pursuit of expertise.', 'The chapter discusses the excitement about exploring human cognition and the disillusionment with the biological approach in psychiatry, highlighting the shift in the deep thinkers about the human mind from psychiatrists to cognitive psychologists.', 'The opportunities in systems and cognitive neuroscience are highlighted, emphasizing the richness of opportunities in this field.', 'The speaker fears degenerative conditions more than death, having witnessed tragic situations, and is concerned about losing cognitive abilities.', 'Realization of limited time has motivated the speaker to shift focus in their work, transitioning to studying mathematical cognition and feeling the pressure of a looming deadline.', "The speaker's contemplation of mortality has influenced their decision-making and work, leading them to pick something more challenging and significant.", "The chapter also explores the speaker's view on the transition from life to death and the impact of anticipating mortality on reasoning and motivation.", 'The scientist expresses his hope for his legacy to highlight his ability to see and pursue exciting paths in science, fostering collaborative opportunities and contributing to scientific progress.', 'The scientist recounts finding joy in scientific progress, particularly during the interactive activation model and the development of theory, emphasizing the importance of seeking such moments in collaborations with students.', "The scientist persevered in pursuing theoretical contributions despite initial rejection and labels, ultimately realizing that one need not be a superhuman to contribute to the development of theory and emphasizing the lesson of not succumbing to labels or reviewers' opinions.", 'Humans create their own meaning as an emergent result of natural occurrences without guidance.', 'The process of creating meaning is celebrated through the telling of stories.', 'The eventual goal is to colonize other planets, solar systems, and galaxies.']}], 'highlights': ["Jay McClelland's collaboration with influential figures like David Rumelhart and Jeff Hinton has paved the way for ideas central to the neural network-based machine learning revolution of the past 15 years.", 'The fundamental beauty of neural networks lies in their ability to link biology with the mysteries of thought, as highlighted by Jay McClelland.', 'The shift in thinking from seeking inspiration from biology to focusing on adjusting connection weights to solve problems led to the development of the backpropagation algorithm by Rumelhart.', 'The study of physiology at the time focused on sensory and motor systems, while cognition was associated with abstract computer algorithms.', 'The leap in cognition with humans is where the difference seems to occur, leading to questions about the uniqueness of human intelligence and the potential for alien civilizations to possess similar capabilities.', 'Semantic dementia causes progressive loss of ability to appreciate meaning of experiences and concepts.', 'The immersion in experience and thinking in an abstract, formal way is akin to the process of understanding language and developing an intuitive understanding of the real world, emphasizing the interconnectedness between cognitive processes and immersion in experiences.', 'The natural numbers are now widely accepted as a cultural construction, contrary to the previous belief of it being part of innate knowledge. It has been accepted by almost everyone that the natural numbers are actually a cultural construction, debunking the previous notion of it being part of innate endowment of core knowledge.', "The synergy of genetics and experience in creating unique talents, such as the 'Mozart effect,' is emphasized as a crucial factor in human development and expertise acquisition.", 'The author reflects on the importance of recognizing and nurturing intrinsic motivation, highlighting its profound impact on human development and the pursuit of expertise.']}