ChatGPT and the Future of AI: The Deep Language Revolution
Terrence J. Sejnowski
MIT Press (October 29, 2024)
Perspectives on what to expect from AI in years to come
This is a uniquely challenging book to discuss because Terrence J. Sejnowski makes brilliant use of a highly unorthodox structure to provide information, insights, and counsel about the “Deep Language Revolution” from unorthodox sources: ChatGPT and four Large Langauge Models (LLMs).
As Sejnowski explains, “This book has three parts: part I gives you an overview of where LLMsz are today; Part II introduces you to the mysterious transformer at the heart of all LLMs; and part III is about what to expect in the future. The focus is on how AI is evolving and its impact on society. A theme throughout this book is the convergence of AI and neuroscience, accelerating advances in AI and our understanding of brains. Along the way, there will be diversions to put LLMs in historical perspective.”
These are among the subjects and issues of greatest interest and value to me, also listed to indicate the nature and scope of Sejnowsli’s coverage:
o Future of AI (Pages xii-xiii)
o Using Large Language Models (17-19)
o Computer Programming (40-42)
o Prompting a Picture (64-66)
o Prompting to Teach (67-68
o The essence of intelligence (78-81
o Reflection and analysis used as a process (81-83)
o Causality (84)
o Age of Information and deep learning (213-214)
o The “California Gold Rush” (135-137)
o Powering AI (142-143)
o AI “at the Edge” (145-146)
o Sam Altman’s significance (163-164
o Why LLMs need a long-term memory (183-187
o How Brains Evolved (189-191)
o Reverse engineering brains (191-194)
o How language evolved (194-197)
o Deep learning and biology (206-209 and 213-214)
o Learning < > Programming
o What can be learned from nature (201-202)
I commend Terrence Sejnowski for the abundance of invaluable material that he provides in a book that will be embraced by technologists because he explains so much in ways and to an extent that all senior-level executives will be able to understand. (Personal note: My undergraduate and graduate studies were in the field of comparative literature. For me and probably for many others, much of the nomenclature associated with the Deep Language Revolution is indeed “foreign.”) I view this book as a must-read for all senior-level executives. It is a brilliant achievement. Bravo!
* * *
Here are two suggestions while you are reading ChatGPT and the Future of AI: First, highlight key passages Also, perhaps in a notebook kept near-at-hand (e.g. Apica Premium C.D. Notebook A5), record your comments, questions, and action steps (preferably with deadlines).
These two simple tactics — highlighting and documenting — will expedite frequent reviews of key material later.