<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Highly Probable]]></title><description><![CDATA[How technology shapes societies and alters our future]]></description><link>https://highlyprobable.io</link><image><url>https://substackcdn.com/image/fetch/$s_!yXSR!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F83318656-68fa-4241-b37a-76b72fb02713_256x256.png</url><title>Highly Probable</title><link>https://highlyprobable.io</link></image><generator>Substack</generator><lastBuildDate>Wed, 20 May 2026 04:00:30 GMT</lastBuildDate><atom:link href="https://highlyprobable.io/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Sebastian Wildwood]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[highlyprobable@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[highlyprobable@substack.com]]></itunes:email><itunes:name><![CDATA[Sebastian Wildwood]]></itunes:name></itunes:owner><itunes:author><![CDATA[Sebastian Wildwood]]></itunes:author><googleplay:owner><![CDATA[highlyprobable@substack.com]]></googleplay:owner><googleplay:email><![CDATA[highlyprobable@substack.com]]></googleplay:email><googleplay:author><![CDATA[Sebastian Wildwood]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[Deep Insights & Shallow LLMs]]></title><description><![CDATA[In his book The Beginning of Infinity, David Deutsch explains to the reader the unique qualities of knowledge and the power it has to shape the universe.]]></description><link>https://highlyprobable.io/p/deep-insights-and-shallow-llms</link><guid isPermaLink="false">https://highlyprobable.io/p/deep-insights-and-shallow-llms</guid><dc:creator><![CDATA[Sebastian Wildwood]]></dc:creator><pubDate>Tue, 14 Oct 2025 14:41:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!yXSR!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F83318656-68fa-4241-b37a-76b72fb02713_256x256.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>In his book <em>The Beginning of Infinity</em>, David Deutsch explains to the reader the unique qualities of knowledge and the power it has to shape the universe. In particular, knowledge is durable, tends to replicate and can be incredibly transformational. To understand just how powerful it is, we can imagine a planet somewhere far away in the galaxy with an alien species that is early in its evolution. This species is capable only of speech &#8212;they have not yet learned how to read or write. They are functionally equivalent to our earliest ancestors, thousands of years ago. Now imagine we sent a tiny device that encoded all human knowledge up to the current date in the alien species language, including all the known properties and laws of physics. The device lands in the center of their civilization and speaks to them and accepts questions. It guides them on how to create a writing system, how to build advanced shelters, improve their food production systems, and so on. What would this do to this civilization and their world? The knowledge contained in the device would literally transform their world; they would build large structures, cover the land with advanced agricultural techniques and harness the power of their sun.</p><p>If our species was farther along in our evolution, the device sent to the alien planet might do far more than transform a planet, it might alter their solar system or even their galaxy, depending on the depth of knowledge contained on the device. It could teach them how to build spaceships that can travel vast distances, construct Dyson spheres, or show them how to build universal printers that can transform floating hydrogen atoms into anything they required.</p><p>A single tiny device encoded with only knowledge could transform an entire galaxy. That&#8217;s the power of knowledge.</p><p>With the recent release of powerful LLMs to the general public, I&#8217;ve found myself thinking a lot about how knowledge is acquired and used in our world today. LLMs have enabled millions of people to search for information without vetting the source or needing to build a larger model of the information from disparate sources, as they once had to do with books and traditional web searching. The analogy that comes to mind is that we were once students in a library, researching topics of interest; now we are simply asking the professor for the answer.</p><p>Why is this a problem? Shouldn&#8217;t getting to the answer by the shortest path possible be more useful and productive? For information, yes, it&#8217;s quite useful. Quickly determining if a tornado is coming to your town or if your favorite sports team is winning is a great use of this technology. For knowledge &#8212;useful information that is productive&#8212; it&#8217;s more nuanced because of its role in the creation of deep insights.</p><p>Deep insight is the creation of new, profound knowledge by combining existing knowledge in creative ways. It is what is behind every breakthrough in human history. The discovery of relativity by Einstein, Ford&#8217;s invention of the assembly line and Satoshi Nakamoto&#8217;s Bitcoin whitepaper are examples of new, profound knowledge that alters history. These insights are rare; most people create few in their lifetimes and some never do. That is because to create a deep insight not only requires a certain amount of knowledge stored in memory, but also the creativity necessary to combine/deconstruct it into new knowledge. Having creativity without knowledge is not enough; the most brilliant mathematician born into this world will not transform the field of mathematics if they are illiterate and thousands of miles from civilization.</p><p>In contrast, shallow insights create no new knowledge (unbeknownst to the creator) or knowledge that is inconsequential. People frequently produce shallow insights &#8212;young adults often do this, believing they have discovered something novel, only to realize someone else has already stumbled upon their profound realization. More importantly, LLMs only produce shallow insights due to how they work. LLMs are a very specific kind of artificial intelligence that predicts the next token from a sequence of previous tokens. LLMs do not have creativity like humans, and yet this does not stop many individuals from overselling their capabilities.</p><p>LLMs are indeed powerful and useful when working with existing knowledge. Their ability to summarize, aggregate and query is impressive. Consuming thousands of websites on the topic of migratory birds and producing a small paragraph summary is a great use case for LLMs. In addition, they are quite powerful at iterating upon or creating variations of existing knowledge. However, they&#8217;re ability to create new and profound knowledge (deep insight) is not possible. LLMs are not on the path to AGI, regardless of biased CEOs proclamations.</p><p>Now that we understand LLMs only produce shallow insights, why is it a problem for us to rely on them when they are in fact quite good at querying and varying existing knowledge? To understand this, we must remind ourselves again what is required for deep insight:</p><ul><li><p>existing knowledge in memory (preferably varied)</p></li><li><p>creativity</p></li></ul><p>A creative person without what I call minimum viable knowledge (MVK) stored in memory cannot produce deep insight. There simply isn&#8217;t enough material for the creativity to build connections upon. This is why young children and destitute, illiterate geniuses don&#8217;t produce world-changing inventions and breakthroughs; they lack knowledge. MVK is the boring blocks of knowledge that create more interesting clusters in our brains. Multiplication, basic handling of paint brushes, foundational equations in physics are all examples of the kinds of basic knowledge required to create insights in different fields.</p><p>To lean on LLMs for our minimum viable knowledge means we can externally store vast amounts of knowledge and access it faster but lose the ability to create deep insights. LLMs remove the friction of that painful, tedious learning of fundamental knowledge but at great cost. Without deep insights, we stagnate and our knowledge does not expand.</p><p>As a society, we must be aware of the dangers of relying too heavily on tools and agents that reduce our ability to acquire minimum viable knowledge. This is especially true for children and adults at the early stages of their careers or studies. Our over-reliance on nascent AI technology will reduce our ability to produce deep insights and until there is a breakthrough in artificial intelligence, we are the only known entities that can produce deep insights.</p><p>Here&#8217;s a parting question:</p><p>Imagine that LLMs were discovered in 1900 and trained on all human knowledge up to that point in time. Would the LLMs have been able to conceive of Einstein&#8217;s relativity before him?</p>]]></content:encoded></item><item><title><![CDATA[Scarcity]]></title><description><![CDATA[Scarcity is important to functional economies and is usually the reason something is considered valuable.]]></description><link>https://highlyprobable.io/p/scarcity</link><guid isPermaLink="false">https://highlyprobable.io/p/scarcity</guid><dc:creator><![CDATA[Sebastian Wildwood]]></dc:creator><pubDate>Mon, 19 May 2025 14:40:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!yXSR!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F83318656-68fa-4241-b37a-76b72fb02713_256x256.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Scarcity is important to functional economies and is usually the reason something is considered valuable. This can be applied to the mundane (currencies, baseball cards) all the way to the philosophical (love, limited life span). For most of human existence, scarcity was managed by the laws of the physical universe. Gold is rare because those atoms were not fused together frequently, life appears to be rare because the optimal conditions for it to arise are improbable and our time on Earth is precious because we only have so many years before we die. If we invert these physical limitations &#8212;say, make gold a common element&#8212; then it would not have been precious to our ancestors and would never have been a form of currency or source of power.</p><p>Another attribute of the physical world that is key to understanding scarcity is the requirements for replication: resources and knowledge. In order for me to replicate an object in real-life, I must have the knowledge necessary to reconstruct it and the raw resources to build it. If I see a beautiful, hand crafted Japanese sword that I want, I not only need to understand how to make it, I would also need the raw materials. Only one does not get me the sword. If I am gifted in courtship (knowledge) but alone on an island (lacking resources), I will not fall in love. The physical universe is very good at constraining resources.</p><p>With this understanding, we can see how powerful figures arose throughout history simply by hoarding raw materials. If you control resources, you control production of valuable, necessary items for survival. Even if your enemies have the requisite knowledge to build machines of war, if you control the supply of necessary metals, they are not a threat.</p><p>In the past, replication was constrained by access to resources and knowledge because we operated almost entirely in physical space and our technology was limited. The future will be different. We will operate more frequently in virtual spaces, regardless of our preferences. Knowledge workers will conduct meetings and sessions in virtual offices. Children will learn in virtual classrooms. People will meet, fall in love and have relationships without ever meeting physically.</p><p>VR is not constrained by physical laws like our real-world. It is constrained by energy and computation (technically storage as well, but storage is cheap and getting cheaper so quickly that its cost will be negligible). It takes energy to power the computations necessary to operate VR and it requires CPUs/GPUs to render it. The latter is technically constrained in the physical world, but every year chips get faster, cheaper and more commoditized. Access to technology is so pervasive, even some of the poorest people on this planet have smart phones with advanced chip-sets. This leaves us with energy, which is also physically constrained. However, energy production is becoming increasingly more efficient and as technology improves &#8212;especially solar and battery technology&#8212; we will soon have access to virtually unlimited energy by capturing the majority of the solar energy hitting the Earth or by fusion.</p><p>Energy and computation only constrain VR externally. Internally, VR has no constraints other than knowledge. The concept of limited raw materials is nonsensical in most virtual environments. If I draw in Photoshop, I do not worry about running out of the color red. If I&#8217;m building a 3D model, there&#8217;s no shortage of polygons. Scarcity is not a concern.</p><p>In addition to essentially unlimited raw materials, objects in virtual environments can be perfectly replicated with only knowledge. This is already a large problem in present digital systems. The music industry was turned upside down in the early 2000s because replicating owned music moved from requiring knowledge and resources (the music files and the machinery to produce CDs) to just knowledge (knowing where to download the file). This same problem has plagued every form of media, including film and digital art.</p><p>Digital systems have unlimited resources and perfect replication with only knowledge. This is a problem.</p><p>If the future is virtual spaces and the metaverse, and these environments have unlimited raw materials, how can economies and valuable items arise without scarcity? If generating income moves into VR, what would compel someone to train and build amazing new creations if their hard labor was instantly reproducible? Economies will not emerge without scarcity.</p><p>&#8220;But wait, we already have scarcity in digital systems! Look how video games and social networks create economies and enforce scarcity.&#8221; This is true, closed systems can create artificial scarcity by restricting replication and controlling the &#8220;resources&#8221; of their ecosystem. However, closed systems are dangerous for two reasons.</p><p>First, they control how the resources work and can change the rules at any moment. Imagine being a laborer inside a closed system controlled by a corporation. You&#8217;ve built up a business inside their virtual world and are making money mining a resource that is hard to find. One day you wake up and discover a new software patch the corporation released has changed the quantity of that resource considerably and now the resource is abundant. There&#8217;s nothing you can do; the rules of the environment have simply changed.</p><p>Second, closed systems are ephemeral. Corporations shutter. Business owners trade hands and change direction. There is absolutely no guarantee any business you currently work with will be around in 10, 5 or even one year. So not only are the parameters of a closed system unreliable, there&#8217;s no guarantee that the system will persist.</p><p>Closed systems &#8212;Fortnite, Facebook, TikTok, etc&#8212; were up until recently the only real way to restrict resources and replication inside digital environments. Fortunately, that is no longer the case. With the invention of blockchain technology, we can now have an open system that allows for the persistent storage of digital assets and verified scarcity.</p><p>This is a revolution that&#8217;s for the most part ignored by the majority of people. For the first time in the history of modern computers, a means to verify scarcity exists in a system not controlled by a private corporation. You can own a unique digital asset that no one else has. Everyone can verify only you own it. Even if copies exist elsewhere, everyone will know your version is legitimate. Most importantly, this asset will not disappear when the business/person/entity that made it disappears. As long as the blockchain persists, the object persists, regardless of the businesses that come and go.</p><p>From my view, this explains the fever induced explosion in NFT prices from 2021 on. From a cursory view, it may appear to be strange and bubbly (and it most certainly is bubbly), but the people invested in this space see the potential and believe they are buying some of the first assets ever to be part of this pivotal moment in history.</p><p>There is no future in virtual systems without scarcity and there are only two known ways to implement it that we know of: proprietary, closed systems and blockchain technology. The former is closed, unreliable and ephemeral. The latter is open, reliable and has the potential to last indefinitely. Which will we choose?</p>]]></content:encoded></item></channel></rss>