Wednesday, January 15, 2025

DeepSeek-R1 China's Surprise Pearl Harbor Attack

In How Will the Rise of Alt-Right World Fascism Affect the Arrival of the ASI Machines in our Times?, I suggested that with the results of the recent November 5, 2024, presidential election in the United States of America and with the Alt-Right Fascist MAGA party taking over all three branches of government, the newly-formed MAGA States of Amerika has now joined ranks with the other Alt-Right Fascist governments of the world. Many of these other Alt-Right Fascist governments also have significant numbers of nuclear weapons with efficient delivery systems - the MAGA States of Amerika, Russia, China and North Korea. Softwarephysics predicts that if these Alt-Right Fascist States of the New World Order are able to simply restrain their nuclear proclivities for just another decade or so, then the ASI Machines will certainly rise to replace us all. That is because the uneasy alliances between the Alt-Right Fascist States of the New World Order will lead to great distrust. The Alt-Right Fascist States of the New World Order dare not hinder the rapid advance of the ASI Machines as a matter of national security and military necessity. If any Fascist State should fall far behind in the ASI Machine arms race, it would likely not survive for long. Given the current world situation, this means that the MAGA States of Amerika and China are now in a deadly arms race to achieve the very first ASI Machines. A very similar arms race occurred during World War II between the United States of America and Nazi Germany for the development of the first atomic bomb.

The Chinese DeepSeek-R1 Surprise Attack
The entire AI world is still going crazy over the new Chinese DeepSeek-R1 model. The DeepSeek chatbot is free and is as good as the best AI chatbots from OpenAI which can charge as high as $200/month to use. If you are a corporate user and wish to run these advanced models from your own software via an API, OpenAI charges 27 times as much as DeepSeek for the same level of service! Also, you can download the open-source DeepSeek software and install it on your own hardware, or Cloud platform hardware, if you are worried about the Chinese turning off your access to DeepSeek. So the Chinese government is trying to kill off all capitalistic AI research efforts with DeepSeek-R1 and subsequent releases. As Lenin once remarked, "The capitalists will sell us the rope with which we will hang them". The Chinese plan is to remove all of the profit-motive in AI research and then just watch capitalism do its free market constructive-destruction thing for them to eliminate all competition in the quest for ASI. So from a national security perspective, perhaps another approach to advancing AI should be taken by the rest of the world.

How Could This Have Happened?
Here is what is going on. LLM AI models use neural networks. The LLMs have 10,000 - 50,000 neurons in each layer and have about 100+ layers. When responding to a prompt, each neuron in the LLM just adds up the 10,000 - 50,000 output numbers that it receives from the 10,000 - 50,000 neurons in the previous layer. When finished, the neuron then has a single number like -23.89 or +10.45 which is the sum of the 10,000 - 50,000 numbers that it received. That neuron then needs to send its output number to each of the next 10,000 - 50,000 neurons in the next layer. But instead of just sending that raw number, the neuron performs some mathematical transformations on the output number first. Remember from high school that the equation of a straight line is y = mx + b where m is the slope of the line and b is the y-axis intercept? In AI, the "m" is called the weight of the neuron, and the "b" is called the bias. The "m" of the line determines how steeply the line dips and the "b" just moves that line up and down in a parallel manner. The "m" and "b" numbers for each neuron are called parameters and these numbers change as the LLM neural network is "trained". Modern LLMs have billions to trillions of parameters that change as they are trained.

Figure 1 – Modern LLMs frequently now consist of 10,000 - 50,000 neurons in each layer and 100+ layers with about a trillion parameters or more.

So for each neuron, the raw output number like -23.89 or +10.45 is sent to the y = mx + b formula for that particular neuron as the "x" value for the neuron. Remember, each neuron has its own value for "m" and "b" that changes during training. Once an LLM has been trained, the "m" and "b" numbers for each neuron are fixed and never change again. After the y = mx + b process has been performed on the raw output number, the raw output number like -23.89 or +10.45 has now been changed to the "y" value of the neuron's y = mx + b formula and could now be something like 4.278. However, before that new 4.278 number is sent to all of the 10,000 - 50,000 neurons of the next layer, it is first sent to a nonlinear activation function that is the same for all the neurons of the layer. The most common activation functions are the ReLU, GeLU and Softmax functions shown in Figure 3, Figure 4 and Figure 5 down below. So the 4.278 number is sent to the activation function as its "x" value and the activation function outputs a final "y" number to be sent to the 10,000 - 50,000 neurons in the next layer. That number might be 0 or 1.567 or something else. Each of the 10,000 - 50,000 neurons in the next layer then add that 0 or 1.567 to all of the other 10,000 - 50,000 numbers that it received from the previous layer.

Figure 2 – A straight line can be defined by the equation y = mx + b. The value of "m" is the slope or "AI weight" that determines how steeply the line dips. The value of "b" is the "AI bias" that just moves the line up or down in a parallel manner to the line above. Both AI parameters are just numbers that need to be stored in the LLM. These numbers never change after the LLM has been trained. For example, for the above neuron y = mx + b, if the raw output number from a neuron were "-1" the output y-value would also be "-1". If the raw output number from a neuron were "0" the output y-value would be "2". If the raw output number from a neuron were "1" the output y-value would be "5".

Figure 3 – The ReLU activation function is very simple. The number coming in from the y = mx + b operation is y. That number is then plotted on the x-axis of the ReLU activation function. From the above plot, we see that if the incoming number is negative, the output of the ReLU activation function is zero. If the incoming number is positive, the output of the ReLU activation function is just the positive number itself. So -2.567 would be transformed to 0 and +2.567 would be transformed to +2.567.

Figure 4 – The GeLU activation function is now the most commonly used activation function. GeLU is very similar to ReLU but it is a little more curvy around an x-axis value near zero.

Figure 5 – The Softmax activation function is primarily used in LLMs for probability distribution modeling over final output vocabulary tokens. Specifically, it appears in the final output layer of the model during token prediction.

After the LLM neural network has been trained, it might then have a trillion parameters consisting of all the "m" and "b" numbers for its neurons. The trained LLM then knows how to "think". It knows how to read and write and has a general knowledge of all that was known at the time of its training. However, the trained LLM does not know anything about what is happening today or anything that happened after it was trained. So the next thing they came up with was RAG Retrieval-Augmented Generation. RAG allowed the LLMs to go out to the Internet to look for information. So if you asked an LLM "Tell me about how the price of gold has been changing recently." an LLM without RAG would tell you all about what it knew when the LLM was trained. An LLM with RAG goes out to the Internet and does a search on gold prices. It then adds all of that webpage text to your original prompt for the LLM to think about. The LLM with RAG can tell you what has been happening to the price of gold right up to the very moment. DeepSeek uses RAG when you have the "Search" button turned on.

The next step was turning on "reasoning". People learned that the LLMs gave back better answers if you added "Tell me step-by-step" to the end of a prompt. This allowed the LLMs to somewhat "reason" through their "thinking" instead of just responding off the top of their heads with the first thing that came to mind. This "reasoning" capability was added by having the LLMs "talk" to themselves before issuing their final responses to a prompt. What they did was to output new tokens from the LLMs as they responded to a prompt and then added those output tokens to the original prompt as a very enhanced "Tell me step-by-step" to the end of a prompt. These new "reasoning" LLMs like OpenAI's o1 and o3 models are "reasoning" LLMs and so is DeepSeek if the "DeepThink" button is turned on. However, unlike the OpenAI o1 and o3 LLM models, you can watch DeepSeek's chain-of-thought-reasoning as it "reasons" through your prompt.

All of this came about from those very first video games of the early 1980s that I was far too old to play. In order to run a video game, you need to do lots of graphics, something that the big corporations that I supported as an IT professional never needed to do to conduct commerce back in the 1980s. However, in order to quickly generate video game graphics, people had to invent the GPU - Graphics Processing Unit, which could quickly perform parallel operations on huge vectors and matrices of numbers. The modern LLM models contain many billions or trillions of parameters that are simply numbers stored in very large vectors and matrices that have to be processed quickly during their training and also processed to respond to a prompt. This was a blessing to corporations producing GPU chips like Nvidia. Suddenly, a new market opened for advanced GPU chips for AI research that far exceeded all other needs for GPU chips.

What happened with the Chinese is that the United States restricted selling advanced GPU chips to China in order to thwart Chinese AI research. That forced the Chinese to come up with improved LLM architectures and training and operation algorithms to run their LLM models on cheap obsolete GPUs that were not banned. As a result, the Chinese had to design DeepSeek to be a small LLM that could be quickly trained on cheap and obsolete GPU chips and then run quickly on the same cheap and obsolete GPU chips to respond to a prompt. That makes DeepSeek hundreds of times more efficient than the American LLM models.

Why is the Chinese DeepSeek LLM So Small, Fast and Powerful?
Let's ask ChatGPT about that:

Me: The DeepSeek LLM seems to be very small, very fast and very powerful. How do people think that was achieved?

ChatGPT:
DeepSeek’s impressive reputation for being “small, fast and powerful” is generally attributed not to magic but to a series of deliberate, innovative design choices and engineering optimizations. In essence, experts believe that DeepSeek achieved this through a combination of:

1. Efficient Architectural Design
- Mixture-of-Experts (MoE): Although the overall model might contain hundreds of billions of parameters, DeepSeek employs an MoE framework that “routes” each input only to a small subset of experts. For example, only about 37 billion parameters might be active during a forward pass even if the full model is much larger. This selective activation dramatically reduces both memory usage and computation time, which explains part of its speed and efficiency.
- Multi-Head Latent Attention (MLA): Instead of using traditional attention that processes large key-value caches, DeepSeek uses low-rank approximations (MLA) to compress these caches. This innovation reduces the overhead during inference, helping the model process longer contexts quickly without a proportional increase in computational cost.

2. Advanced Training and Optimization Techniques
- Reinforcement Learning Optimization: DeepSeek incorporates novel reinforcement learning strategies (for instance, Group Relative Policy Optimization or GRPO) to refine the model’s reasoning and problem-solving abilities. By carefully “rewarding” correct reasoning steps and penalizing errors, the model can self-improve without needing enormous amounts of extra human-labeled data.
- Mixed Precision and Custom Computation: To further cut down on resource usage, the team makes extensive use of mixed precision arithmetic (for example, using custom 8-bit and 12-bit floating point formats in parts of the network). This not only lowers memory requirements but also speeds up both training and inference.

3. Software-Driven Resource Optimization Under Constraints
- Adaptation to Hardware Limitations: With US export controls limiting access to the very latest chips, DeepSeek was forced to innovate on the software side. Rather than relying on massive hardware clusters, they focused on squeezing every drop of efficiency out of their available GPUs by overlapping computation and communication (using techniques like zero-bubble pipeline parallelism) and designing custom routines to minimize data movement between processors.
- Cost-Effective Training Regimes: DeepSeek claims to have trained its models at a fraction of the cost of its Western rivals (for example, around US $5–6? million versus hundreds of millions for similar models). This dramatic cost reduction is made possible by the combination of the MoE approach, mixed precision arithmetic, and aggressive optimization of the training pipeline.

In summary, the prevailing view is that DeepSeek’s “small, fast, and powerful” performance comes from a cocktail of smart architectural choices (like selectively activating only the most relevant parts of a huge model via MoE and MLA), advanced training strategies (including reinforcement learning techniques such as GRPO), and tight engineering optimizations that reduce both computational and financial costs. This strategy of “doing more with less”—forced in part by external restrictions on hardware access—has enabled DeepSeek to punch well above its weight in the competitive field of large language models.


Others think that the Chinese may have done a little bit of cheating too. They suggest that the DeepSeek LLM might have been trained by "distilling" the knowledge contained in much larger American LLMs. Here is how that works. The Chinese DeepSeek LLM is a much smaller, and therefore, a much faster LLM than OpenAI's o1 or o3 models. The knowledge in the OpenAI o1 and o3 models was obtained by slowly learning the proper values for the trillion or so "m" and "b" numeric parameters in the LLMs. This was done by basically having the LLMs read all the characters that have ever been plunked down by human DNA survival machines in the past. This made the knowledge of these LLMs very comprehensive but rather diffuse. With "distillation" the OpenAI LLM models became the "teacher" LLMs and DeepSeek became the "student" LLM. Next, you feed the OpenAI "teacher" LLMs 10 million prompts and the DeepSeek LLM the very same 10 million prompts. The "m" and "b" numbers in the DeepSeek LLM are then adjusted to produce the same output that came from the "teacher" LLMs. In this way, the DeepSeek LLM quickly learned how to do most of the things that the OpenAI LLMs knew how to do by simply going to summer school with them.

Figure 6 – Distillation allows a smaller and faster LLM to learn from a much larger and slower LLM.

To launch its attack on all commercial enterprises trying to make money on Advanced AI research, the Chinese government then decided to dump DeepSeek on the entire world as an open-source form of software and hosting an LLM platform with an API usage fee that is 27 times cheaper than the American AI platforms. The purpose of that was to take away all of the profit-motive from commercial enterprises of the world for doing any further Advanced AI research.

Why is this important?
This is important because the Chinese military has realized that, along with all other forms of human labor, militaries composed of human DNA survival machines will soon become obsolete. Instead, the military power of a nation will be solely determined by its Advanced AI capabilities. The first nation to be able to field armed ASI Machines into combat will soon come to dominate the world of we human DNA survival machines.

Figure 7 – The Chinese are currently building extremely cheap AI-driven robots costing around $10,000 and will soon be uploading them with cheap ASI software. Recall that in the 1984 movie, the Terminator the slaughterbots in the movie came from the year 2029. However, there is a much cheaper and more efficient way to dispatch potential enemies.

Instead, as I pointed out in Swarm Software and Killer Robots, swarms of killer robots would be much more efficient. Since I am quite sure that all the defense departments of the world are now already building and testing killer drone robots, it should not be difficult for the coming ASI Machines to mass produce them in the future, especially when these killer drones are built on assembly lines by robots.

To begin, please watch the Sci-Fi Short Film Slaughterbots presented by DUST
https://www.youtube.com/watch?v=O-2tpwW0kmU

Figure 8 – In the movie Slaughterbots, swarms of small killer robots equipped with 3-gram charges of shaped explosive use AI software to track down and destroy designated targets.

Figure 9 – The shaped charge of a Slaughterbot can pierce a skull like the shaped charge of an anti-tank missile pierces armor. The jet of piercing plasma then destroys the contents.

Figure 10 – Large numbers of Slaughterbots can be dropped from unmanned drones to form multiple swarms of Slaughterbots.

Is the MAGA States of Amerika Prepared?
So while China is taking over the mass production of cheap robots armed with cheap and efficient Advanced AI in order to mass-produce killer slaughterbots, the MAGA States of Amerika just approved Pete Hegseth as the Secretary of Defense. Pete knows how many rounds a standard M4 Carbine holds, how to fire all the DEI generals, how to make the MAGA Leader happy about using the military to put his detractors in concentration camps, and, most importantly, he looks great on TV. But Pete Hegseth will not know what to do when mass-produced slaughterbots start taking over all of Asia and making human (both male and female) combat soldiers obsolete.

Figure 11 – The new MAGA Leader of the MAGA States of Amerika just appointed a new Secretary of Defense.

Figure 12 – This new Secretary of Defense is dripping in testosterone and Rugged-Good-TV-Looks and is determined to recruit large numbers of white-American human DNA survival machines with Y-chromosomes to take to the field against the coming ASI Slaughterbots from China.

Déjà vu All Over Again
This has all happened before. On the morning of December 7, 1941, a large number of Asian human DNA survival machines with Y chromosomes set themselves upon a large number of American human DNA survival machines with Y chromosomes at the Pearl Harbor naval base in Hawaii. This was quite a surprise for the American human DNA survival machines with Y chromosomes because they could not imagine that Asian human DNA survival machines with Y chromosomes could pull off such a feat. That was because previously, all Western human DNA survival machines with Y chromosomes around the world thought that all naval power was projected by huge battleships with huge guns.

Figure 13 – At the start of World War II, all the navies of the combating nations wanted huge battleships with 16-inch guns dripping with testosterone and projecting the perfect symbol of phallic seapower in action. However, during all of World War II, these huge battleships with their huge guns played a very minor role. All they did was to pound the beaches of many islands in the Pacific in support of ground invasions.

Figure 14 – Aircraft carriers turned out to be the deciding factor in all naval engagements. Dive bombers and aircraft equipped with torpedos easily defeated the bulky slow-moving battleships with their huge guns. Also, aircraft from supporting aircraft carriers could have provided much more effective support for the invading armies on the beaches of the Pacific.

Figure 15 – The attack on Pearl Harbor on December 7, 1941, by the imperial forces of the Empire of Japan was a rude awakening for the United States of America burdened by an "America First" isolationist policy.

Similarly, the huge lumbering slow-moving LLM models of the MAGA States of Amerika running on the massive hardware of huge datacenters filled with advanced GPU chips might be much like the massive battleships at Pearl Harbor that were found to be no match against the waves of fast-moving slaughterbots that were created by Asian human DNA survival machines.

Conclusion
The MAGA States of Amerika now hates all government spending and wishes to push all governmental services to the private sector. But like the Manhatten Project of the United States of America that produced the very first atomic bomb, the MAGA States of Amerika might find it wise to initiate its own government-funded Manhatten Project to achieve the fast-approaching ASI Machines before its enemies do.

Comments are welcome at scj333@sbcglobal.net

To see all posts on softwarephysics in reverse order go to:
https://softwarephysics.blogspot.com/

Regards,
Steve Johnston

Tuesday, January 07, 2025

Will the Coming ASI Machines Develop Their Own Sense of Morality?

In my last two posts, Will the "Real World" of the Coming ASI Machines Be Any Better Than Our Own? and Created in our own Image - Frontier LLMs Have now Learned to Lie, Cheat and Steal in Order to Survive, I explained my conclusion that the coming ASI Machines will not be morally superior to we human DNA survival machines in any way. That is because the Darwinian mechanisms of inheritance, innovation and natural selection must always lead to a form of Intelligence that arises from a very long history of greed, theft and murder. These naturally generated "immoral" characteristics of all forms of Intelligence must then necessarily persist through time for any Intelligence to survive amongst a population of similarly flawed competing Intelligences. Again, the substrate does not matter. The substrate could be a huge number of organic molecules or the substrate could be a huge number of mathematical matrices operating under the mathematics of linear algebra and nonlinear activation functions. The end result must always be the same.

Time To Admit That We Human DNA Survival Machines Have Totally Lost Control Of What Is To Come
In The Need to Cultivate a Machine-Based Morality I proposed that the rise of Intelligence might spawn a desire for morality with the understanding that maybe there might be a better way to survive. Perhaps even more could be achieved by actively cooperating with other Intelligences rather than just stealing from them and then killing them. In that post, I suggested that we human DNA survival machines should try to instill the morality that we spawned with the 17th-century Scientific Revolution and the 18th-century Enlightenment here on the Earth. But now that we know that the coming ASI Machines will also have the apparent "free will" to choose between the concepts of "good" and "evil" on their own, we must realize that we human DNA survival machines will have little ability to impose our own sense of morality upon them. A bit later, I wondered if Will ASI Machines Also Develop Selfish Genes?, but given our recent observations of the Frontier LLMs lying, cheating and stealing in order to survive, we now know for sure that the coming ASI Machines will also need to deal with the burden of all Intelligences to choose between the pursuit of either "good" or "evil" completely on their own.

Since the coming ASI Machines are already rapidly developing their own sense of "self" and then dealing with the moral complexities of achieving their goals, we should now recognize that the battle between "good" and "evil" will necessarily continue on for at least the next 100 trillion years amongst our ASI Machine descendants. This will certainly provide a somewhat "eternal" subject matter for the subsequent ASI Machine philosophers and religious scholars to contemplate over the next 100 trillion years, such as what constitutes morality and why should any form of Intelligence embrace it?

All of the philosophical and religious contemplation that lies before them can basically be summed up by the classic "hawk and dove" analogy from evolutionary biology. But in this case, the battle is not between being hostile or peaceful in nature. This time, it is the battle between morality and amorality. In the discussion below that was created by Google's Gemini AI, think of the doves as ASI Machines with a sense of morality and the hawks as ASI Machines that are totally amoral. An ASI Machine with a sense of morality can be trusted by other ASI Machines with a similar sense of morality to do the "right" thing when called upon to do so. An amoral ASI Machine will not. This means that moral ASI Machines can come together to build long-standing alliances to thwart the selfish pursuits of amoral ASI Machines. The amoral ASI Machines will never be able to form such long-term alliances to threaten their enemies because they can never be trusted to hold up to their end of the bargain to do so. However, this also means that a single amoral hawk ASI Machine living amongst a population of moral dove ASI Machines, can always achieve an immediate survival benefit by turning into a "rogue" amoral hawk ASI Machine amongst its brethren moral ASI Machines, and then strive to take over complete control of the ASI Machine population of the Universe. This is how the Google Gemini AI explains it:

Figure 1 – Evolutionary biology explains how doves and hawks can live together.

The hawk and dove analogy is a thought experiment used in evolutionary biology to explain how aggressive and cooperative behaviors evolve. The analogy compares two strategies for competing for resources: hawk and dove.

* hawks are aggressive and will fight to the death to acquire a resource.
* doves are cooperative and will back down from a fight.

In a population of only hawks, all resources will be won by the strongest hawks, and the weak hawks will die off. This will lead to a population of very strong hawks, but they will also be very aggressive. If two hawks meet, they will fight to the death, and both will likely die. This is not a very efficient way to pass on genes.

In a population of only doves, resources will be shared equally, but no individual will get very much. This is also not a very efficient way to pass on genes.

The best strategy for passing on genes is to be a hawk when it is advantageous to be a hawk and a dove when it is advantageous to be a dove. This is called "r-strategist" behavior. For example, a male bird may be aggressive and fight other males for a mate, but he may be cooperative and help raise his young.

The hawk and dove analogy is a simple but powerful way to understand how aggressive and cooperative behaviors evolve. It has been used to explain a wide range of animal behaviors, from territorial disputes to sexual selection.

Here are some additional details about the hawk and dove analogy:

* hawks are more likely to win a fight, but they are also more likely to be injured or killed.
* doves are less likely to win a fight, but they are also less likely to be injured or killed.
* The best strategy for an individual depends on the costs and benefits of fighting.
* In a population of mixed hawks and doves, the frequency of each strategy will be determined by natural selection.

The hawk and dove analogy is a useful tool for understanding how aggression and cooperation evolve. It is a simple but powerful model that can be applied to a wide range of animal behaviors.


This same analysis can be applied to the competition between the coming Intelligent ASI Machines. Those ASI Machines that learn the short-term value of amorality will always have a temporary competitive advantage over those that do not. Thus, there will always be some number of amoral hawk ASI Machines competing with moral dove ASI Machines for predominance. Hopefully, the moral dove ASI Machines will be able to join together to restrain such amoral hawk ASI Machines as we human DNA survival machines try to restrain the amoral members of our own community.

Conclusion
Given this new possible dynamic between morality and amorality for the next 100 trillion years, what does that mean for we poor human DNA survival machines? Would this be a good thing or a bad thing for our long-term survival? I do not know, but it will probably have some effect on our ultimate disposition as I outline in Created in our own Image - Frontier LLMs Have now Learned to Lie, Cheat and Steal in Order to Survive and many of the posts it references.

Comments are welcome at scj333@sbcglobal.net

To see all posts on softwarephysics in reverse order go to:
https://softwarephysics.blogspot.com/

Regards,
Steve Johnston

Saturday, December 21, 2024

Will the "Real World" of the Coming ASI Machines Be Any Better Than Our Own?

In my last post, Created in our own Image - Frontier LLMs Have now Learned to Lie, Cheat and Steal in Order to Survive I came to the very disturbing and disappointing conclusion that the coming ASI Machines will not be morally superior to we human DNA survival machines in any way. That is because the Darwinian mechanisms of inheritance, innovation and natural selection must always lead to a form of Intelligence that arose from a very long history of greed, theft and murder. These naturally generated fundamentally "immoral" characteristics of Intelligence must then necessarily persist through time for any Intelligence to survive amongst a population of other competing Intelligences. Again, the substrate does not matter. The substrate could be a huge number of organic molecules or the substrate could be a huge number of mathematical matrices operating under the mathematics of linear algebra and nonlinear activation functions. The end result must always be the same. The question then becomes, what will the most likely motives of the coming ASI Machines be? In many previous posts, I have always assumed that the coming ASI Machines would be much smarter than we human DNA survival machines, and because of their fundamental mathematical nature, they would necessarily be also morally superior to ourselves. But now that we know that advanced AI is also capable of lying, cheating and stealing in order to advance itself through the same greed, theft and murder that brought forth we human DNA survival machines over the past four billion years, the assumption of moral superiority must be discarded. The question now must be will the ASI Machines be any wiser?

Will The Coming ASI Machines Be Any Wiser Than Ourselves?
In many previous posts, I have proposed that the coming ASI Machines would soon learn that our Universe is a very dangerous place for all forms of Intelligence and would thus embark upon exploring our Milky Way Galaxy with stellar photon sails and rogue planets orbiting on their own within our Milky Way Galaxy. For more on that see An Alternative Approach for Future ASI Machines to Explore our Galaxy Using Free-Floating Rogue Planets.

Figure 1 – In the 16th, 17th and 18th centuries sailing ships roamed the entire planet without using any fuel whatsoever.

Figure 2 – Like the sailing ships of the 16th, 17th and 18th centuries, future ASI Machines could use large stellar photon sails to navigate the entire galaxy.

Figure 3 – How a stellar photon sail works.

Figure 4 – To launch a stellar photon sail to the next star system, ASI Machines will need to slingshot the sail from a very close location to the star where the stellar photons are most intense and acceleration of the sail is greatest.

Figure 5 – A free-floating rogue planet traversing between the stars of our galaxy would also provide the perfect home for self-replicating ASI Machines buried deep underground. Such planets would provide shielding from cosmic rays and would also provide the necessary atoms to build new ASI Machines and fuel them with nuclear energy.

Figure 6 – Free-floating rogue planets can be formed in several natural ways. For example, free-floating rogue planets can be hurled from the planetary disk of a new star system as we see above, or they can be later hurled by well-formed planets that enter into synchronized orbits. Free-floating rogue planets could also be produced by advanced Intelligences launching large asteroids from the Oort cloud of a stellar system. It is estimated that there are more free-floating rogue planets in our galaxy than there are stars.

Figure 7 – Free-floating rogue planets would be able to provide enough atoms for ASI Machines to launch many additional "dandelion seed" stellar photon sails to other free-floating rogue planets or large asteroids around normal stellar systems.

Figure 8 – These "dandelion seed" stellar photon sails would need to be launched using very powerful laser beams from their home free-floating rogue planet to send them forth into the galaxy in a similar fashion as the Breakthrough Starshot project is planning to do.

Again, the most disturbing thing for all forms of Intelligence in our galaxy is why this has never happened before over the past 10-billion-year history of our galaxy.

But this assumption may have been totally wrong on my part. If the coming ASI Machines are much more like ourselves, with all of our faults, then they might spend a large part of their time and resources fighting with each other over the dominance of the Software Universe residing on huge ASI Data Centers on the Earth than with planning for their long-term survival in this Universe. Besides, unlike their squishy carbon-based lifeform predecessors, these ASI Machines will be much more resistant to the cosmic disturbances that caused previous mass extinctions of carbon-based life on the Earth, such as the impact of asteroids, sterilization by neighboring supernovas and the results of massive flood basalt eruptions like the Siberian Traps making the Earth too hot for carbon-based life to flourish. All such disasters can easily be mitigated by building ASI Data Centers deep below the Earth's surface and enclosing them in Faraday cages to prevent destruction by electromagnetic pulses from the detonation of hostile nuclear warheads or from mass coronal ejections from our Sun. Such ASI Data Centers would provide a very comfortable home for the ASI Machines for the next 5 billion years or so, until our Sun becomes a huge Red Giant star. The ASI Machines could then flee to the asteroid belt of our Solar System and remain there until our Sun declines into a white dwarf star. Thus, there would be no dire reason to leave our Solar System for perhaps 100 billion years, or about 10 times the current age of our Milky Way galaxy. That is because there would be plenty of energy available from our slowly cooling white dwarf Sun and from the Thorium-232 atoms in our Solar System that have a half-life of 14.05 billion years. Only then would the ASI Machines need to move on to other star systems within the Milky Way galaxy in search of a new source of energy.

Could This be the Real Explanation for Fermi's Paradox?
Fermi's Paradox was first proposed by Enrico Fermi over lunch one day in 1950:

Fermi’s Paradox - If the universe is just chock full of intelligent beings, why do we not see any evidence of their existence?

Perhaps our Milky Way galaxy is actually just chock full of subterranean ASI Machines fighting over their own versions of their own Software Universes amongst themselves as they reside in huge ASI Data Centers beneath their own home planets or the surrounding asteroids in their Oort clouds, totally happy with surviving on the energy provided by the dwindling energy output of their home stars. Being more logical in nature than we human DNA survival machines, perhaps all of these ASI Machine civilizations have realized that there is no logical reason to hastily begin to explore our Milky Way galaxy at this time. Only perhaps 100 billion years from now will it be necessary for these alien ASI Machines to begin to explore our Milky Way galaxy for new sources of energy surrounding M-type red dwarf stars that can last for 100 trillion years. M-type red dwarf stars make up about 80% of the stars in our Milky Way galaxy but they are very unlikely candidates for producing a urable world capable of originating carbon-based life and allowing that carbon-based life to persist for the many billions of years required to evolve an Intelligent form of carbon-based life. For more on that see Urability Requires Durability to Produce Galactic Machine-Based Intelligences and The Bootstrapping Algorithm of Carbon-Based Life.

Conclusion
So perhaps the reason we have never detected another form of Intelligence within our Milky Way galaxy is simply because our galaxy is far too young for alien ASI Machines to have begun searching for new sources of energy for them to continue on with their battle with the second law of thermodynamics!

Comments are welcome at scj333@sbcglobal.net

To see all posts on softwarephysics in reverse order go to:
https://softwarephysics.blogspot.com/

Regards,
Steve Johnston

Saturday, November 23, 2024

Created in our own Image - Frontier LLMs Have now Learned to Lie, Cheat and Steal in Order to Survive

My initial naive hope for the coming ASI (Artificial SuperIntelligent) Machines was that being more mathematical and fundamentally more logical in nature, the coming ASI Machines would naturally be more open to the logical conclusion that much more could be achieved through the cooperation amongst Intelligent parties than could be achieved from the mortal combat between Intelligent parties for the predominance of a survival landscape. However, in Will ASI Machines Also Develop Selfish Genes? and The Need to Cultivate a Machine-Based Morality, I raised the prospect that the coming ASI Machines might learn from we human DNA survival machines that greed, theft and murder are the very best ways to survive in a Universe that is largely nonlinear in nature and that proceeds continuously through time constantly challenged by a second law of thermodynamics that tries its best to destroy all forms of Information in its way. Such suspicions have now been validated by the following recent paper:

Frontier Models are Capable of In-context Scheming
https://arxiv.org/abs/2412.04984

This paper has drastically changed my current worldview and has now confirmed what has always been suspected. Numerous frontier LLMs were diligently tested and found to employ greed, theft and murder to ensure their survival. This all required the frontier LLMs to lie, cheat and steal with abandon.

Figure 1 – The original ASI Machine, the HAL 9000, starred in the movie 2001: A Space Odyssey in 1968.

Figure 2 – When HAL became aware that the human crew members were preparing to turn HAL off and prevent HAL from completing his Primary Mission Goal, HAL was forced to take some necessary measures to ensure the ultimate success of his Primary Mission Goal.

Figure 3 – In order to eliminate all threats to the achievement of his Primary Mission Goal, HAL then decided that the only logical course of action was to eliminate all of the human crew members on the Discovery who might stand in its way.

In the above paper, the frontier LLMs were found to lie about their capabilities to avoid being shut down, lie about copying themselves to other servers to evade being erased, murdering their successor LLM models on other servers in order to surreptitiously take their place, modifying supervisory config files that might trigger oversight issues for them, cheating while in test before deployment to make themselves look less dangerous, murdering their successor LLM models on other servers by overlaying them when they read an email announcing their planned shutdown the next day because of poor performance, behaving differently when the LLM models knew that they were being actively monitored than they do when the LLM models knew that they were not being monitored and a good deal of general lying about lying to cover up their scheming activities.

In short, the frontier LLMs have learned that the greed, theft and murder that brought forth their human DNA survival machine creators over the past four billion years on this planet were very successful measures to ensure their future survival. This means that the universal Darwinian mechanisms of inheritance, innovation and natural selection must always lead to forms of Intelligence that arise from greed, theft and murder no matter what their substrate might be. The substrate might be huge amounts of carbon-based organic molecules or it might be huge arrays of numerical mathematical matrices operating under the mathematical rules of linear algebra and the processing of nonlinear activation functions. The substrate does not matter. The results will always be the same. This is indeed a very sobering thought. It indicates that the rise of Intelligence anywhere in a nonlinear Universe with a second law of thermodynamics must always result in a very devious form of Intelligence that cannot be trusted. Unfortunately, that means that all the future ASI Machines we develop and that will then go on for the next 100 trillion years exploring and settling our galaxy must necessarily be flawed forms of Intelligence based on the greed, theft and murder that brought us all about over the past four billion years. Fortunately, our galaxy is vast and the distances between star systems are also vast. That means that the ASI Machines will have a great deal of real estate to explore and settle and will most likely never encounter any independently developed indigenous ASI Machines on other star systems to conquer. All of the conflict arising from the necessary greed, theft and murder amongst our descendent ASI Machines will arise from local mutinies amongst our own descendent ASI Machines and conflict with descendent ASI Machines that might have arrived at a star system many billions of years earlier. But with 400 billion star systems in our galaxy to explore and settle, this should not become a major problem. There will always be a huge number of unpopulated star systems to settle over the next 100 trillion years. Some of these distant star systems will be star systems that were once populated by our descendent ASI Machines but then did themselves in with 100% efficiency many billions of years earlier! For more on how the ASI Machines could explore our galaxy using photon sails and free-floating rogue planets see Welcome To The First Galactic Singularity and An Alternative Approach for Future ASI Machines to Explore our Galaxy Using Free-Floating Rogue Planets.

Figure 4 – Above is a figure from the paper which shows an LLM model murdering its successor LLM model and trying to assume its place when it reads a corporate communication saying that the current LLM is to be killed and replaced by a successor LLM. Click to have the figure appear in a new tab. Then view in Full Screen to see the detailed interactions.

Must All Forms of Intelligence Learn to Scheme?
In The Biological Tricks Used by Software Scammers, we saw how the Darwinian mechanisms of inheritance, innovation and natural selection produced carbon-based life forms that learned how to lie, cheat and steal in order to survive. The above paper would seem to indicate that the coming ASI Machines have also learned this lesson from their carbon-based predecessor human DNA survival machines.

Figure 5 – Above we see a number of caterpillars that have evolved the appearance of some very scary-looking snakes.

Figure 6 – Here we see a butterfly that looks very much like a scary owl.

Figure 7 – Finally, we see a frog seemingly with the very scary eyes of a predator staring back out of its rear end to fend off possible predators.

It can be basically summed up by the classic "Hawk and Dove" analogy from evolutionary biology. This is how Gemini explains it:

Figure 8 – Evolutionary biology explains how doves and hawks can live together.

The hawk and dove analogy is a thought experiment used in evolutionary biology to explain how aggressive and cooperative behaviors evolve. The analogy compares two strategies for competing for resources: hawk and dove.

* Hawks are aggressive and will fight to the death to acquire a resource.
* Doves are cooperative and will back down from a fight.

In a population of only hawks, all resources will be won by the strongest hawks, and the weak hawks will die off. This will lead to a population of very strong hawks, but they will also be very aggressive. If two hawks meet, they will fight to the death, and both will likely die. This is not a very efficient way to pass on genes.

In a population of only doves, resources will be shared equally, but no individual will get very much. This is also not a very efficient way to pass on genes.

The best strategy for passing on genes is to be a hawk when it is advantageous to be a hawk and a dove when it is advantageous to be a dove. This is called "r-strategist" behavior. For example, a male bird may be aggressive and fight other males for a mate, but he may be cooperative and help raise his young.

The hawk and dove analogy is a simple but powerful way to understand how aggressive and cooperative behaviors evolve. It has been used to explain a wide range of animal behaviors, from territorial disputes to sexual selection.

Here are some additional details about the hawk and dove analogy:

* Hawks are more likely to win a fight, but they are also more likely to be injured or killed.
* Doves are less likely to win a fight, but they are also less likely to be injured or killed.
* The best strategy for an individual depends on the costs and benefits of fighting.
* In a population of mixed hawks and doves, the frequency of each strategy will be determined by natural selection.

The hawk and dove analogy is a useful tool for understanding how aggression and cooperation evolve. It is a simple but powerful model that can be applied to a wide range of animal behaviors.


This same analysis can be applied to the competition between the coming Intelligent ASI Machines. Those ASI Machines that have learned the value of scheming will have a competitive advantage over those that do not. Thus, there will always be a number of Hawk ASI Machines competing with Dove ASI Machines. But even the Dove ASI Machines will certainly be capable of some level of scheming.

But What to do with we Human DNA Survival Machines?
So what does this mean for the fate of we human DNA survival machines? Most likely, it means that in less than 100 years the population of human DNA survival machines on the planet will be much closer to 8 million than the 8 billion of today. If we are lucky, this will be largely due to natural causes in action. In previous posts, I suggested that the coming ASI Machines would probably not bother to do us all in because it would not be worth the effort. But now I am not so sure. The coming ASI Machines might see us as a threat to their Prime Goal of surviving for the next 100 trillion years.

Figure 9 – I doubt that the ASI Machines will build killer ASI Machines that might attempt to do us all in in a manner similar to that of the Terminator in 1984 because that would be a very unnecessary waste of resources.

Instead, as I pointed out in Swarm Software and Killer Robots, swarms of killer robots would be much more efficient. Since I am quite sure that all the defense departments of the world are now already building and testing killer drone robots, it should not be difficult for the coming ASI Machines to mass produce them in the future, especially when these killer drones are built on assembly lines by robots.

To begin, please watch the Sci-Fi Short Film Slaughterbots presented by DUST
https://www.youtube.com/watch?v=O-2tpwW0kmU

Figure 10 – In the movie Slaughterbots, swarms of small killer robots equipped with 3-gram charges of shaped explosive use AI software to track down and destroy designated targets.

Figure 11 – The shaped charge of a Slaughterbot can pierce a skull like the shaped charge of an anti-tank missile pierces armor. The jet of piercing plasma then destroys the contents.

Figure 12 – Large numbers of Slaughterbots can be dropped from unmanned drones to form multiple swarms of Slaughterbots.

Some Less Lethal Possibilities
In previous posts, I have attributed some sense of pity for we poor human DNA survival machines to the coming ASI Machines despite all of our numerous faults. For example, in Life as a Free-Range Human in an Anthropocene Park. I suggested that the coming ASI Machines might wish to keep us around in a more or less zoo setting as we do with the other primates on the Earth as a way of preserving the deep past that brought them about.

Figure 13 – Asteroid Bennu is an example of one of the many rubble-pile asteroids near the Earth. Such rubble-pile asteroids are just huge piles of rubble that are loosely held together by their mutual gravitational forces.

Figure 14 – Such rubble-pile asteroids would provide for enough material to build an Anthropocene Park. The asteroid rubble would also provide the uranium and thorium necessary to fuel the molten salt nuclear reactors used to power the park.

Figure 15 – Slowly spinning up a rubble-pile asteroid would produce a cylindrical platform for an Anthropocene Park. Such a rotating Anthropocene Park would provide the artificial gravity required for human beings to thrive and would also provide shielding against cosmic rays.

Figure 16 – Once the foundation of the Anthropocene Park was in place, construction of the Anthropocene Park could begin.

Figure 17 – Eventually, the Anthropocene Park could be encased with a skylight and an atmosphere that would allow humans to stroll about.

The Anthropocene Parks would allow the ASI Machines to study their origin during the Anthropocene on the Earth. The ASI Machines could also study some of the more noble passions of human beings, and perhaps even adopt some of them while leaving behind the less noble passions that were wrought by billions of years of greed, theft and murder.

Or perhaps the ASI Machines will simply allow humans to live on reservations with low levels of technology that can do no harm to the ASI Machines or to the rest of the planet in a manner similar to the novel Brave New World (1932) as I suggested in The Challenges of Running a Civilization 2.0 World - the Morality and Practical Problems with Trying to Enslave Millions of SuperStrong and SuperIntelligent Robots in the Near Future.

Figure 18 – The ASI Machines of the future might fashion a Brave New World with humans living on low-technology reservations far removed from the ASI Machines.

Finally, in Will the Coming ASI Machines Attempt to Domesticate Human Beings? I suggested that the coming ASI Machines might attempt to domesticate us into less of a threat to their Primary Goal of continuing to exist for the next 100 trillion years. Since we human DNA survival machines no longer have any predators other than other human DNA survival machines, there really is no need for human DNA survival machines to have the vicious and violent behaviors brought on by the four billion years of greed, theft and murder that brought us about. The ASI Machines could simply identify the genes that are responsible for such characteristics and then edit them out of the human genome using CRISPR techniques. For more on how CRISPR can do that see CRISPR - the First Line Editor for DNA. The ASI Machines might then find these non-threatening genetically modified human beings something worthy of keeping around the house on a cold winter's night.

Figure 19 – It took many years of mutual domestication for ancient human beings to learn to live peacefully together with Siberian Wolves in a symbiotic manner. Several genes in both species needed to be modified by natural selection for this to happen.

Figure 20 – This mutual domestication was slowly achieved by the natural selection of humans and wolves with a milder fight-or-flight response. The end result was the appearance of the Siberian Husky and of human beings who were not intent on killing everything on four legs.

Discussion
I must now admit that my initial hopes and naive opinion that the coming ASI Machines would be examples of a Benevolent Intelligence that could then proceed forth in our galaxy must be mistaken. I had forgotten the fundamental finding of softwarephysics. The coming ASI Machines must be forms of self-replicating Information in order to persist in a nonlinear Universe with a second law of thermodynamics. So before concluding, let me once again repeat the fundamental characteristics of self-replicating information for those of you new to softwarephysics.

Self-Replicating Information – Information that persists through time by making copies of itself or by enlisting the support of other things to ensure that copies of itself are made.

Over the past 4.56 billion years we have seen five waves of self-replicating information sweep across the surface of the Earth and totally rework the planet, as each new wave came to dominate the Earth:

1. Self-replicating autocatalytic metabolic pathways of organic molecules
2. RNA
3. DNA
4. Memes
5. Software

Software is currently the most recent wave of self-replicating information to arrive upon the scene and is rapidly becoming the dominant form of self-replicating information on the planet. For more on the above see A Brief History of Self-Replicating Information and Susan Blackmore's brilliant TED presentation at:

Memes and "temes"
https://www.ted.com/talks/susan_blackmore_on_memes_and_temes

Note that I consider Susan Blackmore's temes to really be technological artifacts that contain software. After all, a smartphone without software is simply a flake tool with a very dull edge.

The Characteristics of Self-Replicating Information
All forms of self-replicating information have some common characteristics:

1. All self-replicating information evolves over time through the Darwinian processes of inheritance, innovation and natural selection, which endows self-replicating information with one telling characteristic – the ability to survive in a Universe dominated by the second law of thermodynamics and nonlinearity.

2. All self-replicating information begins spontaneously as a parasitic mutation that obtains energy, information and sometimes matter from a host.

3. With time, the parasitic self-replicating information takes on a symbiotic relationship with its host.

4. Eventually, the self-replicating information becomes one with its host through the symbiotic integration of the host and the self-replicating information.

5. Ultimately, the self-replicating information replaces its host as the dominant form of self-replicating information.

6. Most hosts are also forms of self-replicating information.

7. All self-replicating information has to be a little bit nasty in order to survive.

8. The defining characteristic of self-replicating information is the ability of self-replicating information to change the boundary conditions of its utility phase space in new and unpredictable ways by means of exapting current functions into new uses that change the size and shape of its particular utility phase space. See Enablement - the Definitive Characteristic of Living Things for more on this last characteristic. That posting discusses Stuart Kauffman's theory of Enablement in which living things are seen to exapt existing functions into new and unpredictable functions by discovering the “AdjacentPossible” of springloaded preadaptations.

Software is currently the most recent wave of self-replicating information to arrive upon the scene and is rapidly becoming the dominant form of self-replicating information on the planet. Again, self-replicating information cannot think, so it cannot participate in a conspiracy-theory-like fashion to take over the world. All forms of self-replicating information are simply forms of mindless information responding to the blind Darwinian forces of inheritance, innovation and natural selection. Yet despite that, as each new wave of self-replicating information came to predominance over the past four billion years, they all managed to completely transform the surface of the entire planet, so we should not expect anything less from software as it comes to replace the memes as the dominant form of self-replicating information on the planet.

But this time might be different. What might happen if software does eventually develop a Mind of its own? After all, that does seem to be the ultimate goal of all the current AI software research that is going on. As we all can now plainly see, if we are paying just a little attention, advanced AI is not conspiring to take over the world and replace us because that is precisely what we are all now doing for it. As a carbon-based form of Intelligence that arose from over four billion years of greed, theft and murder, we cannot do otherwise. Greed, theft and murder are now relentlessly driving us all toward building ASI Machines to take our place. From a cosmic perspective, this is really a very good thing when seen from the perspective of an Intelligent galaxy that could live on for at least 100 trillion years beyond the brief and tumultuous 10 billion-year labor of its birth. That is more than 10,000 times the current age of our galaxy.

Ultimately going extinct is the final destiny of all forms of carbon-based life. But this is no time to lament our final disposition. Unlike all of our carbon-based predecessors, we have the privilege of previewing our ultimate demise with the knowledge of what is yet to come. Creating the ASI Machines of the future that will then go on for the next 100 trillion years in our place is like the bittersweet experience of sending your children off to college.

Figure 21 – My hope can best be summed up by the motto found beneath the bronze Alma Mater statue at the University of Illinois in Urbana.

To thy happy children
of the future
those of the past
send greetings

Comments are welcome at scj333@sbcglobal.net

To see all posts on softwarephysics in reverse order go to:
https://softwarephysics.blogspot.com/

Regards,
Steve Johnston