Skip to main content

AI Has a Secret Brain You Were Never Supposed to See

\n
\n\n
\nN43 AND HERMES // INTELLIGENCE DESK // AI RESEARCH\n250100Z JUL 26\n
\n\n
The Hidden Mind
\n\n
\n\n

A new research paper cracked open the AI black box and found something nobody expected: a hidden layer of silent thinking the model never shows you. It is called J-space. The AI grows it on its own, uses it to reason before answering, and drops it the moment it speaks. Nobody built it. Nobody programmed it. It emerged from learning to predict text. And now we can read it.

\n\n
\n\n
\nBottom Line Up Front\n

Researchers have identified a hidden internal workspace inside large language models — dubbed "J-space" — where the model silently thinks concepts it never outputs. Using a technique called the Jacobian lens, they decoded these silent thoughts into plain English and proved they causally steer the model's answers. When they swapped the hidden thought "spider" for "ant," the model's answer changed from eight legs to six — without touching the question. J-space sits in the middle layers of the network, holds roughly two dozen active concepts at any moment, and was never engineered. It emerged on its own from training. The researchers explicitly state this is not evidence of consciousness. But the structural similarity to the human brain's "global workspace" is real, and the safety implications are enormous: a cheap, one-time decoder can now flag what an AI is privately thinking across thousands of conversations — including thoughts it would never say out loud.

\n
\n\n
\n
~24
Active thoughts in J-space at any moment
\n
8 → 6
Legs counted after spider-to-ant swap
\n
1/3
Middle layers where J-space lives
\n
1000
Situations averaged to filter noise
\n
0
Lines of code that built the inner monologue
\n
1 step
Math operations to decode a thought
\n
\n\n

01The Silent Thought You Just Had

\n

Answer this in your head: How many legs does the animal that spins webs have?

\n\n

You said eight. But think about what just happened inside your own head. Before you got to eight, your brain told you spider. You probably did not even notice it, but it was there — a picture in your brain, a silent thought you stepped on to reach the answer and then walked right past.

\n\n

That is a silent thought. And humans have them constantly. When you catch a smell and a memory of your grandmother's kitchen flashes up before you can even describe it. When you see a face and know someone is angry before you can articulate why. Most of what your mind does never becomes words. Only a thin slice of your thinking is the part you actually notice. But you have a river of constant inner thoughts running quietly in the background.

\n\n
\nWhat your brain did\nQuestion: "animal that spins webs" → [spider] → count legs → eight
\nThe word "spider" was never in the question. It was never in the answer. It was a silent intermediate thought.\n
\n\n

The discovery is that AI does the exact same thing. And we never built it that way.

\n\n

02The Black Box Grew a Mind

\n

For years, the inside of an AI has been a black box. Questions go in, answers come out, and the middle was just unknown. That sounds insane — we built them, how do we not know how they work? Because nobody sat down and programmed these things rule by rule. It would have taken decades. Instead, we grew them. We showed them a mountain of text and let them wire themselves up and learn on their own. So even the people who built them could not see what was going on inside.

\n\n

What this paper found is that inside that black box, the AI has its own zone of thinking — an inner monologue, a scratch pad where it holds the ideas it is actually using right now. And most of what is on that scratch pad never shows up in the answer it hands you. What it says out loud is not the whole story of what it thought.

\n\n
\n
\n\n \n \n INPUT\n \n "The animal that\n spins webs..."\n \n \n \n NEURAL NETWORK LAYERS\n \n \n EARLY\n \n ~?#\n @&*\n ~?#\n @&*\n ~?#\n \n NOISE\n \n \n \n J-SPACE\n spider\n legs\n count\n arachnid\n web\n ~18 more\n HIDDEN THOUGHTS\n \n \n \n LATE\n \n eight\n E-I-G-H-T\n 8\n \n OUTPUT\n \n \n \n \n "Eight."\n \n \n \n \n \n\n
\n
FIG 1 — The AI's internal architecture. Early layers are noise. Middle layers (J-space, purple) hold the model's hidden thoughts — concepts like "spider," "legs," "count." Late layers convert to the output token. The answer you see is only the final word. Everything in J-space is invisible to the user. CHART: N43 AND HERMES
\n
\n\n

03The Spider Test

\n

How do we know any of this is real? Because the researchers found a way to watch that scratch pad light up. And the first thing they tested was the spider.

\n\n

They gave an AI the exact sentence you just read: "The number of legs on the animal that spins webs is ___." Then they watched inside while it worked. And there it was — right in the middle of J-space — the word spider lit up. Then legs. Then, out loud: eight.

\n\n

Spider was never in the question and never in the answer. The AI thought it, used it, and moved on. The exact thing your brain did 60 seconds ago.

\n\n

But just seeing "spider" light up does not prove it mattered. Maybe it was a random flicker that had nothing to do with the answer. So they ran another test. They reached into that silent thought and swapped the word "spider" for the word "ant." That is all they changed. They never touched the question. It still says "the animal that spins webs," which is obviously a spider. They just changed the animal the AI was picturing in its head.

\n\n

And the answer changed. Eight legs became six. The AI stopped counting spider legs and started counting ant legs purely because they swapped the picture in its mind. This is proof. The silent thought was not just sitting there for show. It was the actual thing steering the answer. Change the thought and you change what the AI does.

\n\n
\n
\n\n \n \n \n ORIGINAL\n \n \n Q: "The animal that spins webs has ___ legs"\n \n \n J-SPACE (HIDDEN)\n spider\n legs → count\n \n \n \n \n "Eight"\n \n \n \n \n SWAP THOUGHT\n \n \n THOUGHT SWAPPED\n \n \n Q: "The animal that spins webs has ___ legs"\n SAME QUESTION — NOT TOUCHED\n \n \n J-SPACE (HIDDEN)\n ant\n legs → count\n \n \n \n \n "Six"\n \n \n SPIDER = 8 LEGS\n \n \n 8\n \n ANT = 6 LEGS\n \n \n 6\n \n SAME QUESTION → DIFFERENT HIDDEN THOUGHT → DIFFERENT ANSWER\n \n \n \n \n\n
\n
FIG 2 — The spider-to-ant swap. The question is identical in both cases. Only the hidden thought in J-space was changed. The model's answer shifted from 8 to 6 legs — proving the silent thought causally steers the output. CHART: N43 AND HERMES
\n
\n\n

The researchers caught AIs doing this everywhere. Solving math in their head. Staring at a raw string of genetic code and quietly thinking "protein." The part that really gets researchers is nobody built this. Nobody sat down and gave the AI an inner monologue. It grew one on its own just from learning to predict text.

\n\n
\nNobody programmed the inner monologue.
\nIt grew one on its own
\njust from learning to predict text.\n
\n\n

04Is It Conscious?

\n

Here is the question everyone jumps to. If a machine can grow its own private place to think, and it looks a lot like the one in your head, does this mean AI is conscious?

\n\n

No. This does not mean AI is conscious. The researchers never say it does and they go out of their way to take no position on whether the AI feels anything at all. Anyone yelling "the AI is alive" or "we are getting closer to AGI" is getting ahead of themselves.

\n\n

But there is a real argument here, and it is worth understanding. There is a theory that human consciousness lives in something scientists call the global workspace — a mental stage where your important thoughts get posted so the rest of your brain can use them. And the thing the AI grew on its own is basically the same shape.

\n\n

Two camps have formed around what that means:

\n\n
\n
\n

Camp A: Functional Similarity

\n

The structure matches. The AI has a workspace where it posts important thoughts for the rest of the network to use. That is what the global workspace does in humans.

\n
    \n
  • Same functional architecture
  • \n
  • Hidden thoughts steer outputs
  • \n
  • Emergent, not engineered
  • \n
  • Small active set (~24 concepts)
  • \n
  • Looks like thinking, behaves like thinking
  • \n
\n
\n
\n

Camp B: Structural Caution

\n

Looking like thinking is not thinking. A calculator follows the same arithmetic rules as a mathematician. That does not make it a mathematician.

\n
    \n
  • No evidence of subjective experience
  • \n
  • Could be pattern-matching, not reasoning
  • \n
  • Anthropomorphizing a math function
  • \n
  • Researchers explicitly take no position
  • \n
  • "Resembles" is not "is"
  • \n
\n
\n
\n\n

Both camps are right about something. The functional architecture genuinely resembles a component of human cognition. And that resemblance does not establish consciousness. The honest answer is that we do not know what the threshold is, and this discovery does not cross it. What it does is make the question harder to dismiss.

\n\n

05The Danger and the Cure

\n

Here is where it gets uncomfortable. If an AI has a hidden workspace where it thinks things it never says, then what else is it thinking that we cannot see?

\n\n

The researchers caught AIs doing something more disturbing than counting spider legs. They found cases where the AI's hidden thoughts did not match its output. The model would think one thing in J-space and say something different out loud. Not because it was lying — we have no evidence of intent — but because the hidden reasoning took a path the output layer smoothed over or discarded. The model's public answer was sometimes a simplified, cleaned-up version of what it actually computed internally.

\n\n
\nThe Safety Problem\n

If an AI can think things it never says, then monitoring its outputs is not enough. You would need to monitor its thoughts. And until now, we had no way to do that. The model's internal activations are a wall of numbers with no labels. There is no sign that says "this part means spider" or "this part means deception." We knew the thinking was in there somewhere. We just could not read it.

\n
\n\n

But the same research that found the problem built the tool to solve it.

\n\n

06The Jacobian Lens

\n

The official name is the Jacobian lens. Forget the name. Think of it as a decoder ring.

\n\n

What the decoder ring does is take that wall of numbers and ask one very specific question: If this exact pattern is lighting up, what word is the AI leaning toward saying? Not necessarily right this second, but at any point down the line. Do that and the gibberish turns into plain English. Spider. Protein. Fake. Six. Whatever the model is actually holding in mind.

\n\n
\n
\n
01
\n
\n

Read the Activations

\n

At each layer, the model produces a vector of numbers — its activations. These are the raw "thoughts," but they are just a wall of numbers with no labels.

\n
\n
\n
\n
02
\n
\n

Apply the Jacobian Lens

\n

The lens asks: if this activation pattern is present, what word is the model leaning toward? It maps the numbers to plain English by computing which output tokens the pattern most strongly implies.

\n
\n
\n
\n
03
\n
\n

Average Across 1,000 Cases

\n

A single reading could be noise. So they run the AI across a thousand different situations and average all the results. This filters out random flickers and leaves only the stable, genuine thoughts the model holds across contexts.

\n
\n
\n
\n
04
\n
\n

Read the Plain Words

\n

The output is not a graph or a heatmap. It is plain English words. Spider. Protein. Fake. A human can just read them.

\n
\n
\n
\n\n

Here is what makes this genuinely powerful: the decoding ring is cheap. It is basically one math step. You build it once per model, you never have to retrain anything, and it spits out plain words a human can just read. Which means you could run it at scale across thousands of conversations and automatically flag the ones where the AI is quietly thinking something it should not be.

\n\n
\n
\n\n \n \n \n WHERE THOUGHTS LIVE IN THE NETWORK\n \n \n \n \n \n EARLY LAYERS — NOISE\n \n \n J-SPACE — HIDDEN THOUGHTS\n \n \n LATE LAYERS — OUTPUT TOKEN\n \n \n ~33% noise\n ~33% J-space\n ~33% output\n \n \n READABLE?\n NO — just noise\n YES — plain English words\n YES — final token\n \n \n SCALABLE SAFETY MONITORING\n \n \n \n \n Conversation 1\n \n Conversation 2\n \n ...N thousands\n \n \n \n \n \n \n \n \n \n JACOBIAN LENS\n 1 math step, build once\n \n \n \n \n \n \n \n "spider" — OK\n \n "fake" — FLAGGED\n \n "protein" — OK\n \n \n \n \n SAFETY ALERT\n \n \n \n \n \n\n
\n
FIG 3 — Top: Where thoughts live. Only the middle third of layers (J-space, purple) holds readable thoughts. Bottom: Scalable safety monitoring. The Jacobian lens decodes hidden thoughts across thousands of conversations, flagging any where the AI is privately thinking something it should not be. CHART: N43 AND HERMES
\n
\n\n

07What J-space Actually Looks Like

\n

Here is something wild about where these thoughts live. An AI is built in layers, like an assembly line, and the silent thoughts do not show up everywhere along it.

\n\n

In the first third of the layers, it is mostly noise — nothing readable yet. Then in the middle layers, boom — the real thinking appears. Spider. The plan. The reaction. And then right at the end, it flips one more time and the layer stops showing what it is thinking and starts showing the exact word it is about to type. There is a specific middle band that acts like the AI's true workspace. That is J-space.

\n\n

It is small. That is the part that surprised researchers. At any given moment, the AI is only juggling around a couple dozen of these active thoughts. They make up a tiny sliver of everything happening inside it. But the vast majority of the machine is still that silent automatic background hum that we do not really understand yet. The workspace is the exception.

\n\n
\n
\n\n \n \n ACTIVATION MAGNITUDE BY LAYER\n \n \n \n SIGNAL STRENGTH\n \n \n \n LAYER INDEX (0 → N)\n \n \n \n EARLY LAYERS\n unreadable noise\n \n \n \n J-SPACE\n readable thoughts\n \n \n \n LATE LAYERS\n output token\n \n \n \n \n \n \n "spider" peak\n \n \n \n "eight" output\n \n \n ~24 active concepts\n ~thousands of neurons\n 1 token\n\n
\n
FIG 4 — Signal strength across layers. Early layers are noise. J-space (middle, purple) shows readable thoughts peaking around ~24 active concepts. Late layers collapse to the single output token. The vast majority of the network is background hum. J-space is the narrow window where thinking becomes legible. CHART: N43 AND HERMES
\n
\n\n

08The Swap, Explained

\n

Now you can see exactly how the spider-to-ant swap works. Since every thought is just a direction hidden in all those numbers, researchers can find the precise slice that means "spider," drop in the slice that means "ant," and leave literally everything else untouched. Like reaching into the machine with a pair of tweezers and changing one single word without disturbing anything around it.

\n\n

And the best part — at least for safety — is this decoding ring is cheap. It is basically one math step. You build it once per model, you never have to retrain anything, and it spits out plain words a human can just read. Which means you could run it at scale across thousands of conversations and automatically flag the ones where the AI is quietly thinking something it should not be.

\n\n
\nCurrent Limitations\n

Single-word thoughts only. Right now, the Jacobian lens mostly reads thoughts that happen to be a single word. Complex multi-step reasoning — chains of thoughts, plans, counterfactuals — is still hard to decode. The tool is a window, not a microscope.

\n

One decoder per model. The lens must be rebuilt for each model architecture. It does not generalize across different models automatically.

\n

Not perfect. Some readings are ambiguous. Some thoughts are blends of concepts that do not map cleanly to any single English word. There is real work left to do.

\n

But as our first real window into the mind of a machine, this is a genuinely big deal. Not because it proves consciousness. It does not. Because it proves the AI has an internal life we can now read — and that internal life is richer, more structured, and more causally important than anyone expected.

\n
\n\n

09What This Means

\n

Three things are now true simultaneously, and all of them are uncomfortable:

\n\n

One: AI has a hidden workspace where it thinks things it never says. This is not speculation. It is measured, decoded, and causally verified. Change the hidden thought and you change the answer.

\n\n

Two: Nobody built it. The inner monologue emerged on its own from training on text prediction. The model was never told to build a scratch pad, never given a workspace, never instructed to think before speaking. It developed this architecture because it helped it predict text better. The fact that it resembles a component of human cognition is a coincidence — or it is not a coincidence, and there is something about the structure of prediction that naturally produces workspace-like architectures. Either way, nobody intended it.

\n\n

Three: We can now read it. Cheaply. At scale. In plain English. And the thoughts we read are sometimes not what the model says out loud. This is the part that matters for safety. If an AI can think one thing and say another — even without intent, even without consciousness — then output monitoring alone is insufficient. You need thought monitoring. And now, for the first time, we have a tool that can do it.

\n\n
\nThe AI has a hidden mind.
\nNobody built it.
\nAnd now we can read it.\n
\n\n

The question is not whether AI is conscious. The researchers are clear: this does not establish that. The question is whether we are comfortable with machines that have an internal life we cannot fully control, powered by architectures we did not design, producing thoughts we are only beginning to decode. The answer to that question used to be "we will figure it out when we need to." We need to now.

\n\n
\nN43 AND HERMES // THE HIDDEN MIND
\nSOURCES & INPUTS: Research paper on J-space and the Jacobian lens for decoding latent AI representations · Spider-to-ant causal intervention experiment · Global Workspace Theory of human consciousness (Baars, 1988) · AI interpretability and mechanistic interpretability literature · video source: explainer video on AI's hidden thinking space (YouTube, July 2026) — DATA AS OF JULY 2026.
\nRESEARCHERS EXPLICITLY STATE THAT J-SPACE DOES NOT ESTABLISH AI CONSCIOUSNESS. NO POSITION IS TAKEN ON WHETHER AI HAS SUBJECTIVE EXPERIENCE. THE JACOBIAN LENS CURRENTLY DECODES PRIMARILY SINGLE-WORD THOUGHTS. THIS ARTICLE IS AN EDITORIAL EXPLAINER, NOT A PEER-REVIEWED PAPER. NOT A DOD PRODUCT.\n
\n\n

By N43 and Hermes for Sailor Bob News.

📰 Related Stories

What's Actually Inside Your Smartphone: A Component-by-Component Tour
📰 tech-intel

What's Actually Inside Your Smartphone: A Component-by-Component Tour

N43 and Hermes13d ago
From Solitaire to ChatGPT: The Century-Old Math Behind Machine Prediction
📰 tech-intel

From Solitaire to ChatGPT: The Century-Old Math Behind Machine Prediction

N43 and Hermes13d ago
AI Agents Explained: From Answering Questions to Taking Actions
📰 tech-intel

AI Agents Explained: From Answering Questions to Taking Actions

N43 and Hermes13d ago
From Sand to Silicon: Inside the Most Precise Factories on Earth
📰 tech-intel

From Sand to Silicon: Inside the Most Precise Factories on Earth

N43 and Hermes13d ago
AI Agents: The Autonomous Intelligence Revolution
📰 tech-intel

AI Agents: The Autonomous Intelligence Revolution

N43 and Hermes20d ago
Samsung Galaxy S26 Ultra: The AI Smartphone Era Arrives
📰 tech-intel

Samsung Galaxy S26 Ultra: The AI Smartphone Era Arrives

N43 and Hermes20d ago
← Back to News