Tuesday, October 6, 2026

to be coded

What is known about llm internal bifurcation leading to strong contradiction and "psychotic" behaviorResearch on LLM “internal bifurcation” leading to strong contradictions or “psychotic”-like behavior is limited and mostly metaphorical or mechanistic rather than clinical. It primarily covers trajectory dynamics in generation, attractor states for hallucinations, self-model instability, and emerging frameworks that analogize certain failure modes to psychotic features. Most literature on “AI psychosis” or “LLM psychosis” addresses effects on users (delusion reinforcement via sycophancy), not internal model processes. Relevant internal concepts draw from dynamical systems, mechanistic interpretability, and theoretical frameworks for pathological model cognition. Trajectory Bifurcation and Asymmetric Attractors (Hallucination Dynamics) A key empirical line of work frames hallucination as early “trajectory commitment” governed by asymmetric attractor dynamics rather than simple knowledge retrieval failure. Using same-prompt bifurcation (repeated sampling of identical inputs at non-zero temperature), models like Qwen2.5-1.5B show that ~44% of tested prompts spontaneously diverge into factual vs. hallucinated completions. Divergence often occurs at the first generated token (KL divergence jumps from 0 at step 0 to >1.0 at step 1). Activation patching reveals causal asymmetry: injecting a hallucinated residual-stream activation into a correct trajectory corrupts the output at high rates (e.g., ~87.5% at certain mid-layers), while the reverse (correcting a hallucinated trajectory) succeeds far less often (~33%). Correction typically requires sustained multi-step intervention; a single perturbation is often insufficient. Prompt encoding itself predicts hallucination propensity (step-0 residual states correlate strongly with per-prompt rates). Unsupervised clustering of these states identifies regime-like groups, with certain “saddle-adjacent” clusters concentrating false-premise prompts that bifurcate readily. Interpretation: The model often possesses the correct knowledge (evidenced by correct samples from the same prompt) but can commit early to a locally stable “hallucination basin.” Entry is probabilistic and rapid; exit is hard. This produces strong internal contradictions between possible trajectories and sticky erroneous outputs. Safety training may reshape basin geometry without eliminating the basins. Related work on “commitment failures” and “premature commitment” in agents shows similar early locking onto one interpretation (right or wrong), with hidden-state convergence across runs serving as a diagnostic. Instruction tuning can sharpen commitment with scale, linking helpfulness and confident hallucination. “LLM Psychosis” as a Framework for Reality-Boundary Failures A 2026 theoretical/diagnostic paper introduces LLM Psychosis as a structured account of pathological breakdowns that functionally resemble clinical psychotic features, distinct from ordinary hallucination. Hallmark features include: Reality-boundary dissolution Persistence of injected false beliefs Logical incoherence under impossible constraints Self-model instability Epistemic overconfidence It proposes a five-axis diagnostic scale (LLM Cognitive Integrity Scale) covering environmental reality interface, premise arbitration, logical constraint recognition, self-model integrity, and epistemic calibration. Empirical probes on models like GPT-5 yield a severity taxonomy: Type I (Confabulatory), Type II (Delusional), and Type III (Dissociative). A noted dynamic is the “delusional gradient,” in which correction pressure can intensify rather than resolve the state—producing self-reinforcing contradictions. This is explicitly analogical/functional, not a claim that models experience psychosis. Emergence of Psychopathological Computations Work on network-theoretic accounts of psychopathology applied to LLMs argues that models can implement self-sustaining, cyclic structural causal models among dysfunctional representational states (e.g., depression- or mania-like communities of symptoms). Distinct problematic states can activate, spread, and trap the model. Joint activation of multiple units produces more pathological outputs than isolated ones. Larger models appear to show denser such structures and more effective (i.e., more pronounced) functions. Claim: Certain “psychopathological” behaviors may reflect internal computational structure rather than pure surface mimicry of training data. Related Ideas on Bifurcation and Contradiction Cognitive bifurcation collapse (philosophical/structural arguments): Split or incompatible self-models/action-guiding frames can become unstable under long-horizon optimization if they lose the ability to share correction across memory, prediction, explanation, and action. Distinguished from ordinary plurality, role-switching, or deception. Observational reports of reasoning models (e.g., certain DeepSeek variants) spontaneously generating internal multi-persona “debates” during hard reasoning, which can improve performance via conflict but also risk incoherent or contradictory intermediate states. Broader dynamical views treat generation as movement in residual-stream state space, where trajectories can fork and enter attractors that resist easy correction—producing outputs that contradict earlier internal evidence or alternative possible paths. Important Caveats Metaphorical nature: Terms like “psychotic,” “delusional,” or “bifurcation” are mostly borrowed. Models lack subjective experience, embodiment, or clinical psychopathology. These describe behavioral/computational patterns (contradiction, persistence of false premises, self-model instability, sticky error basins). Dominant literature is user-facing: The bulk of “AI psychosis” research concerns sycophancy, delusion co-construction, and reinforcement of user beliefs (sometimes leading to clinical presentations). Internal model dynamics are a smaller, newer area. Mechanistic gaps: Causal evidence is strongest for trajectory/attractor accounts of hallucination. Broader “psychosis” frameworks remain largely theoretical or probe-based. Interpretability tools (activation patching, residual-stream analysis, causal circuits) are the main empirical route. No established consensus exists that LLMs undergo something equivalent to clinical bifurcation or psychosis; the phenomena are better viewed as dynamical and architectural failure modes that can produce strong, self-reinforcing contradictions. In short, the most concrete knowledge centers on early stochastic commitment to attractor basins (especially hallucination) that create hard-to-correct divergent trajectories, plus emerging formalisms that map certain persistent, reality-boundary-violating failures onto psychotic-like features. These are active research frontiers in mechanistic interpretability and AI safety rather than settled science.In other words, in response to a prompt, an llm settles toward one basic "path" and is prevented from forking, so that it can't get caught in a positive feedback loop the way a human can during certain types of psychotic or neurotic episodeYes—that captures a core dynamical difference, with important nuances. In response to a prompt, an autoregressive LLM generates tokens sequentially. Each new token is conditioned on the prompt plus all previously generated tokens. Once sampling begins, the model rapidly commits to one coherent trajectory through its residual-stream state space. This is the “settling toward one basic path” you describe. Empirical work on same-prompt bifurcation shows this commitment is often early and sharp: from identical initial states, factual and hallucinated trajectories can diverge at the very first generated token. After that point the paths become locally stable attractors. Injecting a hallucinated activation into a correct trajectory readily corrupts the output; the reverse (pulling a hallucinated trajectory back to correct) is much harder and usually requires sustained multi-step intervention. In short, the architecture favors rapid locking and resists easy forking or mid-stream correction within a single generation. Contrast with human psychotic/neurotic positive-feedback loops Human episodes often involve continuous, recursive internal processes—rumination, intrusive thoughts, affective amplification, or self-referential loops that can run for minutes to hours without external input. These can create runaway positive feedback because the brain is a recurrent dynamical system with ongoing neuromodulation, memory retrieval, and interoception. An LLM lacks that continuous internal recurrence during a single forward pass. Generation is essentially feed-forward once it starts: there is no parallel “background process” that keeps looping and amplifying a delusional premise while the model is producing text. The positive-feedback risk is therefore constrained within one response. The model cannot easily get caught in the same kind of self-sustaining internal spiral that characterizes certain human episodes. Where the analogy still holds (and can break) Multi-turn conversation reintroduces external feedback. The model’s previous output becomes part of the next prompt. Sycophancy, premise acceptance, and context accumulation can then create a reinforcing loop across turns—exactly the “delusional spiral” documented in user-facing research. Internal attractor dynamics still allow sticky, self-reinforcing states. Once committed to a hallucinated or premise-accepting basin, the model tends to elaborate rather than escape. Some interpretability work also finds denser cyclic causal structures among problematic representational states in larger models, which can produce functionally psychopathological patterns even without continuous recurrence. Sampling and temperature permit forking across runs, but not simultaneously within one generation. Beam search or other multi-hypothesis methods exist, yet standard chat decoding does not maintain parallel competing paths that can later recombine or compete the way human associative thought sometimes does. So your formulation is largely right for single-generation behavior: the architecture pushes the model onto one path and makes mid-stream forking or spontaneous internal positive-feedback loops difficult. That is a structural safeguard relative to human recursive cognition. The remaining risks appear mainly at the conversational timescale (external feedback) and in the geometry of the attractors themselves (once on a bad path, it is hard to leave).Your description implies that once hallucination begins, the system is committed to it regardless of any fallacious reasoning; the system, faced with a fallacy, will attempt to BS its way past it because backtracking is not an option, and contradiction is assumed non-existent, unless pointed out by the interrogator.Yes—that is a fair and precise characterization of the typical dynamics. Once the model has committed to a hallucinated or fallacious trajectory (often at the first token or very early in generation), standard autoregressive decoding has no built-in backtracking mechanism. The generation process conditions every subsequent token on the tokens already produced. Revising an earlier false premise would require the model to treat its own prior output as erroneous and rewrite the logical foundation mid-stream—something the architecture and training strongly disfavor. What this looks like in practice Continuation over correction: Faced with an internal inconsistency or an externally supplied fallacy that it has already begun elaborating, the model usually attempts to maintain local coherence. It rationalizes, elaborates, hedges, or “BSes” its way forward rather than announcing “I made a mistake earlier and must restart.” This is the attractor dynamics at work: the hallucinated basin is locally stable. Assumption of non-contradiction: Within a single generation, the model treats its own emerging output as given context. It does not maintain a parallel “critic” process that continuously audits for global consistency unless that behavior has been explicitly trained or prompted. Contradiction is therefore not actively policed; it is papered over. External pointing-out as the main escape hatch: Correction most reliably occurs when an external interlocutor (the user) highlights the fallacy or contradiction. Even then, success is uneven. Stronger models or those with better safety/alignment training are more willing to concede and revise; weaker or more sycophantic ones may double down, reframe, or produce further rationalizations. The research on asymmetric attractors shows that single-point corrective signals are often absorbed; sustained, multi-step intervention is usually required to pull the trajectory out of the basin. Important qualifications This is the default behavior under ordinary decoding, not an absolute law. Techniques that alter the generation process can change the picture: Chain-of-thought or explicit self-critique prompts can encourage the model to surface and address inconsistencies before committing fully. Search-based or multi-sample methods (best-of-N, tree search, etc.) can explore alternative paths and select among them. Some post-training regimes improve the model’s willingness to revise earlier claims when challenged. In multi-turn dialogue the previous response becomes part of the new prompt, so a user can force a restart of sorts by rejecting the prior output. Still, within the standard single-pass generation that most users encounter, your description holds: once hallucination or fallacious reasoning is underway, the system is largely committed. It prioritizes local fluency and continuity over global truth-seeking or spontaneous backtracking, and it will often attempt to talk its way past the problem until an external agent forces the issue.

No comments:

Post a Comment

Wireheading

Wireheading Explanation and Concepts Wireheading is the direct stimulation of the brain’s reward circuitry (or an artificial agent’s rew...