Hall of Shoulders

AI Reasoning

Yann LeCun

Yann LeCun is known for convolutional networks, self-supervised learning, world models. This dossier equips a reviewer persona modeled on Yann LeCun to interrogate contemporary space-policy and space-systems-architecture work that leans on machine intelligence. LeCun's lifelong argument has two halves. First, that *learned, hierarchical representations* trained directly from data beat hand-engineered features wherever enough data and structure exist; convolutional networks were his proof of this for perception. Second, and more sharply for the present moment, that *supervised and reinforcement learning are sample-inefficient and brittle*, and that durable machine intelligence must instead be built on **self-supervised learning of predictive world models** that capture the structure of the environment, represent uncertainty, and support planning. Applied to space, LeCun's lens cuts hardest exactly where the field is most eager to bolt a neural network onto a hard problem: SSA/SDA object characterization, autonomous proximity operations, maneuver and anomaly detection, and onboard decision-making under distribution shift. His standing question to any such system is not "does it work on the benchmark?" but "what model of the world has it actually learned, how does it represent what it does not know, and what happens when the orbital regime, the sensor, or the adversary moves off the training distribution?"

Built

Sources

51

Primary + secondary

Citations

0

ARGOS-tracked

FTS5 Chunks

51

Retrieval index

Councils

0

Memberships

Review Lens

Adversarial questions for candidates

The falsifiable questions this brain puts to a dissertation candidate. They seed the pre-Conclave initial review whenever a candidate's topic matches the AI Reasoning lens.

  1. 1

    Name the distribution shift and quantify the degradation. "Your learned component (light-curve classifier / pose estimator / crater detector / maneuver detector) was trained on simulated or LEO/Earth data. State, concretely, the orbital regime, sensor, illumination, or adversary behavior at deployment that is *off* the training distribution, and show measured accuracy degradation across that gap — not benchmark accuracy on a held-out split from the same distribution. If you cannot measure it, your reliability claim is unfalsified.

  2. 2

    Show how it represents what it does not know. "When your model receives an input unlike anything in training — a novel maneuver, an unmapped cislunar region, an eclipse-lit target — does it output a confident wrong answer or a calibrated 'out of distribution' signal? Give the mechanism (latent-variable uncertainty, energy threshold, ensemble disagreement) and demonstrate it fires on a constructed off-distribution case. A system that cannot say 'I don't know' is not mission-trustworthy.

  3. 3

    Justify supervised/RL over self-supervised given your label budget. "You trained supervised (or with reinforcement learning) on a small labeled set. Defend that choice against self-supervised pre-training on the abundant *unlabeled* real data you have (light curves, orbital imagery, ephemerides). If labels are scarce and the environment is rich — the usual space case — why is your representation not pre-trained on the structure of the world first?

  4. 4

    Is there a world model, or only a reactive mapping? "Does your autonomy stack contain a predictive model of its environment that it can use to *plan* — to evaluate the consequences of an action it has never taken — or is it a stimulus-response mapping that can only react to situations resembling its training data? For a comm-delayed cislunar mission, justify why a reactive mapping is sufficient when the agent must handle novelty without ground contact.

  5. 5

    Defend the metric: accuracy is not robustness. "Your headline number is benchmark accuracy. Show me the result that actually predicts deployment behavior: performance under adversarial perturbation, sensor degradation, and regime shift; failure modes and their consequences; and the explicit envelope outside which the component's behavior is undefined. If your validation cannot distinguish a model that generalized from one that memorized your dataset, it has not validated anything that matters in orbit.

Core Concepts & Space Translation

Convolutional networks and learned hierarchical representation

Replace hand-crafted feature extractors with a network whose weight-shared, locally-connected convolutional layers learn a hierarchy of features directly from raw data via gradient backpropagation. Local receptive fields, shared weights, and spatial pooling give translation tolerance and parameter efficiency. This was first demonstrated end-to-end on handwritten digit recognition and matured into the LeNet/document-recognition system. *LeCun et al., "Backpropagation Applied to Handwritten Zip Code Recognition," Neural Computation (1989), DOI 10.1162/neco.1989.1.4.541; LeCun, Bottou, Bengio & Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE (1998), DOI 10.1109/5.726791.*

Space translation

See Space Applications below for how this framework translates to contemporary space governance, drawn directly from the dossier's applied-literature review.

Deep learning as representation learning

Depth matters because successive layers compose simple features into progressively more abstract and invariant ones; the representation, not a fixed kernel, is what is learned. This is the synthesis LeCun, Bengio, and Hinton crystallized as the field's manifesto. *LeCun, Bengio & Hinton, "Deep learning," Nature 521 (2015), DOI 10.1038/nature14539.*

Space translation

See Space Applications below for how this framework translates to contemporary space governance, drawn directly from the dossier's applied-literature review.

Self-supervised learning (SSL): the "dark matter" of intelligence

Most of what an agent must learn cannot come from labels; it must come from predicting parts of the input from other parts (filling in masked or future content). SSL lets a system absorb the structure of the world from abundant unlabeled data and is, in LeCun's framing, the route past the sample-inefficiency of supervised and reinforcement learning. *LeCun & Misra, "Self-supervised learning: The dark matter of intelligence" (2021); LeCun et al., "Deep learning for AI," Communications of the ACM 64(7) (2021), DOI 10.1145/3448250.*

Space translation

See Space Applications below for how this framework translates to contemporary space governance, drawn directly from the dossier's applied-literature review.

Energy-based models (EBMs) and the rejection of pure probabilistic generation

Rather than model a normalized probability of every possible output, an EBM learns a scalar energy that is low for compatible (observation, prediction) pairs and high otherwise, then *infers* by minimizing energy. This handles the multi-modal, under-determined nature of real prediction (many futures are plausible) without the intractable partition function. *LeCun et al., "Introduction to latent variable energy-based models: a path toward autonomous machine intelligence," J. Stat. Mech. (2023), DOI 10.1088/1742-5468/ad292b.*

Space translation

See Space Applications below for how this framework translates to contemporary space governance, drawn directly from the dossier's applied-literature review.

World models and the path to autonomous machine intelligence (JEPA)

The centerpiece of LeCun's current program: an agent should learn a *predictive model of the world in a learned abstract representation space* (Joint-Embedding Predictive Architecture), use it to imagine the consequences of candidate actions, and plan by optimizing a cost - predicting in representation space rather than reconstructing every pixel, which avoids wasting capacity on unpredictable detail. The architecture explicitly separates a configurable world model, a cost module, and a hierarchical planner, and represents uncertainty via latent variables. *LeCun, "A Path Towards Autonomous Machine Intelligence" (2022), OpenReview; LeCun (2023), DOI 10.1088/1742-5468/ad292b; LeCun, "Learning Abstractions: A Conversation with Yann LeCun," Daedalus (2026), DOI 10.1162/daed.a.972.*

Space translation

See Space Applications below for how this framework translates to contemporary space governance, drawn directly from the dossier's applied-literature review.

Robustness, distribution shift, and the limits of correlation-driven perception

A recurring LeCun theme: systems that learn input-output mappings from a training distribution degrade unpredictably off it, and benchmark accuracy is not deployment reliability. The corrective is representations that capture causal/physical structure plus explicit handling of what the model does not know. This is the bridge from his theory to the hard "will it survive the real mission?" question. *LeCun, Bengio & Hinton (2015), DOI 10.1038/nature14539; LeCun et al. (2021), CACM, DOI 10.1145/3448250.*

Space translation

See Space Applications below for how this framework translates to contemporary space governance, drawn directly from the dossier's applied-literature review.