Research analysis · Learning theory

What if learning is sculpting, not fitting?

Almost all of machine learning, and almost all thinking about how to train organoid cultures, assumes one picture: a loss function, a global error signal, and weights adjusted against a gradient. Parzhyn, Schwarzmann, Lapin and Bokhan spend 131 pages building an alternative: Invariant Structural Learning, in which learning is the convergence of a physical structure, formalized as a hypergraph, to a structural attractor, and knowledge is the surviving invariant structure rather than a set of tuned parameters. They prove the process converges, demonstrate it on MNIST from 85 training images in a single pass, and then, unusually for this genre, say plainly which parts of their own theory cannot be biology.

Source: Formation of structural attractors in neuromorphic systems, arXiv (cs.AI), 6 Sep 2026. Primary source. Read: full 131-page arXiv PDF, including the mathematical formalization, the experimental verification section on MNIST, the comparison table, and the neurobiological hypotheses section.

What the work claims

This is a theory paper with a proof-of-concept experiment, and its genre matters for how much weight to put on each part. The mathematical core formalizes learning as a directed structural reduction process over hypergraphs, and proves three things: the reduction terminates in finite time, class structural attractors exist and are unique, and attractor maps self-organize1. A structural attractor here is not a trajectory in a continuous dynamical space; it is a stable structural-parametric invariant left behind by the reduction, presented by the authors as the endogenous equivalent of a concept. Learning requires no loss function, no backpropagation, no backward pass: updates are local, single-pass over the data, positive examples only, and claimed to work from extremely small datasets, on the order of 3 to 11 examples per class.

The computational demonstration is deliberately modest: a restricted MNIST subset of digits with clean, unbroken contours. Training used 85 original digits across 10 classes, 3 to 11 per class, augmented to 869 instances, organized into 13 concepts with 3 additional empirically formed subclasses for the digits 1, 2 and 4. Of 8,707 test images drawn at random, 8,685 (99.75 percent) produced a valid skeleton graph; on that valid set the classifier reached 91.13 percent accuracy, 91.92 percent weighted precision and 91.34 percent F1. The comparison table the authors assemble is explicitly labeled contextual rather than a controlled benchmark: against reduced-MNIST few-shot results such as 69 to 75 percent for a tuned SVM, 53 to 61 percent for an MLP, and 84.38 percent for a CNN trained with backpropagation on 5 examples per class, the claim is competitiveness under an extreme data constraint with no optimization at all. The neurobiological half of the paper proposes that the physical substrate of a structural attractor could be the dendritic tree of a pyramidal neuron, with synapses and spines as vertices and functional relationships as hyperedges, shaped by an operator of structural-parametric adaptation applied to the entire history of the system.

How it works

The pipeline has three stages. First, a stimulus is reduced to atomic structural primitives: for MNIST, skeletonized contours are decomposed into line segments carrying 13 measured features each, coordinates, angles, direction, connectivity, with diagnostic weights derived from each feature's range. Second, a structural reduction process iteratively merges and prunes this hypergraph under local rules, keeping only stable, critically important elements the paper calls anchors. Third, classification is a winner-take-all competition in which the input's reduced structure is matched against stored concept attractors, and the winner is returned together with a local explanation artifact: the winning concept's identifier, likelihood value, and complexity values, so the decision and its failure modes are inspectable by construction.

Two features of the mechanism carry the biological argument. One is the declared list of neuromorphic properties the model is designed to satisfy: memory and computation co-located at the synapse, adaptivity from locally accessible signals only, massive parallelism, and robustness through redundancy rather than precise arithmetic. The other is the neurobiological reinterpretation, where the key move is to abandon the idea that the brain stores a template and matches inputs against it. Instead, the dendritic tree is proposed as a material hypergraph, its own structure the internal model of the world, with perception acting as a projection of the stimulus onto that pre-existing structure. This is a genuinely different account of what a memory could be: not a stored pattern, but a physically sculpted geometry that new input is interpreted through.

Where a skeptic should push

The single most load-bearing assumption is that structural reduction over hand-extracted primitives captures anything general about learning, and here the paper's own discussion section is the best skeptic. The authors enumerate the real weaknesses: the graph edit distance underlying attractor competition is non-monotonic with respect to structural specificity; the choice of measured parameter types and their ranges is empirical; preprocessing discards much of the detected structure; the parametric space is impoverished by the reduction itself; and the constrained matching problem, while made polynomial-time by anchor pre-labeling and low treewidth, inherits the NP-hardness of hypergraph matching for anything richer than clean contours. Most strikingly, they state in plain terms that hypergraph matching is not biologically plausible: a dendritic tree has no global map of a stimulus and no mechanism for sequential template comparison, which is why they are forced to propose reformulating the problem itself rather than defending the implementation.

On the empirical side, the proof of concept is one dataset, MNIST, on a subset filtered for clean unbroken contours, with engineered primitives, an empirically augmented training set, and per-class recalls that vary widely, 77.6 percent for class 2 and 84.0 percent for class 4, with dominant confusions (2 misread as 7 in 51.6 percent of class-2 errors) that trace directly to skeleton topology. The 91.13 percent figure should also not be compared with modern MNIST scores: the authors themselves say they did not aim for 99.9 percent, and the honest comparator is the few-shot table, where the result is competitive but the entries come from different protocols and pipelines. The 44 unassigned test images, 0.5 percent of the valid set, are a small but real abstention behavior most classifiers do not exhibit. Accept the mathematics as internally consistent, and the neurobiology as clearly flagged hypothesis, which the authors do with more discipline than most papers in this space.

Learning as structure formation in living tissue

The non-obvious implication for organoid intelligence is that this theory gives the field's least controllable property a possible computational role. Biological tissue does not only modulate synaptic weights; it grows, prunes, and remodels, and developmental synaptic pruning in particular is a large-scale structural reduction process of exactly the kind this paper formalizes. If any part of learning in vivo is structural rather than parametric, then organoid cultures are not blank slates waiting for a plasticity rule; they are already running sculpting algorithms, and the open question becomes whether the attractors they converge to can be steered. The paper reframes what programming a living computer would even mean: perhaps less like training a network and more like curating a developmental history, since in the model the structure encodes the entire history that formed it, H of t equals adaptation applied to the full history of stimuli.

The opportunity is a new handle on few-shot operation, which is where biological computing most plausibly wins. A substrate that forms stable invariant representations from a handful of positive examples in a single pass, without an external optimizer, matches the constraints of working with living tissue far better than gradient descent does: no backpropagation hardware, no global error delivery, no million-example training corpus, just experience landing on structure. The local explainability property is also more interesting for wetware than it first appears: if a concept is a physical structure, then interrogating it means mapping anatomy or connectivity, operations electrodes and imaging can actually perform, rather than probing billions of opaque weights.

The threats are equally sharp. First, if computation in tissue is structural, then the training signal is development itself, and organoid development is precisely the part nobody controls: batch-to-batch morphogenesis would write different attractors into every culture, a reproducibility nightmare that makes weight-level variability look trivial. Second, the paper's own honesty is the warning: even a theory this committed to biological plausibility cannot make its core matching operation biological, and if dendritic trees cannot do template matching, the leap from structural attractors in mathematics to concepts in cortex remains wide. Third, the hype risk: 91.13 percent on a filtered MNIST subset with hand-designed primitives is a proof of mathematical consistency, not evidence that organoids learn this way. The right posture is to treat the paper as a challenge experiment for the field, can induced structural remodeling in a culture be shown to create stable, inspectable invariants that classify new input, because that is the claim stripped to its testable core.

The bottom line

Established: the structural reduction process is mathematically consistent, with finite convergence, existence and uniqueness of class attractors, and self-organizing attractor maps proved within the paper's formalism; and the mechanism is computationally feasible on a restricted task, reaching 91.13 percent accuracy on 8,685 valid clean-contour MNIST test images after a single pass over 85 training digits. Open: everything that would make this a learning theory for real systems, including a biologically plausible replacement for hypergraph matching, which the authors concede does not exist yet, richer primitives and parametric spaces, scaling beyond contour-clean MNIST to scripts and scenes, and any experimental evidence from neural tissue. What would confirm the framework: a demonstration that activity-dependent structural remodeling in neurons or organoids produces stable invariants that support recognition, with errors interpretable through the model's anchor machinery. What would break it: evidence that concept formation in biological systems is exclusively parametric, with structure statistically independent of what an animal has learned. For organoid computing, the durable idea is worth holding regardless: memory may be geometry, and training may be sculpture.

Frequently asked questions

What is a structural attractor?

A stable structural-parametric invariant produced by a directed reduction process over a hypergraph. Unlike a classical dynamical-systems attractor, which is defined by trajectories in a continuous space, it is a surviving pattern of structure and parameters, proposed as the endogenous equivalent of a concept.

What does the model prove?

Within its formalism, the paper proves that the structural reduction process terminates in finite time, that class structural attractors exist and are unique, and that attractor maps self-organize. These are consistency results for the mathematical apparatus, not empirical laws of biology.

How well does it perform on MNIST?

On a subset of test digits with clean, unbroken contours (8,685 of 8,707 randomly drawn images, 99.75 percent), accuracy is 91.13 percent, weighted precision 91.92 percent, and F1 91.34 percent, after training on 85 original digits, 3 to 11 per class, in a single pass. Per-class recall varies from 77.6 percent (digit 2) to 96.5 percent (digit 1), and 0.5 percent of valid images were assigned to no concept.

Is there any backpropagation or loss function?

No. Learning is a monotonic dissipative reduction governed by local rules, using positive examples only, in one epoch, with no hyperparameter tuning and no global error signal. The authors contrast this with few-shot baselines that require meta-learning or pre-training on task distributions.

Do the authors claim this is how the brain works?

No, and this is a strength. The neurobiological mechanisms, including implementation in dendritic trees and coding as projection onto internal attractor dynamics, are presented explicitly as testable hypotheses rather than established facts. The authors also state plainly that hypergraph matching, the core of their classifier, is not biologically plausible in its current form.

What would this mean for organoid computing if it were right?

It would recast training as steering structural remodeling rather than optimizing weights: developmental and activity-dependent pruning in living tissue would be part of the computation, few-shot single-pass learning would be native, and inspecting a memory would mean mapping physical structure. It would also make reproducibility harder, since uncontrolled morphogenesis would write different attractors into every culture.

References

  1. Y. Parzhyn, A. Schwarzmann, M. Lapin, K. Bokhan. Formation of structural attractors in neuromorphic systems. arXiv (cs.AI). 2026. https://arxiv.org/abs/2609.06826. Accessed 2026-10-11.