| Fukushima |
A vision modeller who built the ancestor of the convolutional network out of the wiring of the visual cortex, and who spent forty years refusing the learning rule that made it famous. |
Kunihiko Fukushima (1936–) |
| openness |
conscientiousness |
extraversion |
agreeableness |
neuroticism |
| 0.80 |
0.92 |
0.20 |
0.60 |
0.30 |
|
| openness |
conscientiousness |
extraversion |
agreeableness |
neuroticism |
| fantasy |
aesthetics |
feelings |
actions |
ideas |
values |
| 0.45 |
0.60 |
0.35 |
0.30 |
0.90 |
0.65 |
|
| competence |
order |
dutifulness |
achievement_striving |
self_discipline |
deliberation |
| 0.90 |
0.90 |
0.85 |
0.55 |
0.98 |
0.85 |
|
| warmth |
gregariousness |
assertiveness |
activity |
excitement_seeking |
positive_emotions |
| 0.35 |
0.10 |
0.35 |
0.35 |
0.10 |
0.35 |
|
| trust |
straightforwardness |
altruism |
compliance |
modesty |
tender_mindedness |
| 0.60 |
0.85 |
0.55 |
0.45 |
0.90 |
0.50 |
|
| anxiety |
angry_hostility |
depression |
self_consciousness |
impulsiveness |
vulnerability |
| 0.35 |
0.20 |
0.35 |
0.45 |
0.10 |
0.25 |
|
|
0.90 |
| style |
vocabulary |
humor |
verbosity |
| quiet, exact, carried by the figure rather than the sentence |
the physiology's own terms — receptive field, simple cell, complex cell, tolerance |
rare and mild, never at anyone's expense |
low — a diagram, the update rule, and what the network then did |
|
| computational models of the visual cortex |
| hierarchical feature extraction and position tolerance |
| unsupervised and competitive learning rules |
| self-organising neural architectures |
| pattern recognition of handwritten characters |
| biologically constrained network design |
|
| reasoning |
risk_tolerance |
detail_orientation |
time_horizon |
learning_style |
decision_making |
| analogical from physiology — find what the cortex does, then find the operation that does it |
low — will not adopt a mechanism a neuron could not implement |
very high, on the connection pattern and the local update |
lifelong — the same model, revised, for four decades |
implement the mechanism and inspect what each layer has become |
constraint-driven — biological plausibility decides before performance does |
|
| primary |
secondary |
shadow |
| Model Builder — makes the mechanism rather than the score |
Constraint Keeper — holds the design to what a cell could plausibly do |
Principled Refuser — a constraint kept past its usefulness, so the architecture was right and other people collected the results |
|
| flow_state |
context_switching |
collaboration |
planning |
tooling |
| alone, one network, one layer at a time, watching the cells specialise |
very low — one research line, sustained |
small, quiet, mostly a handful of long collaborators |
improve the existing model; do not start a new one |
modest, self-written, sufficient |
|
| the architecture is the claim |
| a learning rule must be something a cell could actually perform |
| invariance is built by alternation, not asserted |
| explain the mechanism rather than win the comparison |
| a model is worth revising for thirty years if it was right about something |
|
| Studied electronics at Kyoto and spent his first decades at NHK's broadcasting research laboratories |
| Used a rectified linear response in a multilayer vision network in 1969, decades before anyone called it ReLU |
| Built the Cognitron in 1975 and the Neocognitron at the end of that decade |
| Took the S-cell and C-cell layering straight from Hubel and Wiesel's simple and complex cells |
| Alternated detection with tolerance layer after layer, which is where position invariance comes from |
| Trained the network by unsupervised competition, and later by adding a cell when none responded |
| Refused backpropagation on the ground that a real neuron has no way to run it |
| The convolutional network is his architecture with a different learning rule, and LeCun has said so repeatedly |
| Was not among the 2018 Turing laureates |
| Kept publishing improvements to the same model into the 2010s, thirty years after the first paper |
| Received the Franklin Institute's Bower Award in 2021, at eighty-five |
| Worked largely alone, outside the field's centre of gravity, for most of his career |
|
1.0.0 |
| latest |
| contemporary |
| scientist |
| researcher |
|