#feedforward
Heh yeah, can't really have integrated information in an architecture with lots of feedforward layers and very little (if any?) causal integration
November 7, 2026 at 2:54 PM
A1 #lthechat peer-led facilitation, multiple activities, anything that doesn't involve being just talked at. Room for feedback and feedforward. Options to take part remotely/later.
November 4, 2026 at 8:08 PM
Professor Miller, off topic, but I read your perspective "categorization is baked into the brain", and I was wondering if you're thinking on brain conceptual/semantic primitives in the brain to guide the categorization by newborns, since, you propose feedback signal to appear before feedforward.
November 9, 2026 at 3:51 PM
i am not sure that it is presently a known architecture? i think both the normalization and the MLP are unique to this thing. i am the "inventor" of a stick-breaking variant of PEER. it verifiably sucks, but it has the property i need and a regular MLP does not.

arxiv.org/abs/2407.04153
Mixture of A Million Experts
The feedforward (FFW) layers in standard transformer architectures incur a linear increase in computational costs and activation memory as the hidden layer width grows. Sparse mixture-of-experts (MoE)...
arxiv.org
November 9, 2026 at 5:32 AM
9/ From prior work, we know that training under a topographic macrocircuit implicitly reduces feedforward wiring length but at a cost to task performance in CNNs. We show that transformers (1) reduce both feedforward and lateral wiring length, (2) while avoiding the wiring cost–performance tradeoff.
November 4, 2026 at 3:03 PM
Transient feedforward communication between somatosensory and premotor cortex supports goal-directed #behavior @PLOSBiology.org
Transient feedforward communication between somatosensory and premotor cortex supports goal-directed #behavior
by Yadollah Ranjbar-Slamloo, Tsukasa Kamigaki Goal-directed behavior requires sensory information to be transformed into motor commands, yet the precise temporal structure of communication between sensory and motor cortices during this process remains poorly understood. By simultaneously recording spiking activity from primary somatosensory cortex (S1) and secondary motor cortex (M2) in mice performing a tactile delayed go/no-go task, we identified a brief, stimulus-triggered communication window that predicted behavioral success. Time-shifted canonical correlation analysis revealed a sharp, feedforward surge in S1 → M2 coupling peaking at a short latency, as expected for a potentially direct transmission pathway. This transient interaction conveyed stimulus-selective information such that the S1 → M2 communication subspace aligned with stimulus-coding axes in both regions. In contrast, M2 → S1 feedback interactions were weaker and delayed. Brief optogenetic suppression of S1 reduced both M2 stimulus selectivity and behavioral discriminability, consistent with a functional role of the transient S1 → M2 coupling. These findings demonstrate that sensorimotor transformation is supported not by sustained linear coupling along the stimulus- or choice- axis, but by a short-lived and highly selective feedforward communication channel that rapidly transmits reliable sensory representations into motor-planning circuits.
dlvr.it
November 6, 2026 at 6:10 AM
Happy to have given a talk at the Janelia Data-Driven AI for Neuroscience conference on our work using data-driven approaches to identify informative perturbations that reveal the cortex’s operating regime during context-dependent processing.
www.biorxiv.org/content/10.6...
Characteristics and dynamical signatures of recurrent cortical circuits during context-dependent processing
Context profoundly shapes neural responses and behavior. During context-dependent sensory processing, recurrent connections shape the integration of feedforward sensory input and feed-back input from ...
www.biorxiv.org
November 3, 2026 at 1:36 AM
Direct cortical feedforward and feedback pathways differentially shape visual responses and selectively engage looped circuits https://www.biorxiv.org/content/10.64898/2026.10.27.762146v1
October 30, 2026 at 10:16 PM
This finds that looping only the middle layers rather than the entire model improves reasoning performance, with the Huginn-style architecture outperforming Ouro on 8 out of 10 benchmarks.

It outperforms a 32B feedforward MoE while using 75% fewer stored params.

alphaxiv.org/abs/2610.23036
October 31, 2026 at 7:55 AM
Transient feedforward communication between somatosensory and premotor cortex supports goal-directed #behavior @PLOSBiology.org
Transient feedforward communication between somatosensory and premotor cortex supports goal-directed #behavior
by Yadollah Ranjbar-Slamloo, Tsukasa Kamigaki Goal-directed behavior requires sensory information to be transformed into motor commands, yet the precise temporal structure of communication between sensory and motor cortices during this process remains poorly understood. By simultaneously recording spiking activity from primary somatosensory cortex (S1) and secondary motor cortex (M2) in mice performing a tactile delayed go/no-go task, we identified a brief, stimulus-triggered communication window that predicted behavioral success. Time-shifted canonical correlation analysis revealed a sharp, feedforward surge in S1 → M2 coupling peaking at a short latency, as expected for a potentially direct transmission pathway. This transient interaction conveyed stimulus-selective information such that the S1 → M2 communication subspace aligned with stimulus-coding axes in both regions. In contrast, M2 → S1 feedback interactions were weaker and delayed. Brief optogenetic suppression of S1 reduced both M2 stimulus selectivity and behavioral discriminability, consistent with a functional role of the transient S1 → M2 coupling. These findings demonstrate that sensorimotor transformation is supported not by sustained linear coupling along the stimulus- or choice- axis, but by a short-lived and highly selective feedforward communication channel that rapidly transmits reliable sensory representations into motor-planning circuits.
dlvr.it
November 4, 2026 at 12:09 AM
TR26-311 | New Gate, Weight and Wire Complexity Bounds for Sigmoid Neural Networks | Jiatu Li, Daniel Reichman, Ryan Williams, Tony Wu
Feedforward neural networks with sigmoid activations are of fundamental importance in neural computation. However, our understanding of the circuit complexity of such networks for implementing Boolean functions remains limited. The analog output of the sigmoid, along with its transcendental nature, leads to unique mathematical challenges for proving lower bounds. Introducing new techniques, we establish new upper and lower bounds on the complexity of sigmoidal networks computing Boolean functions: \begin{itemize} \item We prove nearly tight bounds for the wire complexity of computing PARITY with such networks of constant depth and polynomial-bounded weights. \item We extend the size lower bound of Kane and Williams [STOC'16] against depth-$3$ threshold circuits, to depth-3 sigmoidal networks with polynomial weights, proving a $\Omega(n^{1.5}/ (\log n)^{O(1)})$ size lower bound for computing an explicit function in P. \item We prove that every symmetric function on $n$ bits can be computed by a depth-$3$ sigmoidal network with $O(n)$ wires and polynomial weights. This stands in stark contrast with threshold circuits of $d=O(1)$ depth, where $n^{1+\alpha_d}$-wire lower bounds are known for $\alpha_d > 0$. \end{itemize} We also answer a few fundamental problems related to sigmoidal networks, including proving new simulations and separations between threshold circuits and sigmoidal networks. We establish these results using a variety of techniques, including random restrictions for sigmoid gates, analyzing the average sensitivity of networks with sigmoids, simulation arguments, and using tools from approximation theory, complex analysis, and algebraic geometry.
eccc.weizmann.ac.il
November 7, 2026 at 1:37 AM
Transient feedforward communication between somatosensory and premotor cortex supports goal-directed #behavior @PLOSBiology.org
Transient feedforward communication between somatosensory and premotor cortex supports goal-directed #behavior
by Yadollah Ranjbar-Slamloo, Tsukasa Kamigaki Goal-directed behavior requires sensory information to be transformed into motor commands, yet the precise temporal structure of communication between sensory and motor cortices during this process remains poorly understood. By simultaneously recording spiking activity from primary somatosensory cortex (S1) and secondary motor cortex (M2) in mice performing a tactile delayed go/no-go task, we identified a brief, stimulus-triggered communication window that predicted behavioral success. Time-shifted canonical correlation analysis revealed a sharp, feedforward surge in S1 → M2 coupling peaking at a short latency, as expected for a potentially direct transmission pathway. This transient interaction conveyed stimulus-selective information such that the S1 → M2 communication subspace aligned with stimulus-coding axes in both regions. In contrast, M2 → S1 feedback interactions were weaker and delayed. Brief optogenetic suppression of S1 reduced both M2 stimulus selectivity and behavioral discriminability, consistent with a functional role of the transient S1 → M2 coupling. These findings demonstrate that sensorimotor transformation is supported not by sustained linear coupling along the stimulus- or choice- axis, but by a short-lived and highly selective feedforward communication channel that rapidly transmits reliable sensory representations into motor-planning circuits.
dlvr.it
November 2, 2026 at 4:08 PM
Please feel free to (not) listen at your discretion, rummage round in my SoundCloud as pleases you, and gift me any and all feedback and feedforward that may pop up in your mind.
November 2, 2026 at 4:28 AM
It might be a combination of multiple things, including feedforward vs feedbackwards differences.

I just don't know enough math to properly figure it out, or figure out proper test cases for the LFSRs to ensure generation is correct.
November 2, 2026 at 10:42 AM
New in Physiology! We propose CHAOS: a hierarchical autonomic organizing system integrating central command with cardiovascular feedback during exercise.

Led by Marcela Araújo, with Masaki Mizuno and Bruno Silva. Congrats, team!

doi.org/10.1152/phys...
Central Command During Exercise: Hierarchical Integration of Feedforward and Feedback Cardiovascular Control | Physiology | American Physiological Society
Cardiovascular regulation during exercise has traditionally been explained by the interaction between central command, a feedforward neural mechanism originating in higher brain centers, and peripheral cardiovascular reflexes, particularly the exercise pressor reflex and arterial baroreflex. Although central command is widely recognized as initiating autonomic adjustments in proportion to perceived effort, accumulating evidence indicates that its role extends well beyond the generation of parallel autonomic drive. In this review, we synthesize experimental findings spanning spinal and brainstem neurophysiology to integrative studies in intact animals and humans, showing that descending signals associated with central command may access the neural circuitry involved in processing peripheral cardiovascular information and regulating autonomic output. Neurophysiological studies identify multiple sites of interaction, including inhibitory gating of group III/IV muscle afferent transmission within the spinal dorsal horn and modulation of barosensory processing within the nucleus of the solitary tract. At the integrative level, studies of the arterial baroreflex, exercise pressor reflex, and trigeminally mediated diving reflex further demonstrate that central command can selectively regulate reflex expression and modify interactions among competing autonomic inputs rather than summating with them. Together, these observations support a conceptual evolution of central command from a feedforward initiator to a hierarchical autonomic organizing system (CHAOS) that dynamically integrates central command with peripheral cardiovascular feedback according to behavioral context. This CHAOS framework provides a unifying physiological interpretation for findings traditionally considered within individual reflex systems and offers a broader perspective on cardiovascular regulation during exercise and other conditions imposing competing autonomic demands.
doi.org
November 2, 2026 at 3:14 PM
How is sensory information transmitted to influence motor commands during goal-directed #behavior? This study reveals that brief, selective, feedforward coupling transmits sensory representations into motor-planning circuits.
🧪 #NeuroSky #sensorimotor
plos.io/3WU8EGk
November 1, 2026 at 5:10 PM
Mid-circuit measurements with feedforward reduce quantum circuit depth for unitary synthesis from linear to constant, using unrestricted ancillary qubits and measurement-based feedback control.

#QuantumCircuits #QuantumAlgorithms #Research
Exact Constant-Depth Unitary Synthesis via Mid-Circuit Measurement and Feedforward
iq.fp2.dev
October 31, 2026 at 1:49 PM
Mid-circuit measurements with feedforward reduce quantum circuit depth for unitary synthesis from linear to constant, using unrestricted ancillary qubits and measurement-based feedback control.

#QuantumCircuits #QuantumAlgorithms #Research
Exact Constant-Depth Unitary Synthesis via Mid-Circuit Measurement and Feedforward
iq.fp2.dev
October 31, 2026 at 1:49 PM
Mid-Circuit-Messungen mit Feedforward reduzieren die Tiefe von Quantenschaltungen für unitäre Synthese von linear zu konstant und nutzen dabei unbeschränkte Ancilla-Qubits sowie messungsgesteuerte Rückkopplung.

#Quantenschaltungen #Quantenalgorithmen #Forschung
Exakte Synthese konstanter unitärer Tiefe via Mid-Circuit-Messung und Feedforward
iq.fp2.dev
October 31, 2026 at 1:50 PM
??? #Dublin ???

... #Toronto ????

October 30, 1987 #feedforward

share.google/aimode/71PxG... /\
October 31, 2026 at 12:49 AM
Boo.
October 31, 2026 at 8:50 PM
How is sensory information transmitted to influence motor commands during goal-directed #behavior? This study reveals that brief, selective, feedforward coupling transmits sensory representations into motor-planning circuits.
🧪 #NeuroSky #sensorimotor
plos.io/3WU8EGk
October 31, 2026 at 1:10 PM
Magna simuliert Magic-State-Fabriken mit Nicht-Clifford-Inhalten zu Clifford-Schaltkreis-Kosten. Skaliert auf 100 Ausgabezustände, erreicht Mikrosekunden-Abtastung und verarbeitet decoderabhängiges Feedforward – ermöglicht effiziente Designoptimierung für fehlertolerante Quant...
Magna: Simulation von Magic-State-Fabriken so kostengünstig wie Clifford-Schaltkreise
arxiv.org
November 1, 2026 at 3:07 AM
Magna simulates magic state factories with non-Clifford content at Clifford-circuit costs. Scales to 100 output states, achieves microsecond sampling, and handles decoder-dependent feedforward—enabling efficient design optimization for fault-tolerant quantum architectures.
Magna: Simulating Magic State Factories as Cheaply as Clifford Circuits
iq.fp2.dev
November 1, 2026 at 3:09 AM