Brain connectivity meets reservoir computing

PLoS Comput Biol. 2022 Nov 16;18(11):e1010639. doi: 10.1371/journal.pcbi.1010639. eCollection 2022 Nov.

Abstract

The connectivity of Artificial Neural Networks (ANNs) is different from the one observed in Biological Neural Networks (BNNs). Can the wiring of actual brains help improve ANNs architectures? Can we learn from ANNs about what network features support computation in the brain when solving a task? At a meso/macro-scale level of the connectivity, ANNs' architectures are carefully engineered and such those design decisions have crucial importance in many recent performance improvements. On the other hand, BNNs exhibit complex emergent connectivity patterns at all scales. At the individual level, BNNs connectivity results from brain development and plasticity processes, while at the species level, adaptive reconfigurations during evolution also play a major role shaping connectivity. Ubiquitous features of brain connectivity have been identified in recent years, but their role in the brain's ability to perform concrete computations remains poorly understood. Computational neuroscience studies reveal the influence of specific brain connectivity features only on abstract dynamical properties, although the implications of real brain networks topologies on machine learning or cognitive tasks have been barely explored. Here we present a cross-species study with a hybrid approach integrating real brain connectomes and Bio-Echo State Networks, which we use to solve concrete memory tasks, allowing us to probe the potential computational implications of real brain connectivity patterns on task solving. We find results consistent across species and tasks, showing that biologically inspired networks perform as well as classical echo state networks, provided a minimum level of randomness and diversity of connections is allowed. We also present a framework, bio2art, to map and scale up real connectomes that can be integrated into recurrent ANNs. This approach also allows us to show the crucial importance of the diversity of interareal connectivity patterns, stressing the importance of stochastic processes determining neural networks connectivity in general.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Brain*
  • Connectome*
  • Machine Learning
  • Neural Networks, Computer

Grants and funding

FD has been funded by the Deutscher Akademischer Austausch Dienst (DAAD). AG has been funded by the Deutsche Forschungsgemeinschaft (DFG) (HI 1286/7-1). CCH has been funded by the Deutsche Forschungsgemeinschaft (DFG) (SFB 936/A1, Z3; TRR 169/A2; SPP 2041, HI 1286/6-1) and the Human Brain Project (SGA2, SGA3). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.