A new large-scale virtual model of the visual cortex is highly successful in solving visual tasks

A new large-scale virtual model of the visual cortex is highly successful in solving visual tasks
Illustration of the readout convention and the five visual processing tasks for which the V1 model was trained. (A) The visual stimuli for all five tasks were presented to the LGN model. Separate competing pools of pyramidal cells on L5 were chosen as readout neurons for each task. (B to E) Schematic diagrams and timings of five visual tasks (Materials and Methods). (B) In the fine orientation discrimination task, the network received a drifting grating with an orientation very close to 45°, and neurons in the corresponding readout pool had to fire if the orientation was larger than 45∘. (C) For the image classification task, the network received a handwritten sample of a digit from 0 to 9 from MNIST dataset, and the corresponding one of the 10 readout pools for this task had to fire stronger than the others (two samples for digits 7 and 6 are shown). (D) For the visual change detection task, a long sequence of images was presented, with gray screens in between. A corresponding readout pool had to become active during the response window if the most recent image differed from the preceding one. Both natural images and static gratings were used. (E) In the evidence accumulation task, seven cues were presented sequentially, and after a delay, a corresponding readout pool had to indicate through stronger firing whether most cues had been presented on the left or the right. Credit: Science Advances (2022). DOI: 10.1126/sciadv.abq7592

Human Brain Project researchers have trained a large-scale model of the primary visual cortex of the mouse to solve visual tasks in a highly robust way. The model provides the basis for a new generation of neural network models. Due to their versatility and energy-efficient processing, these models can contribute to advances in neuromorphic computing.

Modeling the brain can have a massive impact on (AI): Since the brain processes images in a much more energy-efficient way than artificial networks, scientists take inspiration from neuroscience to create neural networks that function similarly to the biological ones to significantly save energy.

In that sense, brain-inspired neural networks are likely to have an impact on future technology, by serving as blueprints for in more energy-efficient neuromorphic hardware. Now, a study by Human Brain Project (HBP) researchers from the Graz University of Technology (Austria) showed how a large data-based model can reproduce a number of the brain's visual processing capabilities in a versatile and accurate way. The results were published in the journal Science Advances.

With the help of the PCP Pilot Systems at the Jülich Supercomputing Center, developed in a collaboration between the HBP and the software company Nvidia, the team analyzed a biologically detailed large-scale model of the mouse that can solve multiple visual processing tasks. This model provides the largest integration of anatomical detail and neurophysiological data currently available for the visual cortex area V1, which is the first cortical region to receive and process .

The model is built with a different architecture than those of used in current AI, and the researchers found out that it has interesting advantages regarding learning speed and visual processing performance over models that are commonly used for visual processing in AI.

The model was able to solve all five presented by the team with high accuracy. For instance, these tasks involved classifying images of hand-written numbers or detecting visual changes in a long sequence of images. Strikingly, the virtual model achieved the same as the brain even when the researchers subjected the model to noise in the images and in the network that it had not encountered during training.

One reason for the superior robustness of the model—or its ability to cope with errors or unexpected input, such as the noise in the images—is that it reproduces several characteristic coding properties of the brain.

Having developed a unique tool for studying brain-style visual processing and neural coding, the authors describe their new model as providing an "unprecedented window into the dynamics of this brain area."

More information: Guozhang Chen et al, A data-based large-scale model for primary visual cortex enables brain-like robust and versatile visual processing, Science Advances (2022). DOI: 10.1126/sciadv.abq7592

Journal information: Science Advances

Provided by Human Brain Project
Citation: A new large-scale virtual model of the visual cortex is highly successful in solving visual tasks (2022, November 2) retrieved 1 February 2023 from https://techxplore.com/news/2022-11-large-scale-virtual-visual-cortex-highly.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Model describes complete grasping movement planning in the brain


Feedback to editors