What Does Modular Neural Network Mean?

A modular neural network is one that is composed of more than one neural network model connected by some intermediary. Modular neural networks can allow for sophisticated use of more basic neural network systems managed and handled in conjunction.

Techopedia Explains Modular Neural Network

Work on modular neural networks dates all the way back to the 1980s and has been explored in several ways. There is the concept of ensemble learning, where a collection of “simple” or “weak” learners can outpace one deep learning model. Important principles in modular neural network development include the “divide and conquer” principal, which breaks large problems down into more viable parts, and diversity promotion, which some experts describe as a biologically-based model where different types of neural networks cooperate, each fulfilling a different role or function.