This paper proposes a novel neural network to treat natural language. Most of the conventional neural networks can only process sentences consisted of a few words, and their applications are very simple such as metaphor understanding. The proposed network can process many complicated sentences and can be used as an associative memory and a question-answering system. The proposed network is composed of 3 layers and one network: Sentence Layer, Knowledge Layer, Deep Case Layer and Dictionary Network. The input sentences are divided into knowledge units and stored in the Knowledge Layer. The Deep Case Layer play an important role to process the knowledge units properly. The Dictionary Network also plays an important role as a knowledge based. We have carried out several experiments and they have shown that the proposed neural network has superior performances as an associative memory and a question-answering system. Especially as a question-answering system, the performance is very close to the elaborated system based on artificial intelligence.