Probabilistic Chinese Segmentation : A Dictionary Driven Approach to Chinese Word Segmentation Using Text Preprocessors

Abstract

This paper describes a Chinese word segmentation system based on dictionary driven probabilistic segmentation using trained data to calculate probability. The results of this system are compared to results from a Largest First Matching Greedy Chinese Text Segmenter using the same dictionary driven approach.