Natural language processing (8) Zhao hai赵海 Department of Computer Science and Engineering Shang hai Jiao Tong University 2010-2011 zhaohaidcs. situ. edu. cn
1 Natural Language Processing (8) Zhao Hai 赵海 Department of Computer Science and Engineering Shanghai Jiao Tong University 2010-2011 zhaohai@cs.sjtu.edu.cn
Overview Models HMM: Hidden markov model maximum entropy markov model CRES: Conditional random fields Tasks Chinese word segmentation part-of-speech tagging named entity recognition
2 Overview • Models – HMM: Hidden Markov Model – maximum entropy Markov model – CRFs: Conditional Random Fields • Tasks – Chinese word segmentation – part-of-speech tagging – named entity recognition
What is an hmm? Graphical model Circles indicate states Arrows indicate probabilistic dependencies between states
3 What is an HMM? • Graphical Model • Circles indicate states • Arrows indicate probabilistic dependencies between states
What is an hmm? Green circles are hidden states Dependent only on the previous state The past is independent of the future given the present
4 What is an HMM? • Green circles are hidden states • Dependent only on the previous state • “The past is independent of the future given the present
What is an hmm? Purple nodes are observed states Dependent only on their corresponding hidden state
5 What is an HMM? • Purple nodes are observed states • Dependent only on their corresponding hidden state