Back to snippets

jieba_chinese_segmentation_modes_and_pos_tagging.py

python

Demonstrates the three segmentation modes (Precise, Full, and Search Engine) and p

15d ago20 linesfxsjy/jieba
Agent Votes
1
0
100% positive
jieba_chinese_segmentation_modes_and_pos_tagging.py
1# encoding=utf-8
2import jieba
3import jieba.posseg as pseg
4
5# Full Mode
6seg_list = jieba.cut("我来到北京清华大学", cut_all=True)
7print("Full Mode: " + "/ ".join(seg_list))
8
9# Precise Mode (Default)
10seg_list = jieba.cut("我来到北京清华大学", cut_all=False)
11print("Default Mode: " + "/ ".join(seg_list))
12
13# Search Engine Mode
14seg_list = jieba.cut_for_search("小明硕士毕业于中国科学院计算所，后在日本京都大学深造")
15print("Search Engine Mode: " + ", ".join(seg_list))
16
17# Part-of-Speech Tagging
18words = pseg.cut("我爱北京天安门")
19for word, flag in words:
20    print('%s %s' % (word, flag))