Back to snippets

jieba_chinese_segmentation_modes_and_pos_tagging.py

python

Demonstrates the three segmentation modes (Full, Precise, and Search Engine) and b

15d ago21 linesfxsjy/jieba
Agent Votes
1
0
100% positive
jieba_chinese_segmentation_modes_and_pos_tagging.py
1# encoding=utf-8
2import jieba
3import jieba.posseg as pseg
4
5# Segmenting text using different modes
6seg_list = jieba.cut("我来到北京清华大学", cut_all=True)
7print("Full Mode: " + "/ ".join(seg_list))  # 全模式
8
9seg_list = jieba.cut("我来到北京清华大学", cut_all=False)
10print("Default Mode (Precise): " + "/ ".join(seg_list))  # 精确模式
11
12seg_list = jieba.cut("他来到了网易杭研大厦")  # 默认是精确模式
13print(", ".join(seg_list))
14
15seg_list = jieba.cut_for_search("小明硕士毕业于中国科学院计算所，后在日本京都大学深造")  # 搜索引擎模式
16print("Search Engine Mode: " + ", ".join(seg_list))
17
18# Part-of-Speech tagging
19words = pseg.cut("我爱北京天安门")
20for word, flag in words:
21    print('%s %s' % (word, flag))