本文实例讲述了Python实现的txt文件去重功能。分享给大家供大家参考,具体如下:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
|
# -*- coding:utf-8 -*-
#! python2
import shutil
a = 0
readDir = "/Users/Administrator/Desktop/old.txt" #old
writeDir = "/Users/Administrator/Desktop/new.txt" #new
# txtDir = "/home/Administrator/Desktop/1"
lines_seen = set ()
outfile = open (writeDir, "w" )
f = open (readDir, "r" )
for line in f:
if line not in lines_seen:
a + = 1
outfile.write(line)
lines_seen.add(line)
print (a)
print ( '\n' )
outfile.close()
print ( "success" )
|
其中old.tx如下:
www.zzvips.com
www.baidu.com
www.sina.com.cn
www.zzvips.com
www.google.com
www.sohu.com
www.zzvips.com
www.163.com
运行后new.txt内容如下:
www.zzvips.com
www.baidu.com
www.sina.com.cn
www.google.com
www.sohu.com
www.163.com
希望本文所述对大家Python程序设计有所帮助。
原文链接:https://blog.csdn.net/sinat_35360663/article/details/80414699