最近就在磨这个脚本以达到SEO同事要求哈。
awk -v b=[21/Apr/2015:15:46 -v a=[21/Apr/2015:16:46 '$4 > b && $4 < a' log_path|awk '$7!~/png|gif|jpg|jpeg|css|\.js|\.ico/ {print $1}'| sort | uniq -c | sort -n|tail -100
183.38.3.209
139.227.228.217
219.130.218.69
123.150.243.9
113.12.14.182
123.160.206.203
203.208.60.108
112.124.127.53
115.28.203.70
124.207.19.18
218.17.157.50
14.118.132.30
114.83.101.234
125.42.67.72
220.249.91.34
221.223.135.254
202.109.164.190
218.241.145.38
14.118.132.23
111.206.165.43
49.4.167.177
113.104.27.200
218.58.79.155
61.50.123.22
207.46.13.110
113.88.245.130
120.52.71.98
220.248.17.218
61.148.221.114
140.206.72.2
221.224.90.35
114.249.85.224
112.80.208.91
180.107.57.222
61.131.28.85
113.97.142.20
210.29.192.202
222.180.251.90
121.41.122.220
222.209.124.67
222.222.33.106
113.90.202.190
211.157.159.11
116.226.227.20
116.22.230.218
220.160.150.57
116.231.72.8
180.175.170.152
106.123.222.219
218.1.23.34
115.218.26.254
101.81.18.81
218.107.198.190
27.17.32.194
110.80.33.204
112.254.75.220
218.62.90.77
219.142.243.141
110.249.166.98
112.65.181.166
61.149.254.42
61.191.29.226
115.195.158.205
121.12.109.3
112.65.159.2
119.78.130.142
58.246.226.250
218.17.125.194
122.138.250.238
223.203.209.4
115.238.244.247
58.250.164.227
203.208.60.111
114.235.1.19
113.12.138.166
123.138.184.168
14.222.86.194
116.211.121.131
119.188.35.11
61.240.149.130
203.208.60.122
118.122.114.210
121.199.27.53
183.133.35.218
203.208.60.125
60.173.202.33
175.102.134.139
111.198.19.242
14.153.193.211
218.201.70.37
58.100.191.162
121.11.71.26
121.11.70.219
121.11.70.221
203.195.184.135
203.208.60.119