一、前言
此前了解过OKHTTP的缓存的使用,并对缓存的使用进行了初步的总结https://blog.csdn.net/polo2044/article/details/80650856。缓存主要是为了在没有网络的情况下,或者资源不需要实时去后端进行更新时,可以直接从缓存中获取资源信息。一方面是能够在断网的情况下仍然给用户良好的界面展示,另一个方面是避免频繁的请求网络给后端带来压力。目前网络上介绍的在OKHTTP中实现客户端的缓存机制,都是在自定义的Intercept中设置max-age和max-stale的参数值来完成。
但是在查阅网络上的方法后,依旧存在如下疑问:
1. max-age和max-stale在request和response中都可以进行设置,两种设置的效果是否一样,这个可以参考OkHttp缓存max-age详解补充。
2.在本人公司的URL测试中发现,max-age和max-stale没有起作用。
为了解决这些疑问,因此有必要在实际代码中对这两个参数进行实际的验证和研究。
二、max-age和max-stale参数的意义
max-age:告知缓存多长时间,在没有超过缓存时间的情况下,请求会返回缓存内的数据,在超出max-age的情况下向服务端发起新的请求,请求失败的情况下返回缓存数据(测试中已验证),否则向服务端重新发起请求。
max-stale:指示客户机可以接收超出max-age时间的响应消息,max-stale在请求设置中有效,在响应设置中无效(测试中已验证,且参见博客https://www.jianshu.com/p/db197279f053)。
因此max-age和max-stale在请求中同时使用的情况下,缓存的时间可以为max-age和max-stale的和。
三、测试验证
在测试中需要构造一个OKHTTP,然后在拦截器中定义不同的max-age和max-stale来进行测试,在Activity中定义一个定时器,每隔3s进行一次网络请求。
Activity中的网络请求如下:
@Override public void onClick(View view) { if (view.getId() == R.id.button) { Observable.interval(3, TimeUnit.SECONDS).subscribe( new Action1<Long>() { @Override public void call(Long aLong) { getRecomandComic(); } } ); } }
private void getRecomandComic() { RetrofitResearch.getInstance(this) .getTopRecommendList() .subscribeOn(Schedulers.computation()) .observeOn(AndroidSchedulers.mainThread()) .subscribe(new Action1<ComicBeanNoCountResult>() { @Override public void call(ComicBeanNoCountResult comicBeanNoCountResult) { } },
new Action1<Throwable>() { @Override public void call(Throwable throwable) {
} }); } |
OKHTTP的构造代码如下:
public class OkHttpCallFactory { private static int DEFAULT_TIMEOUT = 30; private static final int CONST_10 = 10; private static final int CONST_1024 = 1024; private static final Logger logger = Logger.getLogger("yansm"); private OkHttpCallFactory() { } private static Call.Factory factory; private static int time =60; public static Call.Factory getOkHttpFactory(Context context) { if (factory == null) { synchronized (OkHttpCallFactory.class) { if (factory == null) { OkHttpClient.Builder builder = new OkHttpClient.Builder(); builder.cache(new Cache(context.getCacheDir(), CONST_10 * CONST_1024 * CONST_1024)); //设置缓存 builder.connectTimeout(DEFAULT_TIMEOUT, TimeUnit.SECONDS); builder.writeTimeout(DEFAULT_TIMEOUT, TimeUnit.SECONDS); builder.readTimeout(DEFAULT_TIMEOUT, TimeUnit.SECONDS); Interceptor interceptor = new NetCacheInterceptor(); builder.addInterceptor(interceptor); builder.addNetworkInterceptor(interceptor); builder.addInterceptor(new LoggingInterceptor()); factory = builder.build(); } } } return factory; } //日志输出的拦截器 private static class LoggingInterceptor implements Interceptor { @Override public Response intercept(Chain chain) throws IOException { long t1 = System.nanoTime(); Request request = chain.request(); logger.info(String.format("Sending request %s on %s%n%s", request.url(), chain.connection(), request.headers())); Response response = chain.proceed(request);
long t2 = System.nanoTime(); logger.info(String.format("Received response for %s in %.1fms%n%s", request.url(), (t2 - t1) / 1e6d, response.headers())); return response;
} } } |
3.1 在拦截器的response中设置max-age = 60和max-stale = 120
public class NetCacheInterceptor implements Interceptor { @Override public Response intercept(Chain chain) throws IOException { Request request = chain.request(); CacheControl cacheControl = new CacheControl.Builder() .maxAge(60, TimeUnit.SECONDS) .maxStale(120, TimeUnit.SECONDS).build(); Response response = chain.proceed(request); return response.newBuilder() .removeHeader("Pragma") .removeHeader("Cache-Control") .header("Cache-Control", cacheControl.toString()) .build(); } } |
测试日志结果如下,每隔三秒发送一次请求:
第一次网络请求 06-22 13:59:51.816 32336-469/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null 06-22 13:59:52.200 32336-469/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 381.9ms Server: Tengine Content-Type: text/json;charset=UTF-8 Content-Length: 1492 Date: Fri, 22 Jun 2018 05:59:51 GMT Expires: Thu, 19 Nov 1981 08:52:00 GMT X-Powered-By: PHP/7.0.1 Set-Cookie: PHPSESSID=pef8qomvm3kjg90bs94ojpugf1; path=/ Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529647191|1529647191;Path=/ Via: cache14.l2eu6-1[103,200-0,M], cache4.l2eu6-1[103,0], cache8.cn785[155,200-0,M], cache7.cn785[159,0] X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 05:59:51 GMT X-Swift-CacheTime: 0 Timing-Allow-Origin: * EagleId: 3d9bde1b15296471912141111e Connection: keep-alive Cache-Control: max-age=60, max-stale=120 第二次网络请求 06-22 13:59:54.733 32336-469/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null 06-22 13:59:54.759 32336-469/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 25.1ms Server: Tengine Content-Type: text/json;charset=UTF-8 Content-Length: 1492 Date: Fri, 22 Jun 2018 05:59:51 GMT Expires: Thu, 19 Nov 1981 08:52:00 GMT X-Powered-By: PHP/7.0.1 Set-Cookie: PHPSESSID=pef8qomvm3kjg90bs94ojpugf1; path=/ Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529647191|1529647191;Path=/ Via: cache14.l2eu6-1[103,200-0,M], cache4.l2eu6-1[103,0], cache8.cn785[155,200-0,M], cache7.cn785[159,0] X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 05:59:51 GMT X-Swift-CacheTime: 0 Timing-Allow-Origin: * EagleId: 3d9bde1b15296471912141111e Connection: keep-alive Cache-Control: max-age=60, max-stale=120 第三次网络请求 06-22 13:59:57.733 32336-469/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null 06-22 13:59:57.749 32336-469/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 14.9ms Server: Tengine Content-Type: text/json;charset=UTF-8 Content-Length: 1492 Date: Fri, 22 Jun 2018 05:59:51 GMT Expires: Thu, 19 Nov 1981 08:52:00 GMT X-Powered-By: PHP/7.0.1 Set-Cookie: PHPSESSID=pef8qomvm3kjg90bs94ojpugf1; path=/ Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529647191|1529647191;Path=/ Via: cache14.l2eu6-1[103,200-0,M], cache4.l2eu6-1[103,0], cache8.cn785[155,200-0,M], cache7.cn785[159,0] X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 05:59:51 GMT X-Swift-CacheTime: 0 Timing-Allow-Origin: * EagleId: 3d9bde1b15296471912141111e Connection: keep-alive Cache-Control: max-age=60, max-stale=120 |
charles抓包结果
测试结果分析:在实验中,对response的max-age和max-stale进行了设置,分别为60秒和120秒,在日志的输出中可以看到这一点。但是通过实际的抓包结果能够看到max-age时效起作用了,max-stale没有起时效,客户端在60s内没有向服务端发送请求,但是在60s后向服务端发送了请求。
3.2 在拦截器的request中设置max-age=120和max-stale=60
再次查看该实验时,发现存在问题,就是Response中也设置了max-age,实验本身也有意义,但是先建议阅读我的另一篇博客OkHttp缓存max-age详解补充
参考代码如下
@Override public Response intercept(Chain chain) throws IOException { Request request = chain.request(); CacheControl cacheControl = new CacheControl.Builder().maxAge(120, TimeUnit.SECONDS) .maxStale(60, TimeUnit.SECONDS).build(); request = request.newBuilder() .cacheControl(cacheControl) .build(); return chain.proceed(request); } |
测试日志结果如下:
第一次网络请求 06-22 13:33:28.131 29674-30389/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null Cache-Control: max-age=120, max-stale=60 06-22 13:33:28.700 29674-30389/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 567.5ms Server: Tengine Content-Type: text/json;charset=UTF-8 Content-Length: 1492 Date: Fri, 22 Jun 2018 05:33:27 GMT Expires: Thu, 19 Nov 1981 08:52:00 GMT X-Powered-By: PHP/7.0.1 Set-Cookie: PHPSESSID=t6j4tnss1nkpbm0tddqdr0o2j1; path=/ Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529645607|1529645607;Path=/ Via: cache14.l2eu6-1[102,200-0,M], cache21.l2eu6-1[106,0], cache10.cn883[190,200-0,M], cache1.cn883[214,0] X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 05:33:27 GMT X-Swift-CacheTime: 0 Timing-Allow-Origin: * EagleId: af06f99515296456075954226e Connection: keep-alive Cache-Control: public, max-age=6000 第N次网络请求 06-22 13:35:25.057 29674-30389/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 9.6ms Server: Tengine Content-Type: text/json;charset=UTF-8 Content-Length: 1492 Date: Fri, 22 Jun 2018 05:33:27 GMT Expires: Thu, 19 Nov 1981 08:52:00 GMT X-Powered-By: PHP/7.0.1 Set-Cookie: PHPSESSID=t6j4tnss1nkpbm0tddqdr0o2j1; path=/ Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529645607|1529645607;Path=/ Via: cache14.l2eu6-1[102,200-0,M], cache21.l2eu6-1[106,0], cache10.cn883[190,200-0,M], cache1.cn883[214,0] X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 05:33:27 GMT X-Swift-CacheTime: 0 Timing-Allow-Origin: * EagleId: af06f99515296456075954226e Connection: keep-alive Cache-Control: public, max-age=6000 第N+1次网络请求 06-22 13:35:28.046 29674-30389/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null Cache-Control: max-age=120, max-stale=60 06-22 13:35:28.056 29674-30389/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 8.9ms Server: Tengine Content-Type: text/json;charset=UTF-8 Content-Length: 1492 Date: Fri, 22 Jun 2018 05:33:27 GMT Expires: Thu, 19 Nov 1981 08:52:00 GMT X-Powered-By: PHP/7.0.1 Set-Cookie: PHPSESSID=t6j4tnss1nkpbm0tddqdr0o2j1; path=/ Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529645607|1529645607;Path=/ Via: cache14.l2eu6-1[102,200-0,M], cache21.l2eu6-1[106,0], cache10.cn883[190,200-0,M], cache1.cn883[214,0] X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 05:33:27 GMT X-Swift-CacheTime: 0 Timing-Allow-Origin: * EagleId: af06f99515296456075954226e Connection: keep-alive Cache-Control: public, max-age=6000 Warning: 110 HttpURLConnection "Response is stale" |
charles抓包结果
测试结果分析,从测试结果中可以看出在request请求中设置max-age和max-stale值,缓存时间是以两者值得和,测试中max-age = 120s,max-stale = 60s,恰好为3分钟,抓包请求间隔是3分钟。但是有一点,在请求的时间超过120s后,再次请求时,请求的结果中会多出“Warning: 110 HttpURLConnection "Response is stale"”
3.3 异常测试一
上述测试中max-age和max-stale还算符合预期,但是在用公司的url进行测试时,max-age和max-stale似乎失去了效果。依旧在response中设置max-age =60和max-stale =120进行测试。
测试日志结果如下:
第一次网络请求 06-22 17:38:27.094 7756-7780/com.example.moxie.cacheresearch I/yansm: Sending request https://comic.mkzhan.com/recom/app/ on null 06-22 17:38:27.253 7756-7780/com.example.moxie.cacheresearch I/yansm: Received response for https://comic.mkzhan.com/recom/app/ in 158.0ms Server: Tengine Content-Type: application/json; charset=utf-8 Content-Length: 625 Date: Fri, 22 Jun 2018 08:51:34 GMT Access-Control-Allow-Origin: * Access-Control-Allow-Headers: X-Requested-With,app-id,app-version,device-name,device-resolution,device-udid,platform,system-name,system-version Access-Control-Allow-Methods: GET,POST,OPTIONS X-Powered-By: mkzhan-A2 Via: cache9.l2cm10-1[0,200-0,H], cache29.l2cm10-1[1,0], cache1.cn1412[0,200-0,H], cache14.cn1412[1,0] Age: 2812 X-Cache: HIT TCP_MEM_HIT dirn:12:43491335 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 09:03:10 GMT X-Swift-CacheTime: 3600 Timing-Allow-Origin: * EagleId: 7ce89ea215296603064393222e Connection: keep-alive Cache-Control: max-age=60, max-stale=120 第二次网络请求 06-22 17:38:30.091 7756-7780/com.example.moxie.cacheresearch I/yansm: Sending request https://comic.mkzhan.com/recom/app/ on null 06-22 17:38:30.249 7756-7780/com.example.moxie.cacheresearch I/yansm: Received response for https://comic.mkzhan.com/recom/app/ in 156.9ms Server: Tengine Content-Type: application/json; charset=utf-8 Content-Length: 625 Date: Fri, 22 Jun 2018 08:51:34 GMT Access-Control-Allow-Origin: * Access-Control-Allow-Headers: X-Requested-With,app-id,app-version,device-name,device-resolution,device-udid,platform,system-name,system-version Access-Control-Allow-Methods: GET,POST,OPTIONS X-Powered-By: mkzhan-A2 Via: cache9.l2cm10-1[0,200-0,H], cache29.l2cm10-1[1,0], cache1.cn1412[0,200-0,H], cache14.cn1412[1,0] Age: 2815 X-Cache: HIT TCP_MEM_HIT dirn:12:43491335 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 09:03:10 GMT X-Swift-CacheTime: 3600 Timing-Allow-Origin: * EagleId: 7ce89ea215296603094162696e Connection: keep-alive Cache-Control: max-age=60, max-stale=120 第三次网络请求 06-22 17:38:33.093 7756-7780/com.example.moxie.cacheresearch I/yansm: Sending request https://comic.mkzhan.com/recom/app/ on null 06-22 17:38:33.198 7756-7780/com.example.moxie.cacheresearch I/yansm: Received response for https://comic.mkzhan.com/recom/app/ in 103.4ms Server: Tengine Content-Type: application/json; charset=utf-8 Content-Length: 625 Date: Fri, 22 Jun 2018 08:51:34 GMT Access-Control-Allow-Origin: * Access-Control-Allow-Headers: X-Requested-With,app-id,app-version,device-name,device-resolution,device-udid,platform,system-name,system-version Access-Control-Allow-Methods: GET,POST,OPTIONS X-Powered-By: mkzhan-A2 Via: cache9.l2cm10-1[0,200-0,H], cache29.l2cm10-1[1,0], cache1.cn1412[0,200-0,H], cache14.cn1412[0,0] Age: 2818 X-Cache: HIT TCP_MEM_HIT dirn:12:43491335 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 09:03:10 GMT X-Swift-CacheTime: 3600 Timing-Allow-Origin: * EagleId: 7ce89ea215296603123821715e Connection: keep-alive Cache-Control: max-age=60, max-stale=120 |
抓包结果如下
问题提出:在response中设置了max-age =60s,根据此前的测试情况,抓包得到的请求应该间隔60s,而不是根据请求每次都是3s。针对这一疑问,检查了日志中的返回字段,发现公司服务器返回的字段比此前测试的字段多了一个Age字段
Age字段的定义:当代理服务器用自己缓存的实体去响应请求时,用该头部表明该实体从产生到现在经过多长时间了(可参见该博客的解释https://blog.csdn.net/xifeijian/article/details/46460631)。
由该字段的定义可以猜到,该字段会影响缓存的时效,如果定义的缓存的比改值要小,则缓存从设置起可能就已经失效了。因此需要定义max-age的时间值超过Age的时间值才能让max-age值生效。
3.4 异常测试二
由于Age的时间值也会会是增加的,将max-age的时间值设置为4000,得到如下测试日志:
06-22 09:52:47.578 14683-14855/com.example.moxie.cacheresearch I/yansm: Sending request https://comic.mkzhan.com/recom/app/ on null 06-22 09:52:48.216 14683-14855/com.example.moxie.cacheresearch I/yansm: Received response for https://comic.mkzhan.com/recom/app/ in 637.9ms Server: Tengine Content-Type: application/json; charset=utf-8 Content-Length: 624 Date: Fri, 22 Jun 2018 00:51:28 GMT Access-Control-Allow-Origin: * Access-Control-Allow-Headers: X-Requested-With,app-id,app-version,device-name,device-resolution,device-udid,platform,system-name,system-version Access-Control-Allow-Methods: GET,POST,OPTIONS X-Powered-By: mkzhan-A2 Via: cache9.l2cm10-1[0,200-0,H], cache22.l2cm10-1[1,0], cache10.cn978[0,200-0,H], cache2.cn978[1,0] Age: 3679 X-Cache: HIT TCP_MEM_HIT dirn:6:301393262 mlen:-1 X-Swift-SaveTime: Fri, 22 Jun 2018 01:08:57 GMT X-Swift-CacheTime: 3600 Timing-Allow-Origin: * EagleId: 74d3999615296323674053464e Connection: keep-alive Cache-Control: public, max-age=4000 |
测试结果是,缓存生效了,但是生效的时间值只有4000s-3679s = 321s,在Age值超过4000s之后,依旧是按照测试代码中设定的间隔每隔3s钟发送一次。为了能够除去Age造成的影响,在response中调用removeHeader将Age给删除,但是并没有起作用。
四、总结
本次主要是对max-age和max-stale的意义在OKHTTP的使用中进行了实际的验证测试,由于起初用公司的URL进行测试时发现与预期不符,经过排查发现是Age参数值搞的鬼。
参考博客:
https://blog.csdn.net/adzcsx2/article/details/51365548
https://blog.csdn.net/qqyanjiang/article/details/51316116
https://segmentfault.com/q/1010000002578217/a-1020000002578576
https://www.cnblogs.com/_franky/archive/2011/11/23/2260109.html
https://blog.csdn.net/briblue/article/details/52920531
https://www.cnblogs.com/lenve/p/6063851.html
https://blog.csdn.net/yangjianbo456/article/details/52975183
https://www.jianshu.com/p/db197279f053(比较详细,值得细细阅读)