OKHTTP缓存max-age和max-stale详解

时间:2024-04-09 19:52:25

一、前言

      此前了解过OKHTTP的缓存的使用,并对缓存的使用进行了初步的总结https://blog.csdn.net/polo2044/article/details/80650856。缓存主要是为了在没有网络的情况下,或者资源不需要实时去后端进行更新时,可以直接从缓存中获取资源信息。一方面是能够在断网的情况下仍然给用户良好的界面展示,另一个方面是避免频繁的请求网络给后端带来压力。目前网络上介绍的在OKHTTP中实现客户端的缓存机制,都是在自定义的Intercept中设置max-age和max-stale的参数值来完成。

但是在查阅网络上的方法后,依旧存在如下疑问:

1. max-age和max-stale在request和response中都可以进行设置,两种设置的效果是否一样,这个可以参考OkHttp缓存max-age详解补充

2.在本人公司的URL测试中发现,max-age和max-stale没有起作用。

为了解决这些疑问,因此有必要在实际代码中对这两个参数进行实际的验证和研究。

二、max-age和max-stale参数的意义

      max-age:告知缓存多长时间,在没有超过缓存时间的情况下,请求会返回缓存内的数据,在超出max-age的情况下向服务端发起新的请求,请求失败的情况下返回缓存数据(测试中已验证),否则向服务端重新发起请求。

      max-stale:指示客户机可以接收超出max-age时间的响应消息,max-stale在请求设置中有效,在响应设置中无效(测试中已验证,且参见博客https://www.jianshu.com/p/db197279f053)。

      因此max-age和max-stale在请求中同时使用的情况下,缓存的时间可以为max-age和max-stale的和。

三、测试验证

      在测试中需要构造一个OKHTTP,然后在拦截器中定义不同的max-age和max-stale来进行测试,在Activity中定义一个定时器,每隔3s进行一次网络请求。

Activity中的网络请求如下:

@Override

public void onClick(View view) {

if (view.getId() == R.id.button) {

Observable.interval(3, TimeUnit.SECONDS).subscribe(

new Action1<Long>() {

@Override

public void call(Long aLong) {

getRecomandComic();

}

}

);

}

}

 

private void getRecomandComic() {

RetrofitResearch.getInstance(this)

.getTopRecommendList()

.subscribeOn(Schedulers.computation())

.observeOn(AndroidSchedulers.mainThread())

.subscribe(new Action1<ComicBeanNoCountResult>() {

@Override

public void call(ComicBeanNoCountResult comicBeanNoCountResult) {

}

},

 

new Action1<Throwable>() {

@Override

public void call(Throwable throwable) {

 

}

});

}

OKHTTP的构造代码如下:

public class OkHttpCallFactory {

private static int DEFAULT_TIMEOUT = 30;

private static final int CONST_10 = 10;

private static final int CONST_1024 = 1024;

private static final Logger logger = Logger.getLogger("yansm");

private OkHttpCallFactory() {

}

private static Call.Factory factory;

private static int time =60;

public static Call.Factory getOkHttpFactory(Context context) {

if (factory == null) {

synchronized (OkHttpCallFactory.class) {

if (factory == null) {

OkHttpClient.Builder builder = new OkHttpClient.Builder();

builder.cache(new Cache(context.getCacheDir(),

CONST_10 * CONST_1024 * CONST_1024)); //设置缓存

builder.connectTimeout(DEFAULT_TIMEOUT, TimeUnit.SECONDS);

builder.writeTimeout(DEFAULT_TIMEOUT, TimeUnit.SECONDS);

builder.readTimeout(DEFAULT_TIMEOUT, TimeUnit.SECONDS);

Interceptor interceptor = new NetCacheInterceptor();

builder.addInterceptor(interceptor);

builder.addNetworkInterceptor(interceptor);

builder.addInterceptor(new LoggingInterceptor());

factory = builder.build();

}

}

}

return factory;

}

//日志输出的拦截器

private static class LoggingInterceptor implements Interceptor {

@Override public Response intercept(Chain chain) throws IOException {

long t1 = System.nanoTime();

Request request = chain.request();

logger.info(String.format("Sending request %s on %s%n%s",

request.url(), chain.connection(), request.headers()));

Response response = chain.proceed(request);

 

long t2 = System.nanoTime();

logger.info(String.format("Received response for %s in %.1fms%n%s",

request.url(), (t2 - t1) / 1e6d, response.headers()));

return response;

 

}

}

}

 

 3.1 在拦截器的response中设置max-age = 60和max-stale = 120

public class NetCacheInterceptor implements Interceptor {

    @Override

    public Response intercept(Chain chain) throws IOException {

    Request request = chain.request();

    CacheControl cacheControl = new CacheControl.Builder()

                                                   .maxAge(60, TimeUnit.SECONDS)

                                                   .maxStale(120, TimeUnit.SECONDS).build();

    Response response = chain.proceed(request);

    return response.newBuilder()

    .removeHeader("Pragma")

    .removeHeader("Cache-Control")

    .header("Cache-Control", cacheControl.toString())

    .build();

    }

}

 测试日志结果如下,每隔三秒发送一次请求:

第一次网络请求

06-22 13:59:51.816 32336-469/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null

06-22 13:59:52.200 32336-469/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 381.9ms

Server: Tengine

Content-Type: text/json;charset=UTF-8

Content-Length: 1492

Date: Fri, 22 Jun 2018 05:59:51 GMT

Expires: Thu, 19 Nov 1981 08:52:00 GMT

X-Powered-By: PHP/7.0.1

Set-Cookie: PHPSESSID=pef8qomvm3kjg90bs94ojpugf1; path=/

Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529647191|1529647191;Path=/

Via: cache14.l2eu6-1[103,200-0,M], cache4.l2eu6-1[103,0], cache8.cn785[155,200-0,M], cache7.cn785[159,0]

X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 05:59:51 GMT

X-Swift-CacheTime: 0

Timing-Allow-Origin: *

EagleId: 3d9bde1b15296471912141111e

Connection: keep-alive

Cache-Control: max-age=60, max-stale=120

第二次网络请求

06-22 13:59:54.733 32336-469/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null

06-22 13:59:54.759 32336-469/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 25.1ms

Server: Tengine

Content-Type: text/json;charset=UTF-8

Content-Length: 1492

Date: Fri, 22 Jun 2018 05:59:51 GMT

Expires: Thu, 19 Nov 1981 08:52:00 GMT

X-Powered-By: PHP/7.0.1

Set-Cookie: PHPSESSID=pef8qomvm3kjg90bs94ojpugf1; path=/

Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529647191|1529647191;Path=/

Via: cache14.l2eu6-1[103,200-0,M], cache4.l2eu6-1[103,0], cache8.cn785[155,200-0,M], cache7.cn785[159,0]

X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 05:59:51 GMT

X-Swift-CacheTime: 0

Timing-Allow-Origin: *

EagleId: 3d9bde1b15296471912141111e

Connection: keep-alive

Cache-Control: max-age=60, max-stale=120

第三次网络请求

06-22 13:59:57.733 32336-469/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null

06-22 13:59:57.749 32336-469/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 14.9ms

Server: Tengine

Content-Type: text/json;charset=UTF-8

Content-Length: 1492

Date: Fri, 22 Jun 2018 05:59:51 GMT

Expires: Thu, 19 Nov 1981 08:52:00 GMT

X-Powered-By: PHP/7.0.1

Set-Cookie: PHPSESSID=pef8qomvm3kjg90bs94ojpugf1; path=/

Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529647191|1529647191;Path=/

Via: cache14.l2eu6-1[103,200-0,M], cache4.l2eu6-1[103,0], cache8.cn785[155,200-0,M], cache7.cn785[159,0]

X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 05:59:51 GMT

X-Swift-CacheTime: 0

Timing-Allow-Origin: *

EagleId: 3d9bde1b15296471912141111e

Connection: keep-alive

Cache-Control: max-age=60, max-stale=120

charles抓包结果

OKHTTP缓存max-age和max-stale详解

      测试结果分析:在实验中,对response的max-age和max-stale进行了设置,分别为60秒和120秒,在日志的输出中可以看到这一点。但是通过实际的抓包结果能够看到max-age时效起作用了,max-stale没有起时效,客户端在60s内没有向服务端发送请求,但是在60s后向服务端发送了请求。

3.2 在拦截器的request中设置max-age=120和max-stale=60

      再次查看该实验时,发现存在问题,就是Response中也设置了max-age,实验本身也有意义,但是先建议阅读我的另一篇博客OkHttp缓存max-age详解补充

      参考代码如下

@Override

public Response intercept(Chain chain) throws IOException {

Request request = chain.request();

CacheControl cacheControl = new CacheControl.Builder().maxAge(120, TimeUnit.SECONDS)

.maxStale(60, TimeUnit.SECONDS).build();

request = request.newBuilder()

.cacheControl(cacheControl)

.build();

return chain.proceed(request);

}

    测试日志结果如下:

第一次网络请求

06-22 13:33:28.131 29674-30389/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null

Cache-Control: max-age=120, max-stale=60

06-22 13:33:28.700 29674-30389/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 567.5ms

Server: Tengine

Content-Type: text/json;charset=UTF-8

Content-Length: 1492

Date: Fri, 22 Jun 2018 05:33:27 GMT

Expires: Thu, 19 Nov 1981 08:52:00 GMT

X-Powered-By: PHP/7.0.1

Set-Cookie: PHPSESSID=t6j4tnss1nkpbm0tddqdr0o2j1; path=/

Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529645607|1529645607;Path=/

Via: cache14.l2eu6-1[102,200-0,M], cache21.l2eu6-1[106,0], cache10.cn883[190,200-0,M], cache1.cn883[214,0]

X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 05:33:27 GMT

X-Swift-CacheTime: 0

Timing-Allow-Origin: *

EagleId: af06f99515296456075954226e

Connection: keep-alive

Cache-Control: public, max-age=6000

第N次网络请求

06-22 13:35:25.057 29674-30389/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 9.6ms

Server: Tengine

Content-Type: text/json;charset=UTF-8

Content-Length: 1492

Date: Fri, 22 Jun 2018 05:33:27 GMT

Expires: Thu, 19 Nov 1981 08:52:00 GMT

X-Powered-By: PHP/7.0.1

Set-Cookie: PHPSESSID=t6j4tnss1nkpbm0tddqdr0o2j1; path=/

Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529645607|1529645607;Path=/

Via: cache14.l2eu6-1[102,200-0,M], cache21.l2eu6-1[106,0], cache10.cn883[190,200-0,M], cache1.cn883[214,0]

X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 05:33:27 GMT

X-Swift-CacheTime: 0

Timing-Allow-Origin: *

EagleId: af06f99515296456075954226e

Connection: keep-alive

Cache-Control: public, max-age=6000

第N+1次网络请求

06-22 13:35:28.046 29674-30389/com.example.moxie.cacheresearch I/yansm: Sending request http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network on null

Cache-Control: max-age=120, max-stale=60

06-22 13:35:28.056 29674-30389/com.example.moxie.cacheresearch I/yansm: Received response for http://lbs.sougu.net.cn/app.php?m=souguapp&c=appusers&a=network in 8.9ms

Server: Tengine

Content-Type: text/json;charset=UTF-8

Content-Length: 1492

Date: Fri, 22 Jun 2018 05:33:27 GMT

Expires: Thu, 19 Nov 1981 08:52:00 GMT

X-Powered-By: PHP/7.0.1

Set-Cookie: PHPSESSID=t6j4tnss1nkpbm0tddqdr0o2j1; path=/

Set-Cookie: SERVERID=37f80876073565188d4968aa47392891|1529645607|1529645607;Path=/

Via: cache14.l2eu6-1[102,200-0,M], cache21.l2eu6-1[106,0], cache10.cn883[190,200-0,M], cache1.cn883[214,0]

X-Cache: MISS TCP_MISS dirn:-2:-2 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 05:33:27 GMT

X-Swift-CacheTime: 0

Timing-Allow-Origin: *

EagleId: af06f99515296456075954226e

Connection: keep-alive

Cache-Control: public, max-age=6000

Warning: 110 HttpURLConnection "Response is stale"

charles抓包结果

OKHTTP缓存max-age和max-stale详解

        测试结果分析,从测试结果中可以看出在request请求中设置max-age和max-stale值,缓存时间是以两者值得和,测试中max-age = 120s,max-stale = 60s,恰好为3分钟,抓包请求间隔是3分钟。但是有一点,在请求的时间超过120s后,再次请求时,请求的结果中会多出“Warning: 110 HttpURLConnection "Response is stale"”

3.3 异常测试一

      上述测试中max-age和max-stale还算符合预期,但是在用公司的url进行测试时,max-age和max-stale似乎失去了效果。依旧在response中设置max-age =60和max-stale =120进行测试。

      测试日志结果如下:

第一次网络请求

06-22 17:38:27.094 7756-7780/com.example.moxie.cacheresearch I/yansm: Sending request https://comic.mkzhan.com/recom/app/ on null

06-22 17:38:27.253 7756-7780/com.example.moxie.cacheresearch I/yansm: Received response for https://comic.mkzhan.com/recom/app/ in 158.0ms

Server: Tengine

Content-Type: application/json; charset=utf-8

Content-Length: 625

Date: Fri, 22 Jun 2018 08:51:34 GMT

Access-Control-Allow-Origin: *

Access-Control-Allow-Headers: X-Requested-With,app-id,app-version,device-name,device-resolution,device-udid,platform,system-name,system-version

Access-Control-Allow-Methods: GET,POST,OPTIONS

X-Powered-By: mkzhan-A2

Via: cache9.l2cm10-1[0,200-0,H], cache29.l2cm10-1[1,0], cache1.cn1412[0,200-0,H], cache14.cn1412[1,0]

Age: 2812

X-Cache: HIT TCP_MEM_HIT dirn:12:43491335 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 09:03:10 GMT

X-Swift-CacheTime: 3600

Timing-Allow-Origin: *

EagleId: 7ce89ea215296603064393222e

Connection: keep-alive

Cache-Control: max-age=60, max-stale=120

第二次网络请求

06-22 17:38:30.091 7756-7780/com.example.moxie.cacheresearch I/yansm: Sending request https://comic.mkzhan.com/recom/app/ on null

06-22 17:38:30.249 7756-7780/com.example.moxie.cacheresearch I/yansm: Received response for https://comic.mkzhan.com/recom/app/ in 156.9ms

Server: Tengine

Content-Type: application/json; charset=utf-8

Content-Length: 625

Date: Fri, 22 Jun 2018 08:51:34 GMT

Access-Control-Allow-Origin: *

Access-Control-Allow-Headers: X-Requested-With,app-id,app-version,device-name,device-resolution,device-udid,platform,system-name,system-version

Access-Control-Allow-Methods: GET,POST,OPTIONS

X-Powered-By: mkzhan-A2

Via: cache9.l2cm10-1[0,200-0,H], cache29.l2cm10-1[1,0], cache1.cn1412[0,200-0,H], cache14.cn1412[1,0]

Age: 2815

X-Cache: HIT TCP_MEM_HIT dirn:12:43491335 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 09:03:10 GMT

X-Swift-CacheTime: 3600

Timing-Allow-Origin: *

EagleId: 7ce89ea215296603094162696e

Connection: keep-alive

Cache-Control: max-age=60, max-stale=120

第三次网络请求

06-22 17:38:33.093 7756-7780/com.example.moxie.cacheresearch I/yansm: Sending request https://comic.mkzhan.com/recom/app/ on null

06-22 17:38:33.198 7756-7780/com.example.moxie.cacheresearch I/yansm: Received response for https://comic.mkzhan.com/recom/app/ in 103.4ms

Server: Tengine

Content-Type: application/json; charset=utf-8

Content-Length: 625

Date: Fri, 22 Jun 2018 08:51:34 GMT

Access-Control-Allow-Origin: *

Access-Control-Allow-Headers: X-Requested-With,app-id,app-version,device-name,device-resolution,device-udid,platform,system-name,system-version

Access-Control-Allow-Methods: GET,POST,OPTIONS

X-Powered-By: mkzhan-A2

Via: cache9.l2cm10-1[0,200-0,H], cache29.l2cm10-1[1,0], cache1.cn1412[0,200-0,H], cache14.cn1412[0,0]

Age: 2818

X-Cache: HIT TCP_MEM_HIT dirn:12:43491335 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 09:03:10 GMT

X-Swift-CacheTime: 3600

Timing-Allow-Origin: *

EagleId: 7ce89ea215296603123821715e

Connection: keep-alive

Cache-Control: max-age=60, max-stale=120

抓包结果如下

OKHTTP缓存max-age和max-stale详解

 

问题提出:在response中设置了max-age =60s,根据此前的测试情况,抓包得到的请求应该间隔60s,而不是根据请求每次都是3s。针对这一疑问,检查了日志中的返回字段,发现公司服务器返回的字段比此前测试的字段多了一个Age字段

OKHTTP缓存max-age和max-stale详解

       Age字段的定义:当代理服务器用自己缓存的实体去响应请求时,用该头部表明该实体从产生到现在经过多长时间了(可参见该博客的解释https://blog.csdn.net/xifeijian/article/details/46460631)。

      由该字段的定义可以猜到,该字段会影响缓存的时效,如果定义的缓存的比改值要小,则缓存从设置起可能就已经失效了。因此需要定义max-age的时间值超过Age的时间值才能让max-age值生效。

3.4 异常测试二

     由于Age的时间值也会会是增加的,将max-age的时间值设置为4000,得到如下测试日志:

06-22 09:52:47.578 14683-14855/com.example.moxie.cacheresearch I/yansm: Sending request https://comic.mkzhan.com/recom/app/ on null

06-22 09:52:48.216 14683-14855/com.example.moxie.cacheresearch I/yansm: Received response for https://comic.mkzhan.com/recom/app/ in 637.9ms

Server: Tengine

Content-Type: application/json; charset=utf-8

Content-Length: 624

Date: Fri, 22 Jun 2018 00:51:28 GMT

Access-Control-Allow-Origin: *

Access-Control-Allow-Headers: X-Requested-With,app-id,app-version,device-name,device-resolution,device-udid,platform,system-name,system-version

Access-Control-Allow-Methods: GET,POST,OPTIONS

X-Powered-By: mkzhan-A2

Via: cache9.l2cm10-1[0,200-0,H], cache22.l2cm10-1[1,0], cache10.cn978[0,200-0,H], cache2.cn978[1,0]

Age: 3679

X-Cache: HIT TCP_MEM_HIT dirn:6:301393262 mlen:-1

X-Swift-SaveTime: Fri, 22 Jun 2018 01:08:57 GMT

X-Swift-CacheTime: 3600

Timing-Allow-Origin: *

EagleId: 74d3999615296323674053464e

Connection: keep-alive

Cache-Control: public, max-age=4000

      测试结果是,缓存生效了,但是生效的时间值只有4000s-3679s = 321s,在Age值超过4000s之后,依旧是按照测试代码中设定的间隔每隔3s钟发送一次。为了能够除去Age造成的影响,在response中调用removeHeader将Age给删除,但是并没有起作用。

四、总结

     本次主要是对max-age和max-stale的意义在OKHTTP的使用中进行了实际的验证测试,由于起初用公司的URL进行测试时发现与预期不符,经过排查发现是Age参数值搞的鬼。

参考博客:

https://blog.csdn.net/adzcsx2/article/details/51365548

https://blog.csdn.net/qqyanjiang/article/details/51316116

https://segmentfault.com/q/1010000002578217/a-1020000002578576

https://www.cnblogs.com/_franky/archive/2011/11/23/2260109.html

https://blog.csdn.net/briblue/article/details/52920531

https://www.cnblogs.com/lenve/p/6063851.html

https://blog.csdn.net/yangjianbo456/article/details/52975183

https://www.jianshu.com/p/db197279f053(比较详细,值得细细阅读)