Java SDK夯住(Hang)问题排查

时间：2022-03-10 05:44:29

夯住(Hang)是指程序仍在运行，卡在某个方法调用上，没有返回也没有异常抛出；卡住时间从几秒到几小时不等。 
Java程序发生Hang时，应该首先使用 jstack 把java进程的堆栈信息保存下来 ，供后继分析使用。

调用OSS Java SDK的程序Hang，有以下可能的情况及原因。

Java SDK夯住(Hang)问题排查

说明：

  • jstack -l <pid> > js.txt可以把pid的堆栈信息保存到文件js.txt中。pid可以通过jps命令查找到。
  • 抓包工具，Windows系统下推荐使用Wireshark。捕获筛选器可以设置成
    host <bucket-name>.<endpoint>，例如：
host my-bucket.oss-cn-hangzhou.aliyuncs.com`

Linux使用tcpdump命令抓包，命令格式如下：

sudo tcpdump tcp -i <eth0> -t -s 0 -c 200000 and host <bucket>.<endpoint> -w <file.cap>

例如：

sudo tcpdump tcp -i eth0 -t -s 0 -c 200000 and host my-bucket.oss-cn-hangzhou.aliyuncs.com -w out.cap`

然后用Wireshark打开file.cap分析抓包数据。

  • getObject获取的InputStream需要close，示例如下：
OSSObject ossObject = ossClient.getObject(bucketName, key);

ossObject.getObjectContent().close();
  • OSS Java SDK 2.2.3前的版本getSimplifiedObjectMeta调用有bug，连接没有关闭，会造成泄漏。2.2.3版本修复。
  • hang在PoolingHttpClientConnectionManager.leaseConnection的堆栈如下：
"main" prio=6 tid=0x000000000291e000 nid=0xc40 waiting on condition [0x0000000002dae000]

java.lang.Thread.State: WAITING (parking)

    at sun.misc.Unsafe.park(Native Method)

    - parking to wait for  <0x00000007d85697f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)

    at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)

    at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)

    at org.apache.http.pool.PoolEntryFuture.await(PoolEntryFuture.java:138)

    at org.apache.http.pool.AbstractConnPool.getPoolEntryBlocking(AbstractConnPool.java:306)

    at org.apache.http.pool.AbstractConnPool.access$000(AbstractConnPool.java:64)

    at org.apache.http.pool.AbstractConnPool$2.getPoolEntry(AbstractConnPool.java:192)

    at org.apache.http.pool.AbstractConnPool$2.getPoolEntry(AbstractConnPool.java:185)

    at org.apache.http.pool.PoolEntryFuture.get(PoolEntryFuture.java:107)

    at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.leaseConnection(PoolingHttpClientConnectionManager.java:276)

    at org.apache.http.impl.conn.PoolingHttpClientConnectionManager$1.get(PoolingHttpClientConnectionManager.java:263)

    at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:190)

    at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)

    at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)

    at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)

    at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)

    at com.aliyun.oss.common.comm.DefaultServiceClient.sendRequestCore(DefaultServiceClient.java:113)

    at com.aliyun.oss.common.comm.ServiceClient.sendRequestImpl(ServiceClient.java:123)

    at com.aliyun.oss.common.comm.ServiceClient.sendRequest(ServiceClient.java:68)

    at com.aliyun.oss.internal.OSSOperation.send(OSSOperation.java:94)

    at com.aliyun.oss.internal.OSSOperation.doOperation(OSSOperation.java:146)

    at com.aliyun.oss.internal.OSSOperation.doOperation(OSSOperation.java:113)

    at com.aliyun.oss.internal.OSSObjectOperation.getObject(OSSObjectOperation.java:229)

    at com.aliyun.oss.OSSClient.getObject(OSSClient.java:629)

    at com.aliyun.oss.OSSClient.getObject(OSSClient.java:617)

    at samples.HelloOSS.main(HelloOSS.java:49)
  • hang在java.net.SocketOutputStream.socketWrite的堆栈如下：
"main" prio=10 tid=0x0000000040112800 nid=0x2ad8 runnable [0x00000000418e1000]

   java.lang.Thread.State: RUNNABLE

        at java.net.SocketOutputStream.socketWrite0(Native Method)

        at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)

        at java.net.SocketOutputStream.write(SocketOutputStream.java:136)

        at org.apache.http.impl.conn.LoggingOutputStream.write(LoggingOutputStream.java:77)

        at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)

        at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)

        at org.apache.http.impl.io.SessionOutputBufferImpl.write(SessionOutputBufferImpl.java:169)

        at org.apache.http.impl.io.ContentLengthOutputStream.write(ContentLengthOutputStream.java:115)

        at com.aliyun.oss.common.comm.RepeatableInputStreamEntity$NoAutoClosedInputStreamEntity.writeTo(RepeatableInputStreamEntity.java:127)

        at com.aliyun.oss.common.comm.RepeatableInputStreamEntity.writeTo(RepeatableInputStreamEntity.java:71)

        at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:158)

        at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)

        at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)

        at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)

        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)

        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)

        at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)

        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)

        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)

        at com.aliyun.oss.common.comm.DefaultServiceClient.sendRequestCore(DefaultServiceClient.java:113)

        at com.aliyun.oss.common.comm.ServiceClient.sendRequestImpl(ServiceClient.java:121)

        at com.aliyun.oss.common.comm.ServiceClient.sendRequest(ServiceClient.java:67)

        at com.aliyun.oss.internal.OSSOperation.send(OSSOperation.java:92)

        at com.aliyun.oss.internal.OSSOperation.doOperation(OSSOperation.java:140)

        at com.aliyun.oss.internal.OSSOperation.doOperation(OSSOperation.java:111)

        at com.aliyun.oss.internal.OSSObjectOperation.writeObjectInternal(OSSObjectOperation.java:665)

        at com.aliyun.oss.internal.OSSObjectOperation.putObject(OSSObjectOperation.java:132)

        at com.aliyun.oss.OSSClient.putObject(OSSClient.java:528)

        at com.aliyun.oss.OSSClient.putObject(OSSClient.java:516)

        at com.aliyun.oss.OSSClient.putObject(OSSClient.java:522)

        at com.aliyun.oss.demo.HelloOSS.main(HelloOSS.java:25)
本文为云栖社区原创内容，未经允许不得转载，如需转载请发送邮件至yqeditor@list.alibaba-inc.com；
如果您发现本社区中有涉嫌抄袭的内容，欢迎发送邮件至：yqgroup@service.aliyun.com 进行举报，并提供相关证据，一经查实，本社区将立刻删除涉嫌侵权内容。

https://yq.aliyun.com/articles/61325?spm=a2c4g.11186623.2.34.631b54130pevRE

相关文章