current position:Home>Remember an httpclient pit
Remember an httpclient pit
2021-08-27 07:42:28 【Soldier Zhang Jian】
origin
I saw the server yesterday afternoon , There's a bunch of 500 Response code of . Look at it carefully .
throwable:org.apache.http.ConnectionClosedException: Premature end of Content-Length delimited message body (expected: 146,256; received: 139,121)
at org.apache.http.impl.io.ContentLengthInputStream.read(ContentLengthInputStream.java:178)
at org.apache.http.conn.EofSensorInputStream.read(EofSensorInputStream.java:135)
at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
at java.io.InputStreamReader.read(InputStreamReader.java:184)
at java.io.Reader.read(Reader.java:140)
at org.apache.http.util.EntityUtils.toString(EntityUtils.java:227)
at org.apache.http.util.EntityUtils.toString(EntityUtils.java:308)
at com.zuhao.uhaozutool.base.CommonHttpClient.getHttpClientResult(CommonHttpClient.java:524)
at com.zuhao.uhaozutool.base.CommonHttpClient.doPost(CommonHttpClient.java:390)
at com.zuhao.uhaozutool.base.CommonHttpClient.doJsonPost(CommonHttpClient.java:216)
Copy code
Errors are common , In a nutshell Httpclient When reading the response , client / Server side Disconnected . As a result, the data is read-only and an error is reported (expected: 146,256; received: 139,121)
.
Jieyuan
So check whether there is any code in the code that closes the connection in advance , Check both the client and the server .
It is found that there is no explicit way to close the connection at the root in the code , It's about using PoolingHttpClientConnectionManager
Unified management .
PoolingHttpClientConnectionManager cm = new PoolingHttpClientConnectionManager(1, TimeUnit.MINUTES);
cm.setMaxTotal(200);
cm.setDefaultMaxPerRoute(20);
defaultHttpClient = HttpClients.custom()
.setConnectionManager(cm).build();
Copy code
So look for it PoolingHttpClientConnectionManager
Related configuration . Only found 3 There are three common settings .
new PoolingHttpClientConnectionManager(1, TimeUnit.MINUTES)
, Set the maximum available duration of a single connection in the constructor .cm.setMaxTotal(200);
, Set the maximum number of connections in the whole connection pool .cm.setDefaultMaxPerRoute(20);
, Set individual host/ domain name maximum connection .
No, i giao, There is no setting at all , Then check the server code , Just the most basic springboot project , Even less likely to actively disconnect . Then I tried a series of parameter settings , All invalid .
So re observe the log , Found a suspicious place .
Meow every time (expected: 146,256; received: 139,121)
,received All are 139,121. That's ridiculous , How to accept the same data size every time ??
So I turned to thinking , Is there a set to respond to the maximum acceptance size? Found a circle , No configuration was found .
Think about it. , Wrong! ,httpclient.excute
The success of , It's just EntityUtils.toString
When it failed . The requests were executed successfully , Why does it fail to read ? Check the source code and find , It turns out that the real read response content is EntityUtils.toString
in . Yes, of course , It's just an episode .
private static String toString( final HttpEntity entity, final ContentType contentType) throws IOException {
final InputStream inStream = entity.getContent();
if (inStream == null) {
return null;
}
try {
Args.check(entity.getContentLength() <= Integer.MAX_VALUE,
"HTTP entity too large to be buffered in memory");
int capacity = (int)entity.getContentLength();
if (capacity < 0) {
capacity = DEFAULT_BUFFER_SIZE;
}
Charset charset = null;
if (contentType != null) {
charset = contentType.getCharset();
if (charset == null) {
final ContentType defaultContentType = ContentType.getByMimeType(contentType.getMimeType());
charset = defaultContentType != null ? defaultContentType.getCharset() : null;
}
}
if (charset == null) {
charset = HTTP.DEF_CONTENT_CHARSET;
}
final Reader reader = new InputStreamReader(inStream, charset);
final CharArrayBuffer buffer = new CharArrayBuffer(capacity);
final char[] tmp = new char[1024];
int l;
while((l = reader.read(tmp)) != -1) {
buffer.append(tmp, 0, l);
}
return buffer.toString();
} finally {
inStream.close();
}
}
Copy code
At this time in Google I saw a brother on the show saying , He had a similar problem , Because nginx The configured cache cannot hold the entire response body,nginx The enabled user does not have write permission in the directory , Cause more than... Each time body, Only the size of the cache is returned body.
I understand , But also shocked .
Edge out .
Find it quickly , View the cache configuration of the server domain name .
Quickly check the meaning of each configuration .www.cnblogs.com/wshenjin/p/…
Now I really can't understand , but 139121/1024 About equal to 128, Feeling 128k That field is very suspicious , Try to change it , again nginx after , Problem solving .
complex bug Often only simple configuration is required .
Sum up , The solution to this problem :
- Check whether the client closes the connection in advance
- Check whether the execution time of the server is too long, resulting in timeout, etc
- Check nginx Related configuration
copyright notice
author[Soldier Zhang Jian],Please bring the original link to reprint, thank you.
https://en.qdmana.com/2021/08/20210827074223696O.html
The sidebar is recommended
- Crazy blessing! Tencent boss's "million JVM learning notes", real topic of Huawei Java interview 2020-2021
- JS JavaScript how to get the subscript of a value in the array
- How to implement injection in vuex source code?
- JQuery operation select (value, setting, selected)
- One line of code teaches you how to advertise on Tanabata Valentine's Day - Animation 3D photo album (music + text) HTML + CSS + JavaScript
- An article disassembles the pyramid architecture behind the gamefi outbreak
- BEM - a front-end CSS naming methodology
- [vue3] encapsulate custom global plug-ins
- Error using swiper plug-in in Vue
- Another ruthless character fell by 40000, which was "more beautiful" than Passat and maiteng, and didn't lose BMW
guess what you like
-
Huang Lei basks in Zhang Yixing's album, and the relationship between teachers and apprentices is no less than that in the past. Netizens envy Huang Lei
-
He was cheated by Wang Xiaofei and Li Chengxuan successively. Is an Yixuan a blessed daughter and not a blessed home?
-
Zhou Shen sang the theme song of the film "summer friends and sunny days" in mainland China. Netizen: endless aftertaste
-
Pink is Wangyuan online! Back to the peak! The new hairstyle is creamy and sassy
-
Front end interview daily 3 + 1 - day 858
-
Spring Webflux tutorial: how to build reactive web applications
-
[golang] walk into go language lesson 24 TCP high-level operation
-
August 23, 2021 Daily: less than three years after its establishment, Google dissolved the health department
-
The female doctor of Southeast University is no less beautiful than the female star. She has been married four times, and her personal experience has been controversial
-
There are many potential safety hazards in Chinese restaurant. The top of the program recording shed collapses, and the artist will fall down if he is careless
Random recommended
- Anti Mafia storm: He Yun's helpless son, Sun Xing, is destined to be caught by his dry son
- Introduction to flex flexible layout in CSS -- learning notes
- CSS learning notes - Flex layout (Ruan Yifeng tutorial summary)
- Today, let's talk about the arrow function of ES6
- Some thoughts on small program development
- Talk about mobile terminal adaptation
- Unwilling to cooperate with Wang Yibo again, Zhao Liying's fans went on a collective strike and made a public apology in less than a day
- JS function scope, closure, let, const
- Zheng Shuang's 30th birthday is deserted. Chen Jia has been sending blessings for ten years. Is it really just forgetting to make friends?
- Unveil the mystery of ascension
- Asynchronous solution async await
- Analysis and expansion of Vue infinite scroll source code
- Compression webpack plugin first screen loading optimization
- Specific usage of vue3 video play plug-in
- "The story of huiyeji" -- people are always greedy, and fairies should be spotless!
- Installing Vue devtool for chrome and Firefox
- Basic usage of JS object
- 1. JavaScript variable promotion mechanism
- Two easy-to-use animation JS that make the page move
- Front end Engineering - scaffold
- Java SQL Server intelligent fixed asset management, back end + front end + mobile end
- Mediator pattern of JavaScript Design Pattern
- Array de duplication problem solution - Nan recognition problem
- New choice for app development: building mobile applications using Vue native
- New gs8 Chengdu auto show announces interior Toyota technology blessing
- Vieira officially terminated his contract and left the team. The national security club sent blessings to him
- Less than 200000 to buy a Ford RV? 2.0T gasoline / diesel power, horizontal bed / longitudinal bed layout can be selected
- How does "heart 4" come to an end? Pinhole was boycotted by the brand, Ma Dong deleted the bad comments, and no one blessed him
- We are fearless in epidemic prevention and control -- pay tribute to the front-line workers of epidemic prevention!
- Front end, netty framework tutorial
- Xiaomi 11 | miui12.5 | android11 solves the problem that the httpcanary certificate cannot be installed
- The wireless charging of SAIC Roewe rx5 plus is so easy to use!
- Upload and preview pictures with JavaScript, and summarize the most complete mybatis core configuration file
- [25] typescript
- CSS transform Complete Guide (Second Edition) flight.archives 007
- Ajax foundation - HTTP foundation of interview essential knowledge
- Cloud lesson | explain in detail how Huawei cloud exclusive load balancing charges
- Decorator pattern of JavaScript Design Pattern
- [JS] 10. Closure application (loop processing)
- Left hand IRR, right hand NPV, master the password of getting rich