How do I know when HttpClient.execute () finishes fetching all content in a large request?

Question

I am working with this problem on Android, but it is not a problem with Android.

Using org.apache.http.client.HttpClient, I can make a request for a 1kb URL, and the whole answer is in the HttpResponse:

HttpClient client = new DefaultHttpClient(); HttpGet request = new HttpGet("http://10.16.83.67/1kb.log"); HttpResponse response = null; BufferedReader rd = null; response = client.execute(request); 

Then I can get HttpEntity from the response:

 HttpEntity entity = response.getEntity(); rd = new BufferedReader(new InputStreamReader(entity.getContent())); 

And then, with BufferedReader ...

 while ((line = rd.readLine()) != null) { // ... parse or whatever } 

I look at WireShark, and I see that there is one transmission in each direction for the above code: a request for a log file, and then the whole response is delivered in response.

However, if I ask for something more, say my log file is 1 MB, I see something completely different. Data is placed in frames and then transmitted over the cable in an rd.readLine() loop.

It seems the first kb or so is included in the original answer. But then, when readLine() started, it calls additional requests to the server, and the data is transferred to the socket. If the network connection is interrupted, I get an I / O error. For large queries, entity.isStreaming() is true .

This is an asynchronous call (mandatory for Android, since network calls cannot be made in the UI thread), but I don’t want to continue until I’m sure that I still get all the data from this request, Just wait for the time, and then continue and hoping for the best, unfortunately, is not an option.

My question is this: Do HttpClient , HttpGet , HttpResponse or HttpEntity when they receive data from this request? Or do I need to rely on BufferedReader to find out when a thread is closed?

Answer 1

Are you using AsyncTask? Otherwise you can go for it

  private class DownloadFilesTask extends AsyncTask<URL, Integer, Long> { protected Long doInBackground(URL... urls) {} 

// do all HTTP requests in the method above

  protected void onProgressUpdate(Integer... progress) { setProgressPercent(progress[0]); } protected void onPostExecute(Long result) { showDialog("I pop up when all the code in the DoInbackground is finished"); } 

}

Answer 2

Which httpclient are you using? You can appreciate it.

There are good httpclient libraries that let you use things like this

Check out this 3X example. I am using 4X and do not want any fragmented response code to be sent.

If you want to find new options, you can check here