76 questions
0
votes
0
answers
18
views
How to send chunk in Apache server
How can I configure Apache to send large responses in chunks? Are there any specific settings I need to adjust to control this behavior
i tried to send the data buffer control config but it was not ...
0
votes
0
answers
32
views
How do I stream a large BZ2 data file using Python requests stream=True/iter_content()?
I have a large data file at https://dumps.wikimedia.org/other/pageview_complete/monthly/2024/2024-07/pageviews-202407-user.bz2 (3.3 GB).
I'm trying to stream its contents and process it line by line, ...
- 2,780
0
votes
0
answers
138
views
HTTP Request Header Transfer-Encoding: chunked not getting set even when Body is a ReadableStream
We are trying to look at a solution to upload large files through a React web application. We are thinking of File Streaming solution, to reduce the time take for upload as files can be as large as 20 ...
1
vote
0
answers
796
views
NGINX: How to optionally disable chunked_transfer_encoding?
So I was trying to write some logic in my nginx.conf file to disable chunked transfer encoding based on an if statement, but when I try to run it, I get the following message:
"nginx: [emerg] &...
0
votes
0
answers
245
views
Http chunk encoding miss end of chunked encoding("0\r\n") or tailer("\r\n") on IIS 7.5
I create a simple ASP.NET Application[.NET Framework 4.8] and write a generic web handler (HelloFilterWithClose.ashx).
HelloFilterWithClose.ashx ProcessRequest with setting a HttpResponse.Filter(...
- 1
0
votes
0
answers
488
views
how does Chrome DevTools knows content size of an incomplete http response
I got an har file exported by Chrome DevTools. It shows an incomplete http response with error net::ERR_INCOMPLETE_CHUNKED_ENCODING. the incomplete http response has been transfered 4096 bytes.
"...
- 1
-1
votes
1
answer
387
views
Read from a compressing GZipStream
I'm exploring how to implement an HTTP server in C#. (And before you ask, I know there is Kestrel (and nothing else that isn't obsolete), and I want a much, much smaller application.) So, the response ...
- 20.2k
1
vote
1
answer
2k
views
Chunk transfer vs grpc streaming
I am working on a project, where I want to expose an API which will read a large file send that in response.
Since file can be large in size, it is better to send the file in chunks, so not much ...
- 475
0
votes
0
answers
1k
views
Chunked Transfer Encoding, Content-Length, and Byte Serving
In https://gist.github.com/CMCDragonkai/6bfade6431e9ffb7fe88, it says
Do note that byte serving is compatible with chunked encoding, this
would be applicable where you know the total content length, ...
- 9,482
0
votes
1
answer
603
views
How do I read chunked HTTP responses on jmeter?
I am using jmeter to send a HTTP POST request. the server responds with a chunked http response 200 ok and I need to parse the initial chunk. However jmeter waits for all the response chunks.
I tried ...
- 35
0
votes
1
answer
930
views
Chunked transfer encoding doesn't work with any browsers except Firefox
I am working on my HTTP server and I applied chunked transfer encoding to my responses if the requested file is larger than 64K. It works fine with Firefox, I can even send large videos, but Chrome ...
3
votes
1
answer
2k
views
Is http stream actually implemented by http chunk?
At first, I thought http stream is actually implemented http chunk.
So I did a test to learn.
Here is a django view
def test_stream(request):
return StreamingHttpResponse(func)
func return ...
- 2,476
13
votes
1
answer
19k
views
How To Stream Chunked Response With Spring Boot @RestController
I have spent like a day on this and I am unable to find a solution that works. In our application we have a couple of endpoints that can return large responses. I have been trying to find a ...
- 1,643
1
vote
0
answers
1k
views
C# Retrieve an HTTP POST chunked response by chunk?
I am working with an API that accepts an HTTP POST request along with URL-form-encoded query data as the payload. The response from the server is chunked, and each chunk contains a single JSON object. ...
- 5,097
3
votes
1
answer
781
views
Does Fetch's Response.body chunks correspond to HTTP chunks?
I'm doing a Fetch-api request where the server replies using the HTTP chunked transfer encoding (with text data). I'm consuming the data using the Response.body as a stream.
I'm wondering: Is it safe ...
- 1,877
0
votes
1
answer
614
views
URLSession didReceiveData isn't called in chunked request
I try to listen data from dweet.io service.
I use listen method to get data in realtime. It uses chunked HTTP responses.
I've created simple network manager for that
import Foundation
class ...
- 99
0
votes
1
answer
1k
views
File download in chunks in http-context response C#
I have a below scenario.
Client send request to Server-1 for file download
Server-1 send request to Server-2 for file.
To make this work I need to create a mechanism where once client send request ...
0
votes
1
answer
2k
views
Chunked HTTP request
I try to use chunked http request on ODIN-W2 with mbedOS. I have next http request/response:
POST /post HTTP/1.1<CR><LF>
Accept: */*<CR><LF>
Accept-Encoding: gzip<CR><...
0
votes
0
answers
2k
views
ERR_INVALID_CHUNKED_ENCODING for chunked transfer encoding for HTTP server
My task is to implement simple HTTP server with chunked transfer encoding.
Here is function that read request and send response to the client.
static int serve_request(int sock, struct conf_arg *arg,...
- 47
1
vote
1
answer
593
views
Chunked transfer encoding - Page is not displayed properly
My task is to implement simple HTTP server. I should support chunked transfer encoding when I send response. Here is my function that send response to client.
static int serve_request(int sock, ...
- 47
1
vote
1
answer
1k
views
Upload a chunked image file issue
I'm using ng-file-upload directive to send an image to server from my angular application. Here is my code:
Upload.upload({
url: 'http://localhost:5000/upload',
data: { file: blobFile },
...
20
votes
3
answers
42k
views
Python Requests - ChunkedEncodingError(e) - requests.iter_lines
I'm getting a ChunkedEncodingError(e) using Python requests. I'm using the following to rip down JSON:
r = requests.get(url, headers=auth, stream=True)
And the iterating over each line, using the ...
- 1,877
0
votes
1
answer
76
views
Tiny web server without compressed transfer encoding
I am working on a very constrained device that has TCP support, and I want to support HTTP/1.1 but eliminate all of the compression support to make it fit the device limitations.
If a client sends ...
- 2,744
0
votes
1
answer
787
views
Why can't I prevent chunking on my HttpRequest from WPF client to Web API controller?
I have been battling this for a week now. See my previous question for some additional background.
My WPF client makes GET, POST and PUT calls to my Web API controllers. All was well for weeks. ...
- 523
0
votes
1
answer
694
views
Why are POSTs and PUTs ReadAsAsync() null, but ReadAsStringAsync() filled? AKA "How do I turn Chunking Off?"
I have a Web API project that has a few dozen RESTful methods, split about evenly between GETs, POSTs and PUTs. The system uses Entity Framework objects and Newtonsoft's JSON from Nuget (version 9.0....
- 523
1
vote
1
answer
553
views
How to produce a response body with asynchronously created body chunks in Swift Vapor
I am looking into the Swift Vapor framework.
I am trying to create a controller class that maps data obtained on an SSL link to a third party system (an Asterisk PBX server..) into a response body ...
- 317
0
votes
1
answer
1k
views
What response header should HTTP HEAD method get for a dynamically generated file?
The http spec says about the HEAD request:
The HEAD method is identical to GET except that the server MUST NOT
return a message-body in the response. The metainformation contained
in the HTTP ...
- 64k
3
votes
1
answer
4k
views
curl with chunked Transfer-Encoding
I'm using curl to get a web page with chunked Transfer-Encoding header.
When I execute the command on linux bash (CentOS) I receive the pid of the process and I get back the shell, it seems curl is ...
- 863
1
vote
1
answer
2k
views
Convert HttpEntity.Chunked to Array[String]
I have the following problem.
I am querying a server for some data and getting it back as HttpEntity.Chunked.
The response String looks like this with up to 10.000.000 lines like this:
[{"name":"...
- 623
1
vote
0
answers
736
views
using chunked encoding request with variable chunk size in Java (HttpUrlConnection)
I'm searching for weeks now to find a solution how to use chunked transfer encoding in a Java client without coding my own myHttpURLConnection.
The HttpUrlConnection of Java expects a fixed chunk ...
- 191
7
votes
3
answers
18k
views
Java HTTP server sending chunked response
I am working on a Java application which has a built in HTTP server, at the moment the server is implemented using ServerSocketChannel, it listens on port 1694 for requests:
msvrCh = ...
- 5,742
4
votes
0
answers
2k
views
Golang NewChunkedReader Usage
I'm attempting to process a chunked response from a 3rd-party service by introducing it to httputil.NewChunkedReader:
chunkedReader := httputil.NewChunkedReader(chunkedResponse)
buf := new(bytes....
- 1,586
2
votes
0
answers
393
views
Chunked file uploads in Spray.io?
I have many clients that will upload arbitrarily large files (i.e., let's say up to 5GB). For performance reasons, this has to be done in a streaming way where the clients can split the file into a ...
- 17.4k
0
votes
2
answers
3k
views
Transfer-Encoding: chunked-- Browser does not respond
I have made a very simple web server on my LINUX machine using TCP socket programming in C language.I am sending it a HTTP GET request from a browser(both chrome and mozilla ) from the local machine.
...
- 183
0
votes
1
answer
115
views
Timeouts for ack in spray
In Spray, for chunked response we can send chunked message with an ack like
peer ! MessageChunk(buffer).withAck(MyAck(k))
and we can get ack message back which confirms the message delivery to the ...
- 1,610
0
votes
1
answer
2k
views
Performance of chunked encoding for file transfers
I noticed that chunked encoding is ideal for transfers of web page content where size is unknown. If I'm compelled to use HTTP for file uploads and downloads, is it valid to use the chunked encoding ...
- 509
5
votes
1
answer
2k
views
Handle chunked data sent by Play scala with AngularJs
I send chunked data with Play Scala 2.2 to the client side like this : Ok.chunked(data)
I would like to use them as soon as they are available on the client side. If I just get the data and print ...
- 6,424
1
vote
0
answers
916
views
Use HttpListener to send HTTP trailer in chunked response
I Implemented a HttpListener to process post requests. I need to stream data in the response and then send a trailer. See: HTTP Trailer Example
I've gone through the HttpListenerResponse Source Code ...
- 21
0
votes
2
answers
336
views
How to break bigger chunk into smaller ones to fit into max chunk?
My server is sending me chunked encoded data and I am able to get the chunked response in my client. The problem I am facing is that some chunks are too big, ca 10 MB. I am getting an exception as I ...
- 1,610
1
vote
1
answer
2k
views
Serving Chunked Transfer Coding from flask through nginx
I have some issues serving Chunked Transfer Coding through Nginx.
The data served comes from a flask app running through uwsgi. Here is a sample response that uwsgi gives to a GET request:
0000: 48 ...
- 478
0
votes
1
answer
983
views
A specific Request is not getting recording in Jmeter 2.9
I tried to record a complete screen but unable to record a single Response.
The Screen is for getting live data. So when I clicked on Live Data the page is getting recorded(Jmeter2.9) apart from the ...
14
votes
2
answers
10k
views
HTTP 1.1 - Can a client request that transfers not be "chunked"?
Is it possible for a HTTP 1.1 client to set a header value that indicates the responses to requests should not be chunked? Or is the only way to prevent this, is to send a HTTP 1.0 request? I've tried ...
- 774
26
votes
2
answers
20k
views
Difference between multipart and chunked protocol?
Can some experts explain the differences between the two? Is it true that chunked is a streaming protocol and multipart is not? What is the benefit of using multipart?
- 871
0
votes
0
answers
808
views
http chunked encoding: response works even without the header
According the spec, Transfer-Encoding is required for the chunked behavior to work.
However, during debugging I observe that when the header is not in the response, the client appears to handle it ...
- 31
4
votes
0
answers
725
views
Why is my Rails app using chunked transfer encoding?
I am not using stream anywhere in my app, but responses are still being sent with transfer-encoding: chunked
additional mystery #1: the header is lowercase
additional mystery #2: there is an etag, ...
- 22.7k
16
votes
2
answers
11k
views
Response sent in chunked transfer encoding and indicating errors happening after some data has already been sent
I am sending large amount of data in my response to the client in chunked transfer encoding format.
How should I be dealing with any errors that occur midway during writing of the response?
I ...
- 57.9k
2
votes
2
answers
8k
views
Changing Netty 4 HTTP File Server example to use ChunkedStream instead of ChunkedFile
I'm trying to wrap my head around Netty 4 way of implementing a HTTP Server that serve HttpResponses bodies using chunked transfer-encoding when total data size is unknown.
As a starting point, I ...
- 4,414
1
vote
2
answers
2k
views
Netty - access content of chunked HTTP request (LittleProxy)
I'm intercepting an HTTP request with LittleProxy which uses Netty.
However, now I want to intercept a webservice request that apparently uses chunked transfer encoding.
The HTTP header looks like ...
- 2,070
7
votes
4
answers
5k
views
Django return http early flush (chunked response)
I have an algorithm which waits for almost 5 seconds to generate response and I want to send an ack (http 200) to user as soon as he sends request to tell him that his request has been received and ...
- 2,066
7
votes
1
answer
3k
views
Sending chunked HTTP 1.1 requests in Objective-C
I have the following issue: I am creating a very big SOAP request (the data is a video encoded as Base64 string) and because of that I cannot send it as a raw SOAP request but rather need to send it ...
- 642