Skip to main content
5 events
when toggle format what by license comment
Feb 8, 2023 at 15:34 comment added kdgregory You can't. S3 is an object store, not a filesystem. Objects become available in S3 when they have been fully written, not before. You could play around with multi-part uploads and recover the upload after failure, but this doesn't seem to be what you're asking for (and isn't going to happen automatically in any case). If you need to capture incremental results, either use a filesystem such as EFS, or write smaller files and combine later.
Feb 8, 2023 at 10:53 history edited Didac Busquets CC BY-SA 4.0
added 121 characters in body
Feb 8, 2023 at 10:52 comment added Didac Busquets I'd actually like to "flush" it programmatically, so when a certain event occurs in my application, I force the flush (I'll add it to the question).
Feb 8, 2023 at 10:51 comment added luk2302 If you want the data to be uploaded "earlier" reduce the partSize.
Feb 8, 2023 at 10:46 history asked Didac Busquets CC BY-SA 4.0