Timeline for Flushing content to AWS S3 with Java
Current License: CC BY-SA 4.0
5 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Feb 8, 2023 at 15:34 | comment | added | kdgregory | You can't. S3 is an object store, not a filesystem. Objects become available in S3 when they have been fully written, not before. You could play around with multi-part uploads and recover the upload after failure, but this doesn't seem to be what you're asking for (and isn't going to happen automatically in any case). If you need to capture incremental results, either use a filesystem such as EFS, or write smaller files and combine later. | |
Feb 8, 2023 at 10:53 | history | edited | Didac Busquets | CC BY-SA 4.0 |
added 121 characters in body
|
Feb 8, 2023 at 10:52 | comment | added | Didac Busquets | I'd actually like to "flush" it programmatically, so when a certain event occurs in my application, I force the flush (I'll add it to the question). | |
Feb 8, 2023 at 10:51 | comment | added | luk2302 |
If you want the data to be uploaded "earlier" reduce the partSize .
|
|
Feb 8, 2023 at 10:46 | history | asked | Didac Busquets | CC BY-SA 4.0 |