All Questions
Tagged with multiprocessing file
3 questions
2
votes
1
answer
86
views
Count features in a file, using parallel code
When processing large files (say for parsing or performing computations based on the contents), we want to be able to use multiple processes to perform the job faster.
In my case I wanted to count ...
- 121
7
votes
1
answer
5k
views
Fast Thread- and multiprocess-safe file operations in python under Linux
I'm trying to implement an alternative to python built-in open(), but safe for use in multi-threaded and multiprocessing environment. I'm using advisory locking, ...
- 73
0
votes
3
answers
217
views
Splitting many data files by quintile
The program below is about finding the values below the percentage and splitting them into five different output files. This works great for small input data files. But when I am trying to run it for ...
- 121