All Questions
1 question
0
votes
1
answer
6k
views
pytorch can multithread so why not use python for inference?
I know python has a GIL, so it can only use one cpu for one processing. But pytorch use multi cpu because it uses C++ for multithreading. I guess it works for inference too. so I guess we can use ...