why and when to use torch.cuda.Stream()

daiemen 注册会员
6 days ago

I read in a StackOverflow post regarding it. Though it is also how to use. But after reading it, all I got is:

  • Why/When use stream: To parallelize some computations.
  • Best Practices to use the stream: To boost up some really extensive computational tasks through parallelizing. (Mostly; you are welcome to comment if any better answer is found.)


kdfashioninc 注册会员
6 days ago

Streams are sequences of cuda kernels. Operations in different streams may run in parallel. I don't believe they have to use them. They are are just making the code more parallel and thus hopefully faster.

About the Author

Question Info

Publish Time
6 days ago
Update Time
6 days ago

Related Question