1·
18 days agoModels are computed sequentially (the output of each layer is the input into the next layer in the sequence) so more GPUs do not offer any kind of performance benefit
- 0 Posts
- 2 Comments
Joined 9 months ago
Cake day: June 13th, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
What I am talking about is when layers are split across GPUs. I guess this is loading the full model into each GPU to parallelize layers and do batching