Hello. I am trying to run your code with DIV2K dataset, I leave everything as it is. However, I am having the following issue related to reshaping:
qkv = self.qkv(x).reshape(B, N, 3, self.num_heads, C // self.num_heads).permute(2, 0, 3, 1, 4)
RuntimeError: shape '[16, 9216, 3, 6, 13]' is invalid for input of size 35831808
Hello. I am trying to run your code with DIV2K dataset, I leave everything as it is. However, I am having the following issue related to reshaping:
qkv = self.qkv(x).reshape(B, N, 3, self.num_heads, C // self.num_heads).permute(2, 0, 3, 1, 4)
RuntimeError: shape '[16, 9216, 3, 6, 13]' is invalid for input of size 35831808