Closed RunDevelopment closed 9 months ago
It might seem like a lot changed, but that's only because I reordered the code. Otherwise, I changed the following:
depths
num_heads
resi_connection
qkv_bias
split_size_0
split_size_1
a
b
It might seem like a lot changed, but that's only because I reordered the code. Otherwise, I changed the following:
depthsandnum_heads.resi_connectionandqkv_bias.split_size_0andsplit_size_1. This was pretty involved, since the code that determines the shapes from which I gotaandbis pretty complex.