The sparse structure buffers might not always be memrefs with rank == 1 with the presence of batch levels.