No more to_memref, memref.alloc or memref.dealloc when possible. Differential Revision: https://reviews.llvm.org/D130023