NO! Cover that hole in the back. Your PC is designed to manage air circulation and heat control with that space closed. You can actually cause more heat problems, not to mention additional dust collection, by leaving that hole open. Heat will prematurely age your PC.
Once the metal knockout plate has been removed, it’s best to install a screw in coverplate.
If the tape loosens, the metal knockout may touch the motherboard and short out something.
I have a bunch I salvaged from old computers. If you cannot get a free one from a local computer shop, PM me your address and I’ll mail one to you.