File|Delete

After you confirm the warning message, File|Delete closes the active file and deletes it from disk.

If Windows keeps a Recycle Bin for the drive the active file is on then the file is deleted by moving it into the Recycle Bin.