I'm adding this answer for historic reasons. This was an "unofficial convention" often followed in the DOS/Windows 3.x days and for some time afterwards (for all sorts of "keeping files" but having them "invisible" - not only the startup menu).
Overall idea: since Windows uses the file extension(1) to determine how a file should be run(2), changing this extension will prevent the file from being "seen" by the application responsible for that file type(3).
(1) = this is the part of the filename after the last . (period). Up until Windows '95 this was limited to 3 characters. The extension is now hidden by default and e.g. File Explorer's settings need to be changed to show it. (Startup files have a .LNK ("link") extension.)
(2) = or more technically: which program/application/executable should take a file of this extension to run with it as input.
(3) = Programs/applications/executables are associated with files of a certain type, as determined from their extension, under Settings: On my Windows 10 system, I open the Start menu (press the Windows key) then type "assoc" and choose "Choose default applications by file type". On the resulting dialog you will see the extension in the left column and the application in the right column. Still works though.
(a) One will need to change settings, or work in the command line window, to see the files' extensions.
(b) This solution involves changing the filenames (and potentially changing them back, once done).
The "convention" was to create a backup file, by replacing the file's extension with .BAK (for the historical 3-character limit). Since longer filenames have been introduced on Windows, it is probably safer to preserve the original extension and simply appending .BAK (which makes it easier to remove later on without guesswork).
Sometimes it is helpful to also add a timestamp, especially when creating multiple versions of the same file, e.g. .BAK-20211022.
Longer file name limits obviously allow one to use longer extensions, e.g. .Backup-31-May-2021, but lazy typists try to stay as short as possible :-). It is nice to stay consistent though. Also remember that the ISO date format of YYYYMMDD sorts nicely with an alphabetical sort, as may be done in File Explorer or with DIR.