Is it bad practice to write to the registry?

just for settings later and using a standalone executable with no way to remove it? Because I did, I do, and don't care. It just works.

You're using the tool for it's intended purpose. It is correct to write configuration settings in the registry. Removing registry settings is the job of the uninstall routine.