Uncheck the automatically search for updates which is the default setting; not only could this unregister newer versions it would stop the computer 'phoning home' to the developers site.

Also uncheck the intigrate into windows shell. Allow the user to decide wheter to check this option