You can do this using the Windows Update service. Via Control Panel > Administrative Tools, you can access Services.
In the Services window, scroll down to Windows Update and turn off the process.
To turn it off, right-click on the process, click on Properties and select Disabled. That will take care of Windows Updates not being installed on your machine.
