There won't be a single list of OIDs/Names for just "Windows"; you'll need a few different ones (some by MS, some by other entities) depending on the machine and options installed.
You could use something like SNMPWalk to get a full list of all detected OID's.
SnmpWalk allows you to detect a set of variables that are available for reading on a certain device. You can obtain a full list or just part. By analyzing the results of a network device scan obtained with SnmpWalk you can develop a list of supported MIBs and, in this way, obtain full descriptions of variables and possible values.
Also, once you install the SNMP service, you should get a set of MIBs in
Microsoft-defined MIB that contains object types for monitoring the
network traffic between remote hosts and DHCP servers
Contains object types for monitoring and managing host resources
Covers workstation and server services
Contains the Management Information Base (MIB-II), which provides a simple, workable architecture and system for managing TCP/IP-based internets
Microsoft-defined MIB for the Windows Internet Name Service (WINS)
More info from Microsoft here and here.