This time I tried:
Follow steps at https://developers.google.com/chrome-developer-tools/docs/remote-debugging
Install Windows USB driver http://developer.samsung.com/android/tools-sdks/Samsung-Andorid-USB-Driver-for-Windows (the PC alerted me saying it was already installed but I still did it anyway)
Install the single ADB package required https://docs.google.com/file/d/0B1S0LCuXCnnmSWh6NGJmSE1BUWc/edit)
Go to the ADB install folder which for me was C:\Program Files (x86)\Minimal ADB and Fastboot\
Open command prompt and run adb devices (alternatively I could have run adb start-server but the prior gives a more informational response)
Now, with Chrome open on my phone and chrome://inspect/ open on my desktop I can see the inspect options.
Next problem: I need to repeat the same steps each time I reboot Windows. To solve that issue:
Open a text editor and copy in "C:\Program Files (x86)\Minimal ADB and Fastboot\adb" devices
Save that file as adb.bat in the Windows Startup folder located at C:\ProgramData\Microsoft\Windows\Start Menu\Programs\StartUp