1
Try uninstalling Google Play from the Settings App - Apps Installed Apps.
2
If that is not successful, open the old Control Panel, set view to large icons and then open the Programs and Features applet, and try uninstalling the Google Play app from there.
3
If that is also unsuccessful, downlaod the widely available version of Revo Uninstaller and try uninstalling the app using that utility.