Is the game working with it? If not, then the game is just defaulting to that port. Make sure that the controller doesn't need drivers installed as well. You can also unplug the game controller and see if it dissapears in the harware manager as well. If so, then that port is the port.