AV Famicom Controller Port not working after RGBNES mod

I recently RGBNES modded my AV Famicom and it is displaying fine. Whenever I plug in my US model NES controller none of the buttons respond. When I plug in or unplug the controller it acts like I pressed the start button. It will do this even when I insert the controller plug about half way in.

The only thing I noticed is the ground wire that goes from the AV multi out connector to the NESRGB came loose. Soldered it back on and I am still having the issue. Could that have caused a controller port component or part on the board to fry? Also, the controller was tested on my other NES and is working fine. What might need replacing or repair?