Wow...that was really odd.
I turned off my DMX controller and back on, and cycled power on my SSR4 and the issue appeared to go away. For testing/programming, I'm using a "real" DMX controller (not run from my computer)
And now I was able to recreate the issue, by moving channels 2-4 up and down, however they are not wired up yet. Still kinda strange behavior. It's not doing it everytime either.