For specific channel types, the port assignment is exclusive.
Once a port has been assigned to such a bus or channel, it must not be assigned to another bus. Otherwise, the connection to the first bus is broken.
The corresponding ports are marked in the Audio Connections window on the Device Port pop-up menu.