Just bind to IPAddress.Any - as is usually done ... not sure, but maybe you need to bind to IPAddress.IPv6Any .
This SO post assumes that you are attached to each IP address explicitly - and this SO post has a code on how to get all IP addresses ...
From MSDN :
If you do not need which local address is assigned, specify IPAddress.Any for the localaddr parameter, and the primary service provider will assign the most suitable network address.
From MSDN :
IPAddress.Any field
Provides an IP address indicating that the server should listen for client activity on all network interfaces.
source share