You can see the ECF for the server part. You can set up a publish / subscribe model where only the server can publish, but each of your clients has access to the server subscription.
At this point, I would look at XMPP as a protocol (ECF supports this protocol out of the box). The XMPP plus extensions are what Google uses for Google Voice, so it has been proven and it looks like it will be there for a while. Check out xmpp.org for some Java libraries.
JMF, as JRL is mentioned, is quite old, but can be useful for capturing sound from a microphone and for storing a voice file in a file system.
source share