I am afraid this is not possible through System.Web.WebSockets.
https://tools.ietf.org/html/rfc7692#section-6
Although you can specify HTTP headers for the release mode, messages must activate the RSV1 bit in order to be identified as compressed:
This document highlights the RSV1 bit of the WebSocket header for PMCEs and calls the bit bit "for each message." On a WebSocket connection that uses PMCE, this bit indicates whether the message is compressed or not.
, , , . HTTP, , , , , , , .
, API- WebSocket ASP.NET , , .
OWIN. , , , , , , IIS8 , HTTP, , , .