The %matpotlib inline displays output results as png images. It may be possible to write some JavaScript for a Jupyter laptop to get the color and pixel on the mouse above the image at the output of the cell.
However, the easiest way is to use the %matplotlib notebook backend, which saves the matplotlib live image when building it on output, and therefore the usual built-in mouseover function is easily accessible.

Pay attention to the collector in the lower right corner of the image, which displays the x , y and the value of the current pixel.
source share