Can a memory address change in the sense of pointers? Yes, but outside the unsafe go package does not set pointers as uints. So, will it look on the map? No.
More details in the specification . The linked section even includes an example map with a pointer.
source
share