You can not.
When you load PE into memory (I assume that you are using MapAndLoad from ImageHlp.pas), it loads modules into memory and loads data, but does not go through and rebuilds all the pointers in this way to the standard Windows bootloader.
The pointers in the app will all be relative addresses that do not actually indicate what they should refer to.
, RVAs , , .