First you need to learn more about the DLL. Is it a WinPE (native) dll with exported functions? Is this a COM server? Or maybe it's a .NET assembly with or without ComVisible types.
A better answer may be provided if there is more information.
For InstallShield:
.NET ComVisible - InstallScript DotNetCoCreateObject().
. .
- DTF .