You must implement the module_exit function in your .c file, for example:
static void __exit myexit(void) {} module_exit(myexit);
If you have not already done so before loading your module with insmod , then the only way will be removed to remove this module.
source share