What is the solution for the spark cluster version is lower than my project dependency on Gradle

Question

My project should rely on a dependency that used the higher version of httpcore (4.3.2) but uses 4.2.5 in the Spark cluster. After I built a fat jar with the Gradle shadowJar plugin, I found that 4.3.2 is in a thick jar. But when I ran the spark program using spark-submit, 4.2.5 always loaded.

So what is the general solution for handling this kind of usecase: your dependency uses a higher version than Spark.