What are the disadvantages for the large connection pool size for the Python query module?

Question

When installing HTTPAdapteron, requests.Session()I ran into a problem when the connections were eventually dropped, because I issued asynchronous calls (for the same host, that is, belonging to the same connection pool) in batches where each lot size was higher than the maximum pool size. The solution, of course, was to increase the maximum pool size.

I want to know what trade-offs are between issuing fewer iterations of larger lot sizes (with larger pool sizes) compared to larger iterations of smaller lot sizes (with smaller pool sizes). What is wrong: scaling the pool size to infinity and issuing all asynchronous calls (belonging to the same pool) in one batch request?

Answer 1

The connection pool settings are most likely passed directly to . requests.adapters HTTPAdapter urllib3 PoolManager

ConnectionPool . , ... . , . , urllib3 :

, block = True, maxsize . . .