tpcp.parallel: Helper for global settings during parallel execution#
A set of helper functions to correctly handle global variables in parallel processes.
Both functions are required as long as joblib/joblib#1071 is not resolved.
The provided workarounds are similar to the ones done in scikit-learn (scikit-learn/scikit-learn#25363).
Note, that these fixes are not necessarily compatible with each other. This means you can not forward custom callbacks through scikit-learn Parallel calls. The same way, by default tpcp will not forward sklearn global configs through tpcp Parallel calls. However, you can likely configure the callbacks in tpcp to make that work.
Functions#
|
Wrap a function to be used in a parallel context. |
|
Register a callback to transfer information to parallel workers. |