f1Y
d Z ddlZddlZddlZddlZddlZdZdZdZdZ dZ
dZ d Z d
Z
d Ze
e e e
egZe
d e d
e de
dediZ ej d Z G d de Z G d de ZeZ G d de Z G d de Z G d de Z G d d e Z G d d e Z G d d e Z d! Z d" Z d.d#Z ej! d$d% Z"defd&Z#d.d'Z$ G d( d)e Z% G d* d+e Z& G d, d-e' Z(dS )/z"Brian Quinlan (brian@sweetapp.com) NFIRST_COMPLETEDFIRST_EXCEPTION
ALL_COMPLETED
_AS_COMPLETEDPENDINGRUNNING CANCELLEDCANCELLED_AND_NOTIFIEDFINISHEDpendingrunning cancelledfinishedzconcurrent.futuresc e Zd ZdZdS )Errorz-Base class for all future-related exceptions.N__name__
__module__ __qualname____doc__ ?/opt/alt/python311/lib64/python3.11/concurrent/futures/_base.pyr r - s 77Dr r c e Zd ZdZdS )CancelledErrorzThe Future was cancelled.Nr r r r r r 1 s ##Dr r c e Zd ZdZdS )InvalidStateErrorz+The operation is not allowed in this state.Nr r r r r r 7 s 55Dr r c * e Zd ZdZd Zd Zd Zd ZdS )_Waiterz;Provides the event that wait() and as_completed() block on.c D t j | _ g | _ d S N) threadingEventeventfinished_futuresselfs r __init__z_Waiter.__init__= s _&&
" r c : | j | d S r! r% appendr' futures r
add_resultz_Waiter.add_resultA $$V,,,,,r c : | j | d S r! r* r, s r
add_exceptionz_Waiter.add_exceptionD r/ r c : | j | d S r! r* r, s r
add_cancelledz_Waiter.add_cancelledG r/ r N)r r r r r( r. r1 r3 r r r r r ; sV EE# # #- - -- - -- - - - -r r c @ e Zd ZdZ fdZ fdZ fdZ fdZ xZS )_AsCompletedWaiterzUsed by as_completed().c t t | t j | _ d S r! )superr5 r( r" Locklock)r' __class__s r r( z_AsCompletedWaiter.__init__M s3
$''00222 N$$ r c | j 5 t t | | | j d d d d S # 1 swxY w Y d S r! )r9 r7 r5 r. r$ setr' r- r: s r r. z _AsCompletedWaiter.add_resultQ s
Y $d + + 6 6v > > > JNN AAA A c | j 5 t t | | | j d d d d S # 1 swxY w Y d S r! )r9 r7 r5 r1 r$ r< r= s r r1 z _AsCompletedWaiter.add_exceptionV
Y $d + + 9 9& A A A JNN r> c | j 5 t t | | | j d d d d S # 1 swxY w Y d S r! )r9 r7 r5 r3 r$ r< r= s r r3 z _AsCompletedWaiter.add_cancelled[ r@ r> ) r r r r r( r. r1 r3
__classcell__r: s @r r5 r5 J s !!% % % % %
r r5 c 6 e Zd ZdZ fdZ fdZ fdZ xZS )_FirstCompletedWaiterz*Used by wait(return_when=FIRST_COMPLETED).c | t | | j d S r! )r7 r. r$ r< r= s r r. z _FirstCompletedWaiter.add_resultc s3
6"""
r c | t | | j d S r! )r7 r1 r$ r< r= s r r1 z#_FirstCompletedWaiter.add_exceptiong 3
f%%%
r c | t | | j d S r! )r7 r3 r$ r< r= s r r3 z#_FirstCompletedWaiter.add_cancelledk rH r )r r r r r. r1 r3 rB rC s @r rE rE ` sp 44 r rE c F e Zd ZdZ fdZd Z fdZ fdZ fdZ xZ S )_AllCompletedWaiterz<Used by wait(return_when=FIRST_EXCEPTION and ALL_COMPLETED).c || _ || _ t j | _ t d S r! )num_pending_callsstop_on_exceptionr" r8 r9 r7 r( )r' rM rN r: s r r( z _AllCompletedWaiter.__init__r s> !2 !2 N$$
r c | j 5 | xj dz c_ | j s| j d d d d S # 1 swxY w Y d S )N )r9 rM r$ r< r& s r _decrement_pending_callsz,_AllCompletedWaiter._decrement_pending_callsx s
Y ! ! " "a ' " ")
!
! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! !s 1AA
A
c r t | | d S r! )r7 r. rQ r= s r r. z _AllCompletedWaiter.add_result~ s3
6""" %%'''''r c t | | j r| j d S | d S r! )r7 r1 rN r$ r< rQ r= s r r1 z!_AllCompletedWaiter.add_exception sV
f%%% ! , JNN ) ) + + + + +r c r t | | d S r! )r7 r3 rQ r= s r r3 z!_AllCompletedWaiter.add_cancelled s3
f%%% %%'''''r )
r r r r r( rQ r. r1 r3 rB rC s @r rK rK o s FF ! ! ! ( ( ( ( (, , , , ,( ( ( ( ( ( ( ( (r rK c $ e Zd ZdZd Zd Zd ZdS )_AcquireFutureszDA context manager that does an ordered acquire of Future conditions.c < t |t | _ d S )N)key)sortedidfutures)r' r[ s r r( z_AcquireFutures.__init__ s g2... r c L | j D ]}|j d S r! )r[
_conditionacquirer, s r __enter__z_AcquireFutures.__enter__ 5 l ( (F % % ' ' ' ' ( (r c L | j D ]}|j d S r! )r[ r] release)r' argsr- s r __exit__z_AcquireFutures.__exit__ r` r N)r r r r r( r_ rd r r r rV rV sG NN/ / /( ( (( ( ( ( (r rV c v |t k rt }n|t k rt }net d | D }|t
k rt
|d }n/|t k rt
|d }nt d|z | D ] }|j
| |S )Nc 3 @ K | ]}|j t t fvV d S r! _stater
r .0fs r <genexpr>z._create_and_install_waiters.<locals>.<genexpr> sH P PGH!7 BB P P P P P Pr T)rN Fz Invalid return condition: %r) r r5 r rE sumr rK r
ValueError_waitersr+ )fs return_whenwaiter
pending_countrk s r _create_and_install_waitersrt s m###%% ' '&(( P PLN P P P P P
/ ) )( $OOOFF
M
)
)( %PPPFF ;k IJJ J
" "
&!!!! Mr c # K | rv| d }|D ]}| | |j 5 |j | ddd n # 1 swxY w Y ~| V | tdS dS )a~
Iterate on the list *fs*, yielding finished futures one by one in
reverse order.
Before yielding a future, *waiter* is removed from its waiters
and the future is removed from each set in the collection of sets
*ref_collect*.
The aim of this function is to avoid keeping stale references after
the future is yielded and before the iterator resumes.
N)remover] ro pop)rp rr ref_collectrk futures_sets r _yield_finished_futuresr{ s
rF& " "K q ! ! ! !
\ & &
J f % % % & & & & & & & & & & & & & & &
ffhh
s AA Ac # & K ||t j z }t | } t | }t | 5 t d | D }| |z
}t | t }ddd n # 1 swxY w Y t | } t ||| f E d{V |r|d}n=|t j z
}|dk r!t dt | |fz |j
| |j 5 |j
}g |_
|j
ddd n # 1 swxY w Y | t ||| |f E d{V || D ];}|j 5 |j | ddd n # 1 swxY w Y <dS # | D ];}|j 5 |j | ddd n # 1 swxY w Y <w xY w)an An iterator over the given futures that yields each as it completes.
Args:
fs: The sequence of Futures (possibly created by different Executors) to
iterate over.
timeout: The maximum number of seconds to wait. If None, then there
is no limit on the wait time.
Returns:
An iterator that yields the given Futures as they complete (finished or
cancelled). If any given Futures are duplicated, they will be returned
once.
Raises:
TimeoutError: If the entire result iterator could not be generated
before the given timeout.
Nc 3 D K | ]}|j t t fv |V d S r! rg ri s r rl z as_completed.<locals>.<genexpr> sE C C8 6 AAA AAAAC Cr )ry r z %d (of %d) futures unfinished)time monotonicr< lenrV rt r listr{ TimeoutErrorr$ waitr9 r% clearreverser] ro rw ) rp timeoutend_time
total_futuresr r rr wait_timeoutrk s r as_completedr s $ T^ - -- RBGGM @ @ C C C C C C C x-,R ?? @ @ @ @ @ @ @ @ @ @ @ @ @ @ @ H~~H **8V8:u> > > > > > > > > > J # '$.*:*: : !##& ; LL-?9 9: : :
L l + + +
%
%!2*,' ""$$$
%
%
%
%
%
%
%
%
%
%
%
%
%
%
%
.x<>=J J J
J
J
J
J
J
J
J' J0 * *A
*
*
!!&)))
*
*
*
*
*
*
*
*
*
*
*
*
*
*
* * * * *A
*
*
!!&)))
*
*
*
*
*
*
*
*
*
*
*
*
*
*
* *sy 4BB B #A>G !(E G EG E 3G GG G H H 7 HH
H
H
HDoneAndNotDoneFuturesz
done not_donec t | } t | 5 d | D }| |z
}|t k r |r t || cddd S |t k r7|r5t d |D r t || cddd S t
| t
| k r t || cddd S t | | }ddd n # 1 swxY w Y |j | | D ];}|j
5 |j | ddd n # 1 swxY w Y <|
|j t || |z
S )an Wait for the futures in the given sequence to complete.
Args:
fs: The sequence of Futures (possibly created by different Executors) to
wait upon.
timeout: The maximum number of seconds to wait. If None, then there
is no limit on the wait time.
return_when: Indicates when this function should return. The options
are:
FIRST_COMPLETED - Return when any future finishes or is
cancelled.
FIRST_EXCEPTION - Return when any future finishes by raising an
exception. If no future raises an exception
then it is equivalent to ALL_COMPLETED.
ALL_COMPLETED - Return when all futures finish or are cancelled.
Returns:
A named 2-tuple of sets. The first set, named 'done', contains the
futures that completed (is finished or cancelled) before the wait
completed. The second set, named 'not_done', contains uncompleted
futures. Duplicate futures given to *fs* are removed and will be
returned only once.
c < h | ]}|j t t fv |S r rg ri s r <setcomp>zwait.<locals>.<setcomp>" s7 F F Fah#98"DDD DDDr Nc 3 j K | ].}| s| *|V /d S r! )r exceptionri s r rl zwait.<locals>.<genexpr>( sP G G++--G,-KKMM,E ,E,E,E,EG Gr )r< rV r r r anyr rt r$ r r] ro rw updater% )rp r rq donenot_donerr rk s r r r s 2
RB > >F F2 F F F9 ? * * *(x88 > > > > > > > > _,,$, G Gd G G G G G
=,T8<<> > > > > > > > t99B (x88> > > > > > > > -R== > > > > > > > > > > > > > > > Lg
& &
\ & &
J f % % % & & & & & & & & & & & & & & & KK'((( rDy 1 11s5 .C45C4 /C4C44C8;C8$E E E c | | | ~ S # | w xY w# ~ w xY wr! )resultcancel)futr s r _result_or_cancelr : sR ::g&& JJLLL
C
JJLLLL
s - A AA A c e Zd ZdZd Zd Zd Zd Zd Zd Z d Z
d Z d
Z dd Z
dd
Zd Zd Zd Z eej Zd S )Futurez5Represents the result of an asynchronous computation.c t j | _ t | _ d| _ d| _ g | _ g | _ dS )z8Initializes the future. Should not be called by clients.N) r" Conditionr] r rh _result
_exceptionro _done_callbacksr& s r r( zFuture.__init__H s< #-//
! r c | j D ]9} || # t $ r t d| Y 6w xY wd S )N!exception calling callback for %r)r ExceptionLOGGERr )r' callbacks r _invoke_callbackszFuture._invoke_callbacksQ ss , L LH
L
L
L
L !DdKKKKK
L L Ls %??c | j 5 | j t k r| j rKd| j j t
| t | j | j j j fz cd d d S d| j j t
| t | j | j j j fz cd d d S d| j j t
| t | j fz cd d d S # 1 swxY w Y d S )Nz <%s at %#x state=%s raised %s>z <%s at %#x state=%s returned %s>z<%s at %#x state=%s>) r] rh r r r: r rZ _STATE_TO_DESCRIPTION_MAPr r& s r __repr__zFuture.__repr__X sh
_ ; ;{h&&? 9; /41$+> 1: ?< < ; ; ; ; ; ; ; ; > /41$+> .7 A9 9 ; ; ; ; ; ; ; ; *N+tHH,T[9-; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;s AC1+>C16.C11C58C5c B | j 5 | j t t fv r ddd dS | j t t
fv r ddd dS t | _ | j ddd n # 1 swxY w Y | dS )zCancel the future if possible.
Returns True if the future was cancelled, False otherwise. A future
cannot be cancelled if it is running or has already completed.
NFT)r] rh r r r r
notify_allr r& s r r z
Future.cancell s _ ) ){w 111 ) ) ) ) ) ) ) ) {y*@ AAA ) ) ) ) ) ) ) ) $DK O & & ( ( ( ) ) ) ) ) ) ) ) ) ) ) ) ) ) )
ts B B %B BBc n | j 5 | j t t fv cddd S # 1 swxY w Y dS )z(Return True if the future was cancelled.N)r] rh r r
r& s r r zFuture.cancelled s
_ F F;9.D"EE F F F F F F F F F F F F F F F F F Fs *..c d | j 5 | j t k cddd S # 1 swxY w Y dS )z1Return True if the future is currently executing.N)r] rh r r& s r r
zFuture.running sx
_ * *;') * * * * * * * * * * * * * * * * * *s %))c z | j 5 | j t t t fv cddd S # 1 swxY w Y dS )z>Return True if the future was cancelled or finished executing.N)r] rh r r
r r& s r r z Future.done s
_ P P;9.Dh"OO P P P P P P P P P P P P P P P P P Ps 044c < | j r | j # d } w xY w| j S r! )r r r& s r __get_resultzFuture.__get_result s1 ?
o% < s c < | j 5 | j t t t fvr(| j | ddd dS ddd n # 1 swxY w Y || dS # t $ r t d| Y dS w xY w)a% Attaches a callable that will be called when the future finishes.
Args:
fn: A callable that will be called with this future as its only
argument when the future completes or is cancelled. The callable
will always be called by a thread in the same process in which
it was added. If the future has already completed or been
cancelled then the callable will be called immediately. These
callables are called in the order that they were added.
Nr )
r] rh r r
r r r+ r r r )r' fns r add_done_callbackzFuture.add_done_callback s _ {9.Dh"OOO$++B/// O H BtHHHHH H H H @$ G G G G G G Hs# 7AA A % A2 2%BBNc | j 5 | j t t fv rt | j t
k r"| cddd d} S | j | | j t t fv rt | j t
k r"| cddd d} S t # 1 swxY w Y d} dS # d} w xY w)aB Return the result of the call that the future represents.
Args:
timeout: The number of seconds to wait for the result if the future
isn't done. If None, then there is no limit on the wait time.
Returns:
The result of the call that the future represents.
Raises:
CancelledError: If the future was cancelled.
TimeoutError: If the future didn't finish executing before the given
timeout.
Exception: If the call raised then that exception will be raised.
N) r] rh r r
r r _Future__get_resultr r r' r s r r z
Future.result sP
)
);9.D"EEE(***[H,, ,,..
)
)
)
)
)
)
) DD $$W---;9.D"EEE(***[H,, ,,..
)
)
)
)
)
)
) DD '..(
)
)
)
)
)
)
)
)
) DDD4DKKKKsB C, AC C, A C ? C, C C C, #C $C, ,C0c | j 5 | j t t fv rt | j t
k r| j cddd S | j | | j t t fv rt | j t
k r| j cddd S t # 1 swxY w Y dS )aU Return the exception raised by the call that the future represents.
Args:
timeout: The number of seconds to wait for the exception if the
future isn't done. If None, then there is no limit on the wait
time.
Returns:
The exception raised by the call that the future represents or None
if the call completed without raising.
Raises:
CancelledError: If the future was cancelled.
TimeoutError: If the future didn't finish executing before the given
timeout.
N) r] rh r r
r r r r r r s r r zFuture.exception s $ _
%
%{y*@ AAA$&&&((
%
%
%
%
%
%
%
%
O ) ) ){y*@ AAA$&&&((
%
%
%
%
%
%
%
% #nn$
%
%
%
%
%
%
%
%
%
%s :B=AB=/B==CCc | j 5 | j t k r9t | _ | j D ]}| | ddd dS | j t k rt | _ ddd dS t dt | | j t d # 1 swxY w Y dS )a Mark the future as running or process any cancel notifications.
Should only be used by Executor implementations and unit tests.
If the future has been cancelled (cancel() was called and returned
True) then any threads waiting on the future completing (though calls
to as_completed() or wait()) are notified and False is returned.
If the future was not cancelled then it is put in the running state
(future calls to running() will return True) and True is returned.
This method should be called by Executor implementations before
executing the work associated with this future. If this method returns
False then the work should not be executed.
Returns:
False if the Future was cancelled, True otherwise.
Raises:
RuntimeError: if this method was already called or if set_result()
or set_exception() was called.
NFTz!Future %s in unexpected state: %szFuture in unexpected state) r] rh r r
ro r3 r r r criticalrZ RuntimeError)r' rr s r set_running_or_notify_cancelz#Future.set_running_or_notify_cancel sH . _ A A{i'' 4 "m / /F((.... A A A A A A A A '' % A A A A A A A A C "4 $ - - - ##?@@@ A A A A A A A A A As =B9 B9<=B99B= B=c | j 5 | j t t t hv r(t d | j | || _ t | _ | j D ]}| | | j
ddd n # 1 swxY w Y | dS )zSets the return value of work associated with the future.
Should only be used by Executor implementations and unit tests.
{}: {!r}N) r] rh r r
r r formatr ro r. r r )r' r rr s r
set_resultzFuture.set_result s
_ ) ){y*@( KKK'
(9(9$+t(L(LMMM!DL"DK -
(
(!!$'''' O & & ( ( ( ) ) ) ) ) ) ) ) ) ) ) ) ) ) )
BB##B'*B'c | j 5 | j t t t hv r(t d | j | || _ t | _ | j D ]}| | | j
ddd n # 1 swxY w Y | dS )zSets the result of the future as being the given exception.
Should only be used by Executor implementations and unit tests.
r N) r] rh r r
r r r r ro r1 r r )r' r rr s r
set_exceptionzFuture.set_exception( s
_ ) ){y*@( KKK'
(9(9$+t(L(LMMM 'DO"DK -
+
+$$T**** O & & ( ( ( ) ) ) ) ) ) ) ) ) ) ) ) ) ) )
r r! )r r r r r( r r r r r
r r r r r r r r classmethodtypes GenericAlias__class_getitem__r r r r r E s ??" " "L L L; ; ;( &F F F
* * *
P P P
H H H(! ! ! !F % % % %D&A &A &AP
!
!
!
!
!
! $ E$677r r c @ e Zd ZdZd ZddddZd
dd d
Zd Zd ZdS )ExecutorzCThis is an abstract base class for concrete asynchronous executors.c t )a Submits a callable to be executed with the given arguments.
Schedules the callable to be executed as fn(*args, **kwargs) and returns
a Future instance representing the execution of the callable.
Returns:
A Future representing the given call.
)NotImplementedError)r' r rc kwargss r submitzExecutor.submit< s "###r NrP )r chunksizec t j z fdt | D fd} | S )a} Returns an iterator equivalent to map(fn, iter).
Args:
fn: A callable that will take as many arguments as there are
passed iterables.
timeout: The maximum number of seconds to wait. If None, then there
is no limit on the wait time.
chunksize: The size of the chunks the iterable will be broken into
before being passed to a child process. This argument is only
used by ProcessPoolExecutor; it is ignored by
ThreadPoolExecutor.
Returns:
An iterator equivalent to: map(func, *iterables) but the calls may
be evaluated out-of-order.
Raises:
TimeoutError: If the entire result iterator could not be generated
before the given timeout.
Exception: If fn(*args) raises for any values.
Nc , g | ]} j g|R S r )r )rj rc r r' s r
<listcomp>z Executor.map.<locals>.<listcomp>` s-
A
A
Akdk"$t$$$
A
A
Ar c 3 h K r`$t V n8t t j z
V `D ]} | d S # D ]} | w xY wr! )r r rx r~ r r )r- r rp r s r result_iteratorz%Executor.map.<locals>.result_iteratord s
$
W / 9 99999 /(T^EUEU:U V VVVV W ! $ $FMMOOOO$ $b $ $FMMOOOO$s A6B B1)r~ r zip)r' r r r iterablesr r rp s ``` @@r mapz Executor.mapG st , !1!11H
A
A
A
A
Ai
A
A
A $ $ $ $ $ $ $ r TF)cancel_futuresc dS )a; Clean-up the resources associated with the Executor.
It is safe to call this method several times. Otherwise, no other
methods can be called after this one.
Args:
wait: If True then shutdown will not return until all running
futures have finished executing and the resources used by the
executor have been reclaimed.
cancel_futures: If True then shutdown will cancel all pending
futures. Futures that are completed or running will not be
cancelled.
Nr )r' r r s r shutdownzExecutor.shutdowns s
r c | S r! r r& s r r_ zExecutor.__enter__ s r c 2 | d dS )NT)r F)r )r' exc_typeexc_valexc_tbs r rd zExecutor.__exit__ s
4
ur )T) r r r r r r r r_ rd r r r r r 9 s MM $ $ $ +/! *! *! *! *! *!X
E
r r c e Zd ZdZdS )BrokenExecutorzR
Raised when a executor has become non-functional after a severe failure.
Nr r r r r r s r r r! ))
__author__ collectionsloggingr" r~ r r r r r r r r r
r _FUTURE_STATESr getLoggerr r r r r r objectr r5 rE rK rV rt r{ r
namedtupler r r r r r r r r r <module>r s- 2
##
1
Y Y
{K j
/ 0 0 I U
-
-
-
-
-f
-
-
- ,
G
( ( ( ( (' ( ( (< ( ( ( ( (f ( ( ( , ,<* <* <* <*| / . 2 2 } 02 02 02 02f r8 r8 r8 r8 r8V r8 r8 r8hO O O O Ov O O Od \ r