o V-@sdZddlmZddlmZddlmZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z zejZWn eyFeZYnwdZGdd d eZGd d d eZGd d d eZGdddeZGdddeZdddddeddfddZddZddZdS)z!Implementation of retrying logic.)absolute_import)division)unicode_literalsN) exceptionsc@seZdZdZddZdS) RetryerStatez+Object that holds the state of the retryer.cCs||_||_||_dS)aInitializer for RetryerState. Args: retrial: int, the retry attempt we are currently at. time_passed_ms: int, number of ms that passed since we started retryer. time_to_wait_ms: int, number of ms to wait for the until next trial. If this number is -1, it means the iterable item that specifies the next sleep value has raised StopIteration. N)retrialtime_passed_mstime_to_wait_ms)selfrr r r ;/tmp/google-cloud-sdk/lib/googlecloudsdk/core/util/retry.py__init__-s  zRetryerState.__init__N)__name__ __module__ __qualname____doc__rr r r r r*s rcs(eZdZdZfddZddZZS)RetryExceptionz#Raised to stop retrials on failure.cs&||_||_||_tt||dSN)message last_resultstatesuperrr)r rrr __class__r r r?szRetryException.__init__cCs dj|j|jj|jj|jjdS)Nzvlast_result={last_result}, last_retrial={last_retrial}, time_passed_ms={time_passed_ms},time_to_wait={time_to_wait_ms})r last_retrialr r )formatrrrr r )r r r r __str__EszRetryException.__str__)rrrrrr __classcell__r r rr r<s rc@eZdZdZdS) WaitExceptionz Raised when timeout was reached.Nrrrrr r r r r Or c@r)MaxRetrialsExceptionz&Raised when too many retrials reached.Nr!r r r r r#Sr"r#c@sReZdZdZdddeddfddZddZddZ  d d d Z  d d d Z dS)Retryerz5Retries a function based on specified retry strategy.NcCs(||_||_||_||_||_||_dS)a>Initializer for Retryer. Args: max_retrials: int, max number of retrials before raising RetryException. max_wait_ms: int, number of ms to wait before raising exponential_sleep_multiplier: float, The exponential factor to use on subsequent retries. jitter_ms: int, random [0, jitter_ms] additional value to wait. status_update_func: func(result, state) called right after each trial. wait_ceiling_ms: int, maximum wait time between retries, regardless of modifiers added like exponential multiplier or jitter. N) _max_retrials _max_wait_ms_exponential_sleep_multiplier _jitter_ms_status_update_func_wait_ceiling_ms)r max_retrials max_wait_msexponential_sleep_multiplier jitter_msstatus_update_funcwait_ceiling_msr r r rZs  zRetryer.__init__cCsR|jdur|j|jkrtd|||jdur%|j|j|jkr'td||dSdS)NReachedTimeout)r%rr#r&r r r )r resultrr r r _RaiseIfStopqs   zRetryer._RaiseIfStopcCsx|}|r:|jr#d}|jdkr|t|||jkr|}n||j|9}|jr/|t|j7}|jr8t||j}|SdS)aGet time to wait after applying modifyers. Apply the exponential sleep multiplyer, jitter and ceiling limiting to the base sleep time. Args: last_retrial: int, which retry attempt we just tried. First try this is 0. sleep_ms: int, how long to wait between the current trials. Returns: int, ms to wait before trying next attempt with all waiting logic applied. l0jy g?r)r'mathlogr(randomr*min)r rsleep_ms wait_time_mshundred_years_msr r r _GetTimeToWaitxs   zRetryer._GetTimeToWaitc sdurnddurnifdd}dur!dd}nfdd}|}|j|||d \} } | r@tj| d | d d | S) aVRetries the function if an exception occurs. Args: func: The function to call and retry. args: a sequence of positional arguments to be passed to func. kwargs: a dictionary of positional arguments to be passed to func. should_retry_if: func(exc_type, exc_value, exc_traceback, state) that returns True or False. sleep_ms: int or iterable for how long to wait between trials. Returns: Whatever the function returns. Raises: RetryException, WaitException: if function is retries too many times, or time limit is reached. Nr cs,z idfWSdtfYSr)sysexc_infor )argsfunckwargsr r TryFuncsz)Retryer.RetryOnException..TryFunccSs |dduS)Nr xsr r r s z*Retryer.RetryOnException..cs.|d}|dur dS|d|d|d|S)NrCFrr )try_func_resultrr>should_retry_ifr r ShouldRetryFuncsz1Retryer.RetryOnException..ShouldRetryFunc)rKr9rCrHtb) RetryOnResultrreraise) r r@r?rArKr9rB should_retryrLr3r>r )r?r@rArKr RetryOnExceptions   zRetryer.RetryOnExceptioncs |dur|nd}|dur|ni}t}d}tr}nfdd}t|tjr-t|} nt|} ||i|} t|} zt| } Wn t yPd} Ynw| || } t || | }|| |sd| S| dkrnt d| ||j rw| | ||| |t| |d 7}q3) aoRetries the function if the given condition is satisfied. Args: func: The function to call and retry. args: a sequence of arguments to be passed to func. kwargs: a dictionary of positional arguments to be passed to func. should_retry_if: result to retry on or func(result, RetryerState) that returns True or False if we should retry or not. sleep_ms: int or iterable, for how long to wait between trials. Returns: Whatever the function returns. Raises: MaxRetrialsException: function retried too many times. WaitException: time limit is reached. Nr rcs|kSrr rDrJr r rGsz'Retryer.RetryOnResult..TzSleep iteration stoprC)_GetCurrentTimeMscallable isinstancecollections_abcIterableiter itertoolsrepeatnext StopIterationr<rr#r)r4_SleepMs)r r@r?rArKr9 start_time_msrrQ sleep_genr3r sleep_from_genr rr rJr rOs<             zRetryer.RetryOnResult)NNNN) rrrr_DEFAULT_JITTER_MSrr4r<rRrOr r r r r$Ws % /r$c sJdurtjtdStfdd}|S)aA decorator to retry on exceptions. Args: f: a function to run possibly multiple times max_retrials: int, max number of retrials before raising RetryException. max_wait_ms: int, number of ms to wait before raising sleep_ms: int or iterable, for how long to wait between trials. exponential_sleep_multiplier: float, The exponential factor to use on subsequent retries. jitter_ms: int, random [0, jitter_ms] additional value to wait. status_update_func: func(result, state) called right after each trail. should_retry_if: func(exc_type, exc_value, exc_traceback, state) that returns True or False. Returns: A version of f that is executed potentially multiple times and that yields the first returned value or the last exception raised. N)r-r.r+r,rKr9r/c sptd}z |j||dWSty7}z|jd}tj|d|ddWYd}~dSd}~ww)N)r+r,r-r.r/)r?rArKr9rCrHrM)r$rRr#rrrP)r?rAretryermre to_reraiser-fr.r+r,rKr9r/r r DecoratedFunction*s"  $z+RetryOnException..DecoratedFunction) functoolspartialrRwraps) rgr+r,r9r-r.r/rKrhr rfr rRs rRcCsttdS)Nr)inttimer r r r rT=srTcCst|ddS)Ng@@)rmsleep)r r r r r^Asr^)r __future__rrr collectionsrirZr5r7r=rmgooglecloudsdk.corerabcrWAttributeErrorrbobjectr Exceptionrr r#r$rRrTr^r r r r s@      / 8