K! lSrSSKJr SSKJr SSKJr SSKrSSKrSSKrSSKrSSK J r J r SSK J r SSK Jr SS KJr SS KJr SS KJr S \4S jrS \4SjrS \ \4SjrS\ \\R64S\ \\4S \ \4SjrS\ \\R644SjrSrSrS\R@S \4Sjr!S\ RDS \4Sjr#S\ \\R64S\S\R@S\ RDS\4 Sjr$S\ \\R64S\S\R@S\ RD4Sjr%S\ \S \4S!jr&g)"z#Utilities for debugging task graph.)absolute_import)division)unicode_literalsN)DictIterator) task_buffer task_graph)log) properties)filesreturncf[RRRR 5$)zqWhether task graph debugging is enabled. Returns: bool: True if task graph debugging is enabled else False. )r VALUESstorageenable_task_graph_debuggingGetBoolClib/googlecloudsdk/command_lib/storage/tasks/task_graph_debugger.pyis_task_graph_debugging_enabledr"s%    " " > > F F HHrcf[RRRR 5$)zGReturns the time interval in seconds between two consecutive snapshots.)r rr&task_graph_debugging_snapshot_durationGetIntrrr#get_time_interval_between_snapshotsr+s'FFMMOrc## [R"5R5HWupSU3v [R"U5H1up#pESUSUSU3v U(dMSUR 53v M3 MY g7f)zARetrieve stack traces for all the threads in the current process.z # Traceback for thread: zFile: "z", line z, in z N)sys_current_framesitems traceback extract_stackstrip) thread_idstackfilename line_numbernametexts ryield_stack_tracesr)2s --/557i &yk 22-6-D-DU-K)thZx }E$ @@ 4::<.!!.L8s AB$Bname_to_threadalive_thread_id_to_namec## UR5H*up#UR5(dMX!UR'M, [5nSn[R "S5nUHPnUR U5=n(a[URS55nXQ;dM<U(a SX3v Uv MR UR5Hup#URU;dMSUS3v M! g7f)z8Yields the stack traces of the alive management threads.Nz^\n# Traceback for thread:(.*)z # Traceback for thread:z # Thread z6 is not running. Cannot get stack trace at the moment.) ris_aliveidentr)recompilematchintgroup) r*r+ thread_namethreadall_threads_stack_tracescurrent_thread_idthread_id_patternlinethread_id_matchs r%_yield_management_thread_stack_tracesr<?s ,113k .9fll+401jj!BC&d+11$777o33A674  .AB D  j',113k ||22  }% 4s)C-A.C-!;C- C-#management_threads_name_to_functionc[RRS5 0n[X5nUH"n[RRU5 M$ g)z.Prints stack traces of the management threads.z=Initiating stack trace information of the management threads.N)r statusPrintr<)r=r+ stack_tracesr:s rprint_management_thread_stacksrBasL**E6),dJJTrc[R"U5nU(ad[R R S5 UR5H0n[R R UR55 M2 g[R R S5 g![aBn[R"SU35 [R R S5 SnAgSnAff=f)z*Prints stack traces of the worker threads.z Error reading stack trace file: z#No stack traces could be retrieved.Nz)Printing stack traces for worker threads:z1No stack traces found. No worker threads running.) r ReadFileContentsIOErrorr errorr?r@ splitlinesr")stack_trace_file_pathrAer:s r print_worker_thread_stack_tracesrJps ))*?@L JJ@A'') jjtzz|$*JJHI  II045JJ:;  sB## C/-8C**C/c$[RRSUR535 [RRSUR535 [RRSUR535 g)zPrints the size of the queues.zTask Queue size: zTask Status Queue size: zTask Output Queue size: N)r r?r@qsize) task_queuetask_status_queuetask_output_queues rprint_queue_sizerPsp**&z'7'7'9&:;<**-.?.E.E.G-HIJ**-.?.E.E.G-HIJrr c6URR5$)z"Checks if the task graph is empty.)is_emptyis_setr s r_is_task_graph_emptyrTs    # # %%r task__bufferc(UR5S:H$)z#Checks if the task buffer is empty.r)size)rUs r_is_task_buffer_emptyrXs     !!rstack_trace_file delay_secondsc>[U5n[U5nSnU(dU(aU(d[U5 [U5 [R R [U55 [R R [U55 [U5n[U5nSnUR5HnUR5(dMSn O [R"5n U RU5 U(aMU(dMU(dMgg)aThe main worker function for the task graph debugging framework. Prints the stack traces of the management threads involved namely iterator_to_buffer, buffer_to_queue and task_output_handler.Captures and prints the contents of the task graph and task buffer. Also prints the stack traces of the worker threads if they are running at the particular snapshot taken. Args: management_threads_name_to_function: A dictionary of management thread name to the thread function. stack_trace_file: Path to the file containing the stack traces of the worker threads. task_graph: The task graph object. task__buffer: The task buffer object. delay_seconds: The time interval between two consecutive snapshots. TFN) rTrXrBrJr r?r@strvaluesr. threadingEventwait) r=rYr rUrZis_task_graph_emptyis_task_buffer_emptyis_some_management_thread_aliver6events rtask_graph_debugger_workerres0-Z8.|<%)!& !"#FG$%56JJS_%JJS&'.z:0>&+#5<<>   *.' ? OO E JJ}+&% ! !rc [R"[UUUU[54S9nUR 5 g![ a#n[ R"SU35 SnAgSnAff=f)z)Starts a thread for task graph debugging.)targetargszError starting thread: N)r^Threadrerstart Exceptionr rF)r=rYr rUthread_for_task_graph_debuggingrIs r%start_thread_for_task_graph_debuggingrmsg-&/&6&6) /    / 1   '#$))+ -II's+,,-s69 A&A!!A&rArHc.U(dg/nUH-nUR5nU(dMURU5 M/ SRU5n[R"X5 g![ a#n[ R"SU35 SnAgSnAff=f)zWrites stack traces to a file.N z2An error occurred while writing stack trace file: )r"appendjoinr WriteFileContentsrkr rF)rArHstripped_stack_entriesentrystripped_entrycontentrIs rwrite_stack_traces_to_filerws   H{{}n %%n5 ii./G 1; HIIB1#FGGHsA'rs*&' !@T#**IIS "HSM "i.../!#s(^c]D )-c93C3C.C)D J&K&%6%@%@&T& " (>(>"4" 4)-c93C3C.C)D44"++4(( 4  4n-)-c93C3C.C)D--"++-(( -0H3-H8;Hr