{ iIdZddlZddlZddlZddlmZddlmZmZm Z ddl m Z GddeZ Gdd Z Gd d ZdS) z Page Management System - Intelligent Page State and Pool Management This module provides intelligent page management for handling multiple tabs with state tracking, busy detection, and recovery mechanisms. N)Enum)OptionalDictList)Pagec*eZdZdZdZdZdZdZdZdZ dS) PageStatezPage state enumeration.idlebusyerrorcrashedloadingstuckN) __name__ __module__ __qualname____doc__IDLEBUSYERRORCRASHEDLOADINGSTUCK8/home/byschii/byschiidev/penelope/lib/page_management.pyr r s2!! D D EGG EEErr ceZdZdZdedefdZdefdZdefdZ defdZ defd Z dd e defd Z ddedeefdZdefdZdZdefdZdZdefdZdde defdZdZdZd S) ManagedPagezK Wrapper for Playwright Page with state management and monitoring. pagepage_idcR||_||_tj|_d|_d|_d|_tj|_ tj |_ d|_ d|_|jd|jddS)z Initialize managed page. Args: page (Page): Playwright page instance page_id (str): Unique identifier for this page Nri`)rr r rstatecurrent_operationoperation_start_time error_counttime last_activityasyncioLocklocklast_known_mouse_xlast_known_mouse_yset_default_timeoutset_default_navigation_timeout)selfrr s r__init__zManagedPage.__init__!s  ^ 0459!!Y[[LNN "#"# %%e,,, 0077777rreturnc,|jtjkS)z Check if page is currently busy.)r"r rr/s ris_busyzManagedPage.is_busy9zY^++rc,|jtjkS)z.Check if page is available for new operations.)r"r rr3s r is_availablezManagedPage.is_available=r5rc6K |jr|jtjkrdS|jdd{VdS#t $rJ}t d|jd||tjd{VYd}~dSd}~wwxYw)z Check if page is responsive and ready for operations. Returns: bool: True if page is responsive, False otherwise Fz() => document.readyStateNTu ⚠️ Page z responsiveness check failed: ) rr"r revaluate Exceptionprintr _set_state)r/es r is_responsivezManagedPage.is_responsiveAs 9  i.? ? ?u)$$%@AA A A A A A A A4    PPPQPP Q Q Q//)"344 4 4 4 4 4 4 455555 sA A B?BBcK |jr|jtjkrdS|jdd{V}|ddS#t $rYdSwxYw)z#Check if page is currently loading.Fz () => { return { readyState: document.readyState, loading: document.readyState !== 'complete' } } Nr)rr"r rr9getr:)r/ loading_infos r is_loadingzManagedPage.is_loadingUs 9  i.? ? ?u!%!3!35""L ##Iu55 5   55 sA5A A&%A&,max_operation_timec|jtjkr(|jr!t j|jz }||kSdS)a  Check if current operation has been running too long. Args: max_operation_time (int): Maximum operation time in seconds (default: 5 minutes) Returns: bool: True if operation appears stuck F)r"r rr$r&)r/rDoperation_durations ris_stuckzManagedPage.is_stuckis@ : ' 'D,E '!%t/H!H %(:: :urN new_state operationcK|j4d{V|j}||_tj|_|tjkr:||_tj|_td|j d|n|tj kr7d|_d|_|tjkrtd|j dnx|tj kr9|xj dz c_ |rd|nd|_td|j d|n/|tj krd |_td|j d dddd{VdS#1d{VswxYwYdS) zThread-safe state change.Nu 📄 Page z is now BUSY with: z is now IDLEzERROR: rz is now in ERROR state: rz is now CRASHED)r*r"r&r'r rr#r$r;r rrr%r)r/rHrI old_states rr<zManagedPage._set_statexs/9 B B B B B B B B I"DJ!%D IN**)2&,0IKK)O4<OOIOOPPPPin,,)-&,0) ..At|AAABBBio--  A%  BK)X)>9)>)>)>QX&T4<TTTTUUUUi///)2&@4<@@@AAA/ B B B B B B B B B B B B B B B B B B B B B B B B B B B B B BsD0E E EcVK|tj|d{VdS)z*Mark page as busy with specific operation.N)r<r r)r/rIs rset_busyzManagedPage.set_busys4ooini88888888888rcTK|tjd{VdS)z/Mark page as idle and ready for new operations.N)r<r rr3s rset_idlezManagedPage.set_idles2ooin-----------rr cVK|tj|d{VdS)zMark page as in error state.N)r<r r)r/r s r set_errorzManagedPage.set_errors4ooiou55555555555rcTK|tjd{VdS)zMark page as crashed.N)r<r rr3s r set_crashedzManagedPage.set_crasheds3ooi/00000000000rc &K |jr&|d{Vr |jjnd}|jr9|d{Vr|jd{Vnd}n #d}d}YnxYwd}|jrt j|jz }|j|jj|j ||d{V| d{V| |j |j ||d S)z%Get detailed page status information.N) r r"r#rF responsiverrr%r'urltitle)rr>rWrXr$r&r r"valuer#rBrGr%r')r/ current_url current_titlerFs r get_statuszManagedPage.get_statussY !+/9]t?Q?Q?S?S9S9S9S9S9S9S]$)--Y]K7;yi4K]K]K_K_E_E_E_E_E_E_i$)//"3"33333333eiMM !K MMM!  $ I!%t/H!H |Z%!%!7"4 $ 2 2 4 4444444!__........]]__+!/"   s A1A66A>timeoutcKtj}tj|z |krJ|rdStjdd{Vtj|z |kJdS)z Wait until page is ready for new operations. Args: timeout (int): Maximum time to wait in seconds Returns: bool: True if page became ready, False if timeout T?NF)r&r7r(sleep)r/r^ start_times rwait_until_readyzManagedPage.wait_until_readysY[[ ikkJ&00  "" t-$$ $ $ $ $ $ $ $ikkJ&00 urcXKtd|jd|j4d{V|j}tj|_d|_d|_tj|_ dddd{Vn#1d{VswxYwYtd|jd|j ddS)z?Force page recovery by resetting state and clearing operations.u🔧 Force recovering page z...Nu 🔄 Page z recovered from z to IDLE) r;r r*r"r rr#r$r&r'rY)r/rLs rforce_recoveryzManagedPage.force_recoverys5 =DL===>>>9 - - - - - - - - I"DJ%)D "(,D %!%D   - - - - - - - - - - - - - - - - - - - - - - - - - - - R4<RRRRRSSSSSs?A99 BBc^d|jd|jjd|jr |jjnddS)Nz)r r"rYrrWr3s r__repr__zManagedPage.__repr__s<v$,vvtz7Gvv_c_hNsdimmnsvvvvr)rCN)r])rrrrrstrr0boolr4r7r>rBintrGr rr<rNrPrRrTdictr\rcrerhrrrrrs8T8C88880,,,,,,d,,,,T($(  3     BB)B BBBB699999...6S6666111 $    6c4& T T TwwwwwrrceZdZdZddefdZdZdZddefd Zdd e e d e fd Z de fdZ dded e e fdZde d e e fdZdde e d e fdZdZdZd efdZdZd S)IntelligentPagePoolzj Intelligent page pool that manages multiple tabs with automatic recovery and load balancing.  max_pagescn||_||_i|_d|_t j|_dS)z Initialize page pool. Args: browser_context: Playwright browser context initial_pages (int): Number of pages to create initially max_pages (int): Maximum number of pages allowed rN)browser_contextrqpages page_counterr(r) pool_lock)r/rsrqs rr0zIntelligentPagePool.__init__s3 /"-/  rchK|jd|jtddS)z Setup browser context event listeners. Listens for: - New pages created (manual user tabs, popups, etc) - Auto-registers orphaned pages with generated IDs ru)📡 Browser context listeners configuredN)rson_on_page_createdr;r3s rsetup_listenersz#IntelligentPagePool.setup_listenerss9 (=>>> 9:::::rc tfd|jDrtddSt t jdz}dtjdd}d |d |}td |t|}||j|<td |d t|jd|j d| |dS)ax Handle new page created in browser context. This fires when: - User clicks + button to create new tab - User opens a popup (window.open) - Links open in new tab We auto-register these orphaned pages so the pool stays in sync. Args: page: The newly created Playwright page c3.K|]}|jkVdSri)r).0mprs r z7IntelligentPagePool._on_page_created..s)==2rw$======ru-📄 Page already tracked, ignoring duplicateNabcdef0123456789)kauto__u:🆕 Detected new page created by user, auto-registering: u✅ Orphaned page registered:  (/)) anyrtvaluesr;rlr&joinrandomchoicesrlenrq_attach_close_handler)r/r timestamp random_suffix auto_page_id managed_pages ` rryz$IntelligentPagePool._on_page_createds$ ====):):)<)<=== = =  B C C C F  d*++ /AQ G G GHH :y::=::  Y<YYZZZ#466 $0 <  b|bbs4:bbQUQ_bbbccc ""<00000rrK initial_pagescK|d{Vt|D]}|d{VdS)z Initialize pages asynchronously.N)rzrange _create_page)r/rrs r initializezIntelligentPagePool.initialize)sv""$$$$$$$$$}%% & &A##%% % % % % % % % % & &rNcustom_page_idr1c xK|j4d{V|r||jvrtd|d|}nF|xjdz c_d|j}||jvr#|xjdz c_d|j}||jv# t |j|jkrtd|jd|s?|jdkr4t |jdr|jjr|jjd }n|jd{V}t||}||j|<| |td |d t |jd |jd |cdddd{VS#t$r}td|d|d}~wwxYw#1d{VswxYwYdS)zFCreate a new managed page, reusing the initial Firefox page if needed.NzPage with ID 'z' already existsrKpage_zMaximum page limit (z") reached. Cannot create new page.rtru📄 Created new page: rrru❌ Failed to create page : ) rvrtr:rurrqhasattrrsnew_pagerrr;)r/rr playwright_pagerr=s rrz IntelligentPagePool._create_page2s>, , , , , , , ,  :!TZ//#$U^$U$U$UVVV(!!Q&!!5$"355++%%*%%9d&799G++ tz??dn44#$m4>$m$m$mnnn&L$*;q*@*@WTMacjEkEk*@ptqEqK*@&*&:&@&COO,0,@,I,I,K,K&K&K&K&K&K&KO +?GDD &2 7#**<888^^^3tz??^^T^^^^___#Q, , , , , , , , , , , , , , T   A7AAaAABBB U, , , , , , , , , , , , , , , , s1A(F)9C5F F& F!!F&&F)) F36F3rcjfd}jd|tddS)a Attach a close event listener to a page. When user closes the tab in browser (clicks X button), this handler: 1. Removes page from pool immediately to prevent stale references 2. Marks page as CRASHED for any lingering API references 3. Logs the event for debugging Args: managed_page (ManagedPage): The managed page to attach listener to ctddjvrj=tdd tj_tdddS#YdSxYw)z/Callback when page is closed by user in browseru 🔴 Page z& was closed by user (browser X button)u🗑️ Page z removed from poolu 💥 Page z marked as CRASHEDN)r;rtr rr")rr r/sron_closez;IntelligentPagePool._attach_close_handler..on_closeps NwNNN O O O$*$$Jw'BwBBBCCC %.%6 ">7>>>????? s $A A%closeu+📌 Close event listener attached to page N)r rrxr;)r/rrr s`` @rrz)IntelligentPagePool._attach_close_handlerbsj&       $ Wh/// EGEEFFFFFr wait_timeoutc Ktj}dttjdzdz}td|dt|jtj|z |krzd|jD}td|d||jD]4}|rtd|d |j|cS5t|j|j krwtd|d t|jd |j d  | d {VS#t$r}td|d|Yd }~nd }~wwxYwtd|dtj|z ddtj dd {Vtj|z |kztd|dd S)z6 Get an available page from the pool. req_ri'u🔍 [z-] Searching for available page... Pool size: c.i|]\}}||jjSr)r"rY)r}pidrs r z:IntelligentPagePool.get_available_page..s#UUUYS$3 0UUUrz] Current page states: u📄 [z] Using available page: z] Creating new page (rrNu⚠️ [z] Failed to create new page: u⏳ [z"] No pages available, waiting... (z.1fzs)r`z#] No pages available within timeout)r&rlr;rrtitemsrr7r rqrr:r(ra)r/rrb request_id page_statesrr=s rget_available_pagez&IntelligentPagePool.get_available_pagesrY[[ =C d 233e;==  azaaPSTXT^P_P_aabbbikkJ&55UU$*BRBRBTBTUUUK K:KKkKK L L L ))++  $$&& U:UUt|UUVVVKKK 4://czccDJccRVR`cccdddS!%!2!2!4!44444444 SSSQZQQaQQRRRRRRRRS h*hh V`H`hhhh i i i-$$ $ $ $ $ $ $ $)ikkJ&55, HHHHIIItsE// F9FFr c6|j|S)zGet specific page by ID.)rtr@r/r s rget_page_by_idz"IntelligentPagePool.get_page_by_idsz~~g&&&rc>K||d{VS)ai Create a new page with optional custom ID. Args: page_id (str, optional): Custom page ID. If None, auto-generated ID will be used. Returns: ManagedPage: The newly created managed page Raises: Exception: If page creation fails or page limit exceeded )rN)rrs r create_pagezIntelligentPagePool.create_pages1&&g&>>>>>>>>>rcK|jD]G}|r1td|j|d{VHdS)z&Recover pages that appear to be stuck.u🔧 Recovering stuck page: N)rtrrGr;r re)r/rs rrecover_stuck_pagesz'IntelligentPagePool.recover_stuck_pagess{J%%'' , ,D}} ,CT\CCDDD))+++++++++ , ,rcKd|jD}|D]O}td| |j|jd{Vn#YnxYw|j|=PdS)z#Remove crashed pages from the pool.cBg|]\}}|jtjk|Sr)r"r r)r}r rs r z=IntelligentPagePool.cleanup_crashed_pages..s6   %zY... ...ru🗑️ Removing crashed page: N)rtrr;rr)r/ crashed_pagesr s rcleanup_crashed_pagesz)IntelligentPagePool.cleanup_crashed_pagess  )-)9)9););   % $ $G =G== > > > j).446666666666  7##  $ $s *A((A,c(Ki}g}|jD]U}|d{V}|||d}||ddz||<Vt |j|j||dS)zGet comprehensive pool status.Nr"rrK) total_pagesrqstatus_by_statert)rtrr\appendr@rrq)r/r page_statusesrstatusr"s rget_pool_statusz#IntelligentPagePool.get_pool_statuss J%%'' G GD??,,,,,,,,F   ( ( (7OE%4%8%8%B%BQ%FOE " "tz??."    rcrKtd|jD]c\}} td||jd{V8#t $r}td|d|Yd}~\d}~wwxYw|jtddS)zClose all pages in the pool.u!🔒 Closing all pages in pool...u📄 Closing page: Nu⚠️ Error closing page ru✅ All pages closed)r;rtrrrr:clear)r/r rr=s rclose_all_pagesz#IntelligentPagePool.close_all_pagess 1222!Z--// C CMGT C5G55666ioo'''''''''' C C CA7AAaAABBBBBBBB C  $%%%%%s1A## B -BB )rp)rKri)r)rrrrrlr0rzryrrrjrrrrrrrrrmrrrrrroros ( (3 ( ( ( ( ; ; ;$1$1$1L&&c&&&&..#.+....`!G+!G!G!G!GFS(;BWB'c'h{.C''''??#?+???? ,,, $ $ $ t    & & & & & &rro)rr&r(renumrtypingrrrpatchright.async_apirr rrorrrrs   ''''''''''&&&&&&CwCwCwCwCwCwCwCwLM&M&M&M&M&M&M&M&M&M&r