G_ir$ddlZddlZddlZddlZddlmZddlmZddlm Z ddl m Z ddl m Z ddlmZddlmZdd lmZdd lmZdd lmZmZmZdd lmZmZej<j?d rej@d ejBd ejDdddejFZ$e$jKejDejLdjOe$ej<jQej<jSe*Z+ej<jYe+dZ-ee-ej\dZ/ej\dZ0ej\dZ1dZ2dZ3dZ4dZ5ddZ6y)N) load_dotenv) BeautifulSoup) webdriver)Service)By)Keys)ChromeDriverManager) WebDriverWait)expected_conditions)TimeoutExceptionUnexpectedAlertPresentExceptionNoAlertPresentException) REGION_MAP CAT_CODESz crawler.logz'%(asctime)s [%(levelname)s] %(message)sz%H:%M:%Sutf-8)filenamelevelformatdatefmtencodingz.envUSER_IDUSER_PWTARGET_LOGIN_URLz4https://www.my-auction.co.kr/auction/search_list.phpctj}|jd|jd|jd|jd|jd|jd|jd|jdd |_tjt t j| }|jd |S) Nz --headlessz --no-sandboxz--disable-dev-shm-usagez --disable-gpuz--window-size=1280,720z--disable-extensionsz--dns-prefetch-disablez'--disable-features=VizDisplayCompositorz/usr/bin/google-chrome-stable)serviceoptions) r ChromeOptions add_argumentbinary_locationChromerr installset_page_load_timeout)rdrivers $/var/www/html/land_sniper/crawler.py get_driverr'/s%%'G & ( 23 ) 12 /0 12 BC=G   +-5578F    $ McR t|djtj|jj }|j }tjd||jtjd|S#t$rYyt$rYywxYw)u5혹시 떠있을지 모르는 경고창(Alert) 처리u#🚨 [경고창 감지됨] 내용: u5👉 경고창 '확인'을 눌러서 닫았습니다.N) r untilECalert_is_present switch_toalerttextloggingwarningacceptinfor r)r%r/ alert_texts r& handle_alertr6Hs fa &&r':':'<=  &&ZZ =j\JK  LM  "sB B B&B&%B&c tjd|jtt j d|j dtjdtjd t|djtjtjdf}|jtjd}|j'|j)t*|j'|j)t,tjd|j)t.j0t j dt3|}|rtjd|y|j4}tjd|d|vrntjd|j dt!dd d 5}|j#|j$dddtjdytjdy#t$rWtjd t!d d d 5}|j#|j$dddYy#1swYYyxYwwxYw#1swYxYw#t6$rI}tjd|tjt9j:Yd}~yd}~wwxYw)u&로그인 수행 (과학수사 모드)u-🔑 [1] 로그인 페이지 접속 시도...zdebug_1_login_page.pngu9📸 접속 화면 저장 완료 (debug_1_login_page.png)u)⌨️ [2] 아이디/비번 입력 중... idpasswduA❌ 입력창을 찾을 수 없습니다! (ID='id' 요소 없음)zdebug_error_source.htmlwr)rNFu+🚀 [3] 로그인 정보 전송 (Enter)...u,❌ 로그인 실패 (사이트 메시지): u📍 현재 URL: z login.phpuD⚠️ URL이 여전히 로그인 페이지입니다. 실패 의심!zdebug_2_login_failed.pngzdebug_failed_source.htmluQ📄 현재 페이지 소스를 'debug_failed_source.html'로 저장했습니다.u2✅ 로그인 성공! (페이지 이동 확인됨)Tu!❌ 로그인 중 에러 발생: )r1r4get LOGIN_URLtimesleepsave_screenshotr r+r,presence_of_element_locatedrID find_elementr erroropenwrite page_sourceclear send_keysMY_IDMY_PWrRETURNr6 current_url Exception traceback format_exc)r%id_inputpw_inputf alert_msgrNes r&loginrWXsX= DE 9 1  78 PQ  @A $VR066..t}=H**255(;H 5!5!  BC4;;' 1  (  MMH T U((  ( 67 + % MM` a  " "#= >0#H ,A**+ , LLl m LLM NK   MM] ^/wG ,1**+ , ,  > , ,  9!=> i**,-sA:J/=AIB8J/AJ/0J# J/*J/,J ,JJ J/J J J/J  J/#J,(J// L8?K<<Lc .t}g} tjd|d|d|dt|s7tjd|j g|j St |d}t |dj|d}tj|d }td |d |d |} tjd | |j| tjdt|jd} | jd} | s| jd} tjdt| d} | D]} | |k\rn| j j#}d|vr) | j%d}|s>|j j#}|d}t|dkrl|j'dsd|z}|j)||dj+|j-dd|dd| dz } tjd||j |S#t.$rYwxYw#t.$r"}tjd|Yd}~Gd}~wwxYw#|j wxYw) Nu🤖 크롤러 시작 (지역:  u , 물건: )uQ🚫 로그인 실패로 종료합니다. (로그 및 스크린샷 확인 필요)code sub_regionsr101z ?address1_01=z &address1_02=z &usage_code=u🌐 검색 페이지 접속: r*z html.parserz&form[name='fboardlist'] table tbody trtru!📦 발견된 리스트 개수: ru 대항력za[href*='search_view.php']hrefhttpzhttps://www.my-auction.co.krdu진행) auction_idtitle info_textlinkstatusu - 수집: u❌ 전체 에러: )r'r1r4rWrEquitrr=rBASE_SEARCH_URLr?r@rrHselectlenr0strip select_one startswithappendjoinsplitrO) sido_name gugun_namecat_namelimitr%results sido_code gugun_codecat_code target_urlsoupitemscountitemr0link_taga_idr_rVs r&run_instant_searchrsv \FG= 6yk:,jYaXbbcdeV} MMm n KKMn  iy)&1  *=9==j"M ==51'( i[ j\Yefneop  5j\BC : 1 V//? DEKK%E 8U EF D~u99??$Dd"H ??+GH}}**,'t9q=(v.7UX\7\"&!!$$**,!7!= &    {4&121 @  N   1 +A3/001  snAI/DIII-IIA*I1I IIII I?I:5J:I??JJ)r9)7osr?r1rPdotenvrbs4rseleniumr!selenium.webdriver.chrome.servicerselenium.webdriver.common.byrselenium.webdriver.common.keysrwebdriver_manager.chromer selenium.webdriver.support.uir selenium.webdriver.supportr r,selenium.common.exceptionsr r rmappingsrrpathexistsremove basicConfigINFO StreamHandlerconsolesetLevel getLogger addHandlerdirnameabspath__file__current_folderrqenv_pathgetenvrKrLr>rjr'r6rWrr(r&rsB 5+/87@qq+77>>-  BIIm  ,, 4    '   !" )!:; 77<< / H ) ) BII( ) H2 ?BCr(