T=j@SrSSKJr SSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK JrJrJrJr SSKJr SSKJr SSKJr SSKJrJr SS KJr SS KJr SS KJ r SS K!J"r"J#r#J$r$J%r%J&r&J'r' SS K(J)r) SSK*J+r+ SSK,J-r- SSK.J/r/ SSK0J1r1 SSK2J3r3 SSK4J5r5 SSK6J7r7 SSK8J9r9J:r:J;r; \ Rx"\=5r>\\?\?4r@S5SjrA"SS\B5rCS6SjrD"SS\B5rES7SjrFS8S9SjjrGS:S jrH"S!S"5rI"S#S$\5rJS;S%jrK\KSS-jjrOS?S@S.jjrPSS/.SAS0jjrQ"S1S2\5rR"S3S45rSg)BzO The main purpose of this module is to expose LinkCollector.collect_sources(). ) annotationsN)CallableIterableMutableMappingSequence) dataclass) HTMLParser)Values) NamedTupleProtocol)canonicalize_name)Response) RetryError)ConnectionFailedErrorConnectionTimeoutErrorNetworkConnectionErrorProxyConnectionErrorSSLMissingErrorSSLVerificationError)Link) SearchScope) PipSession)raise_for_status)is_archive_fileredact_auth_from_url) url_to_path)vcs)CandidatesFromPage LinkSource build_sourcec[RH?nUR5RU5(dM)U[ U5S;dM=Us $ g)z_Look for VCS schemes in the URL. Returns the matched VCS scheme, or None if there's no match. z+:N)rschemeslower startswithlen)urlschemes a/Users/stevendouglas/BidBrain/.venv/lib/python3.13/site-packages/pip/_internal/index/collector.py_match_vcs_schemer+4sC ++ 99; ! !& ) )c#f+.>$.FM c,^\rSrSrSU4SjjrSrU=r$)_NotAPIContent?c<>[TU]X5 XlX lgN)super__init__ content_type request_desc)selfr4r5 __class__s r*r3_NotAPIContent.__init__@s 4((r,)r4r5)r4strr5r9returnNone)__name__ __module__ __qualname____firstlineno__r3__static_attributes__ __classcell__r7s@r*r.r.?s ))r,r.cURRSS5nUR5nURS5(ag[ XR R 5e)z Check the Content-Type header to ensure the response contains a Simple API Response. Raises `_NotAPIContent` if the content type is not a valid content-type. Content-TypeUnknown)z text/htmlz#application/vnd.pypi.simple.v1+html#application/vnd.pypi.simple.v1+jsonN)headersgetr%r&r.requestmethod)responser4content_type_ls r*_ensure_api_headerrMFs^##'' BL!'')N     '7'7'>'> ??r,c\rSrSrSrg)_NotHTTP\N)r<r=r>r?r@rQr,r*rOrO\sr,rOc[RRU5up#pEnUS;a [5eUR USS9n[ U5 [ U5 g)z Send a HEAD request to the URL, and ensure the response contains a simple API Response. Raises `_NotHTTP` if the URL is not available for a HEAD request, or `_NotAPIContent` if the content type is not a valid content type. >httphttpsT)allow_redirectsN)urllibparseurlsplitrOheadrrM)r(sessionr)netlocpathqueryfragmentresps r*_ensure_api_responser``sR-3LL,A,A#,F)FD &&j <<T< 2DTtr,Fc[[U5R5(a [XS9 [R S[ U55 SSR/SQ50nU(a[R S5 SUS'URXS 9n[U5 [U5 [R S [ U5URRS S 55 U$) a5Access an Simple API response with GET, and return the response. This consists of three parts: 1. If the URL looks suspiciously like an archive, send a HEAD first to check the Content-Type is HTML or Simple API, to avoid downloading a large file. Raise `_NotHTTP` if the content type cannot be determined, or `_NotAPIContent` if it is not HTML or a Simple API. 2. Actually perform the request. Raise HTTP exceptions on network failures. 3. Check the Content-Type header to make sure we got a Simple API response, and raise `_NotAPIContent` otherwise. )rZzGetting page %sAcceptz, )rFz*application/vnd.pypi.simple.v1+html; q=0.1ztext/html; q=0.01z"Refreshing package index response.z max-age=0z Cache-Control)rGzFetched page %s as %srDrE) rrfilenamer`loggerdebugrjoinrHrrMrG)r(rZforce_revalidaterGr_s r*_get_simple_responserhrs"tCy))**S2 LL"$8$=> $))  G  9:#. ;;s; ,DTt LLS! 3 Kr,cU(aOSU;aI[RR5nUSUS'URS5nU(a [ U5$g)z=Determine if we have any encoding information in our headers.rDz content-typecharsetN)emailmessageMessage get_paramr9)rGmrjs r*_get_encoding_from_headersrpsK>W, MM ! ! ##N3.++i( w<  r,c2\rSrSrSSjrSSjrS SjrSrg) CacheablePageContentc6UR(deXlgr1)cache_link_parsingpager6rvs r*r3CacheablePageContent.__init__s&&&& r,c[U[U55=(a- URRURR:H$r1) isinstancetypervr()r6others r*__eq__CacheablePageContent.__eq__s-%d,P%**..1PPr,c@[URR5$r1)hashrvr(r6s r*__hash__CacheablePageContent.__hash__sDIIMM""r,)rvN)rv IndexContentr:r;)r|objectr:bool)r:int)r<r=r>r?r3r}rr@rQr,r*rrrrsQ#r,rrc\rSrSrSSjrSrg) ParseLinkscgr1rQrws r*__call__ParseLinks.__call__scr,rQNrvrr:zIterable[Link])r<r=r>r?rr@rQr,r*rrsAr,rc^^[RSU4Sjj5m[R"T5SUU4Sjj5nU$)z Given a function that parses an Iterable[Link] from an IndexContent, cache the function's result (keyed by CacheablePageContent), unless the IndexContent `page` has `page.cache_link_parsing == False`. c:>[T"UR55$r1)listrv)cacheable_pagefns r*wrapper*with_cached_index_content..wrappersB~**+,,r,cj>UR(aT"[U55$[T"U55$r1)rurrr)rvrrs r*wrapper_wrapper2with_cached_index_content..wrapper_wrappers+  " "/56 6BtH~r,)rrrr: list[Link])rvrr:r) functoolscachewraps)rrrs` @r*with_cached_index_contentrs@__--__R r,rc#~# URR5nURS5(ac[R"UR 5nUR S/5H,n[R"X0R5nUcM(Uv M. g[UR5nUR=(d SnURUR RU55 URnUR=(d UnURH!n [R "XUS9nUcMUv M# g7f)zT Parse a Simple API's Index Content, and yield its anchor elements as Link objects. rFfilesNzutf-8)page_urlbase_url)r4r%r&jsonloadscontentrHr from_jsonr(HTMLLinkParserencodingfeeddecoderanchors from_element) rvrLdatafilelinkparserrr(ranchors r* parse_linksrs &&,,.N  !FGGzz$,,'HHWb)D>>$1D|J *  DHH %F}}'H KK ##H-. ((C%#H..  I <  !sD;D=T)frozencZ\rSrSr%SrS\S'S\S'S\S'S\S 'S rS \S 'SS jrSrg)ratRepresents one response (or page), along with its URL. :param encoding: the encoding to decode the given content. :param url: the URL from which the HTML was downloaded. :param cache_link_parsing: whether links parsed from this page's url should be cached. PyPI index urls should have this set to False, for example. bytesrr9r4 str | Nonerr(Trruc,[UR5$r1)rr(rs r*__str__IndexContent.__str__ s#DHH--r,rQN)r:r9) r<r=r>r?__doc____annotations__rurr@rQr,r*rrs/N H##.r,cD^\rSrSrSrSU4SjjrSSjrS SjrSrU=r $) rizZ HTMLParser that keeps the first base HREF and a list of all anchor elements' attributes. cH>[TU]SS9 XlSUl/Ulg)NT)convert_charrefs)r2r3r(rr)r6r(r7s r*r3HTMLLinkParser.__init__s& $/$( 46 r,cUS:Xa)URcURU5nUbX0lggUS:Xa%URR[ U55 gg)Nbasea)rget_hrefrappenddict)r6tagattrshrefs r*handle_starttagHTMLLinkParser.handle_starttagsR &=T]]2=='D $  CZ LL  U ,r,c.UHup#US:XdM Us $ g)NrrQ)r6rnamevalues r*rHTMLLinkParser.get_href#s KDv~ !r,)rrr()r(r9r:r;)rr9rlist[tuple[str, str | None]]r:r;)rrr:r) r<r=r>r?rr3rrr@rArBs@r*rrs 7-r,rc<Uc[RnU"SX5 g)Nz%Could not fetch URL %s: %s - skipping)rdre)rreasonmeths r*_handle_get_simple_failr*s  ||| 0$?r,c[UR5n[URURSUURUS9$)NrD)rr(ru)rprGrrr()rKrurs r*_make_index_contentr4sE*(*:*:;H ( LL-  r,)rgcURRSS5Sn[U5nU(a[R SUU5 gUR S5(a~[ RR[U55(aQURS5(dUS- n[RRUS5n[RSU5 [X1US 9n[!XPR"S 9$![$a [R S U5 g[&a6n[R S UUR(UR*5 SnAgSnAf[,[.4an[1X5 SnAgSnAf[2[44a1nS UR63n[1X[R8S9 SnAgSnAf[:a#n[1USUR635 SnAgSnAf[<a#n[1USUR635 SnAgSnAf[>a)n[1U[AUR655 SnAgSnAff=f)N#rrzICannot look at %s URL %s because it does not support lookup as web pages.zfile:/z index.htmlz# file: URL is directory, getting %srZrg)ruz`Skipping page %s because it looks like an archive, and cannot be checked by a HTTP HEAD request.zSkipping page %s because the %s request got Content-Type: %s. The only supported Content-Types are application/vnd.pypi.simple.v1+json, application/vnd.pypi.simple.v1+html, and text/htmlz4There was a problem confirming the ssl certificate: )rzconnection error: zproxy connection error: )!r(splitr+rdwarningr&osr\isdirrendswithrVrWurljoinrerhrrurOr.r5r4rrrrrcontextinforrrr9)rrZrgr( vcs_schemer_excrs r*_get_index_contentrAs ((..a  #C#3'J W    ~~g277==S1A#B#B||C  3JC ll""3 5 :C@U# 3C <#4r?rr@rQr,r*rrs++++r,rc\rSrSrSrS Sjr\S S Sjj5r\S Sj5r SSSjjr SSjr S r g) LinkCollectoriz Responsible for collecting Link objects from all configured locations, making network requests as needed. The class's main method is its collect_sources() method. cX lXlgr1 search_scoperZ)r6rZrs r*r3LinkCollector.__init__s ) r,cDUR/UR-nUR(a5U(d.[R SSR SU555 /nUR =(d /n[R"UUURS9n[UUS9nU$)z :param session: The Session to use to make requests. :param suppress_no_index: Whether to ignore the --no-index option when constructing the SearchScope object. zIgnoring indexes: %s,c38# UHn[U5v M g7fr1r).0r(s r* 'LinkCollector.create..sIjs-c22js)rrno_index)rZr) index_urlextra_index_urlsrrdrerfrrcreater)clsrZoptionssuppress_no_indexrrrlink_collectors r*rLinkCollector.creates''(7+C+CC   $5 LL&IjII J''-2 "))!!%% '% r,c.URR$r1)rrrs r*rLinkCollector.find_linkss  +++r,NcURRnSU;=(d USL=(a [U5U;n[UURUS9$)z. Fetch an HTML page containing package links. z:all:Nr)rZrefresh_packager r)r6location package_namergshould_force_revalidates r*fetch_responseLinkCollector.fetch_responses_ <<77")-="=#  $ D!,/3CC " LL4  r,c^^^[R"UUU4SjTRRT555R 5n[R"UUU4SjTR 55R 5n[ R[R5(a[R"XC5Vs/sH&nUcMURcMSUR3PM( nn[U5STS3/U-n[ RSRU55 [![#U5[#U5S9$s snf)Nc 3h># UH'n[UTTRRSSTS9v M) g7f)Fcandidates_from_pagepage_validator expand_dirru project_nameNr"rZis_secure_originrlocr r r6s r*r0LinkCollector.collect_sources..s? 4 P %9#||<< #()  P/2c 3h># UH'n[UTTRRSSTS9v M) g7f)Tr Nrrs r*rrs= 5 ' %9#||<<#')  'rz* z' location(s) to search for versions of : )rr) collections OrderedDictrget_index_urls_locationsvaluesrrd isEnabledForloggingDEBUG itertoolschainrr'rerfrr)r6r r index_url_sourcesfind_links_sourcessliness``` r*collect_sourcesLinkCollector.collect_sourcess8 (33 4 ((AA,O 4   &( )44 5  5   &(    w}} - -#);OOA%&VV"QVVH O  u:,##/.3E LL5) *./-.  sE  E !E r)rZrrrr:r;F)rZrrr rrr:r)r:z list[str]r1)rrrrr:IndexContent | None)r r9r r r:r) r<r=r>r?rr3 classmethodrpropertyrrr$r@rQr,r*rrs"   #(    B,,:>  ,6  (, , 1,   , r,r)r(r9r:r)rKrr:r;)r(r9rZrr:r;r&)r(r9rZrrgrr:r)rGResponseHeadersr:r)rrr:rrr1)rrrzstr | ExceptionrzCallable[..., None] | Noner:r;)T)rKrrurr:r)rrrZrrgrr:r')Tr __future__rr email.messagerkrrrrr urllib.parserVcollections.abcrrrr dataclassesr html.parserr optparser typingr r pip._vendor.packaging.utilsr pip._vendor.requestsrpip._vendor.requests.exceptionsrpip._internal.exceptionsrrrrrrpip._internal.models.linkr!pip._internal.models.search_scoperpip._internal.network.sessionrpip._internal.network.utilsrpip._internal.utils.filetypesrpip._internal.utils.miscrpip._internal.utils.urlsrpip._internal.vcsrsourcesr r!r" getLoggerr<rdr9r*r+ Exceptionr.rMrOr`rhrprrrrrrrrrrrrrQr,r*rBs#  HH!" :)6+948990!AA   8 $ c*)Y)@, y *#8 8 88 8v # #BB(8 $...(Z>(,@ @ @ %@ @48  ,0  "# ? ?? ?  ?D,z, v v r,