t_K @ se d Z d d l m Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z
d d l m Z d d l
m Z m Z d d l m Z d d l m Z d d l m Z d d
l m Z d d l m Z e rd d l m Z d d
l m Z m Z m Z m Z m Z m! Z! m" Z" m# Z# m$ Z$ d d l% m& Z& d d l' m( Z( e e$ e) e# f Z* e e# g e$ e+ e f f Z, d g Z- e j. d e j/ Z0 e j. d Z1 e j. d Z2 e j3 e j4 e j5 e j6 e j7 e j8 e j9 e j: e j; e j< e j= e j> e j? e j@ g ZA e jB e jC e jD g ZE d d eE D ZF Gd d d eG ZH Gd d d eG ZI d d d d d d ZJ d d ZK d d d ZL d d d d d! ZM d d d d" d# ZN Gd$ d% d% eG ZO d& d' ZP d( d) ZQ Gd* d+ d+ eR ZS d, d- ZT d. d/ ZU d0 d1 ZV d2 d3 ZW d d4 d5 ZX e j. d6 e j/ ZY d S)7z
Requirements file parsing
)absolute_importN)parse)
cmdoptions)InstallationErrorRequirementsFileParseError) SearchScope)raise_for_status) auto_decode)MYPY_CHECK_RUNNING)get_url_scheme)Values) AnyCallableDictIteratorListNoReturnOptionalTextTuple)
PackageFinder)
PipSessionparse_requirementsz^(http|https|file):z (^|\s+)#.*$z#(?P<var>\$\{(?P<name>[A-Z0-9_]+)\})c C s" g | ] } t | j q S )strdest).0or r /builddir/build/BUILDROOT/alt-python35-pip-20.2.4-1.el7.x86_64/opt/alt/python35/lib/python3.5/site-packages/pip/_internal/req/req_file.py
<listcomp>L s r c @ s" e Z d Z d d d d Z d S)ParsedRequirementNc C s: | | _ | | _ | | _ | | _ | | _ | | _ d S)N) requirement is_editable
comes_fromoptions
constraint line_source)selfr! r" r# r% r$ r& r r r __init__P s
zParsedRequirement.__init__)__name__
__module__ __qualname__r( r r r r r O s r c @ s e Z d Z d d Z d S)
ParsedLinec C s | | _ | | _ | | _ | | _ | | _ | rQ d | _ d | _ | | _ n7 | j r d | _ d | _ | j d | _ n d | _ d S)NTFr ) filenamelinenor# optsr% is_requirementr" r! editables)r' r- r. r# argsr/ r% r r r r( c s
zParsedLine.__init__N)r) r* r+ r( r r r r r, b s r, Fc
c sn t | } t | | | } xI | j | | D]5 } t | d | d | d | } | d k r1 | Vq1 Wd S)a Parse a requirements file and yield ParsedRequirement instances.
:param filename: Path or url of requirements file.
:param session: PipSession instance.
:param finder: Instance of pip.index.PackageFinder.
:param comes_from: Origin description of requirements.
:param options: cli options.
:param constraint: If true, parsing a constraint file rather than
requirements file.
r$ findersessionN)get_line_parserRequirementsFileParserr handle_line)
r- r4 r3 r# r$ r% line_parserparser parsed_line
parsed_reqr r r r s c C s@ t | j d d } t | } t | } t | } | S)zxSplit, filter, and join lines, and return a line iterator
:param content: the content of the requirements file
start ) enumerate
splitlines
join_linesignore_commentsexpand_env_variables)content
lines_enumr r r
preprocess s
rE c
C s d j | j r d n d | j | j } | j s9 t | j rj t d | j d | j d | d | j S| r t j
| | j i } xD t D]< } | | j j
k r | j j
| r | j j
| | | <q Wd j | j | j } t d | j d | j d | d | j d | d
| Sd S) Nz{} {} (line {})z-cz-rr! r" r# r% z
line {} of {}r$ r& )formatr% r- r. r0 AssertionErrorr" r r! r check_install_build_globalr/ SUPPORTED_OPTIONS_REQ_DEST__dict__)liner$ line_comes_from req_optionsr r& r r r handle_requirement_line s. $
" rN c s rJ | j r | j _ | j rJ j j f d d | j D | r| j } | j } | j rw | j g } | j d k r g } | j r | j | j | j r| j d } t j j
t j j | } t j j | | }
t j j
|
r|
} | j | t d | d | } | | _ | j rD| j | j rW| j | rx< | j plg D]+ } d j | | }
| j | d |
qmWd S) Nc 3 s$ | ] } | j k r | Vq d S)N)features_enabled)r f)r$ r r <genexpr> s z%handle_option_line.<locals>.<genexpr>Tr
find_links
index_urlsz
line {} of {}source)require_hashesrO extendrR rS index_urlno_indexextra_index_urlsospathdirnameabspathjoinexistsappendr search_scopepreset_allow_all_prereleases
prefer_binaryset_prefer_binary
trusted_hostsrF add_trusted_host)r/ r- r. r3 r$ r4 rR rS valuereq_dirrelative_to_reqs_filera hostrT r )r$ r handle_option_line sD
rl c C sF | j r t | | } | St | j | j | j | | | d Sd S)a Handle a single parsed requirements line; This can result in
creating/yielding requirements, or updating the finder.
:param line: The parsed line to be processed.
:param options: CLI options.
:param finder: The finder - updated by non-requirement lines.
:param session: The session - updated by non-requirement lines.
Returns a ParsedRequirement object if the line is a requirement line,
otherwise returns None.
For lines that contain requirements, the only options that have an effect
are from SUPPORTED_OPTIONS_REQ, and they are scoped to the
requirement. Other options from SUPPORTED_OPTIONS may be present, but are
ignored.
For lines that do not contain requirements, the only options that have an
effect are from SUPPORTED_OPTIONS. Options from SUPPORTED_OPTIONS_REQ may
be present, but are ignored. These lines may contain multiple options
(although our docs imply only one is supported), and all our parsed and
affect the finder.
N)r0 rN rl r/ r- r. )rK r$ r3 r4 r; r r r r7 s r7 c @ s@ e Z d Z d d Z d d Z d d Z d d Z d S)
r6 c C s | | _ | | _ | | _ d S)N)_session _line_parser _comes_from)r' r4 r8 r# r r r r( C s z RequirementsFileParser.__init__c c s& x | j | | D] } | Vq Wd S)z3Parse a given file, yielding parsed lines.
N)_parse_and_recurse)r' r- r% rK r r r r N s z RequirementsFileParser.parsec c s x | j | | D] } | j r | j j s; | j j r | j j r` | j j d } d } n | j j d } d } t j | r t j | | } n0 t j | s t j
j t j
j | | } x' | j
| | D] } | Vq Wq | Vq Wd S)Nr FT) _parse_filer0 r/ requirements constraints SCHEME_REsearch urllib_parseurljoinrZ r[ r^ r\ rp )r' r- r% rK req_pathnested_constraint
inner_liner r r rp U s"
z)RequirementsFileParser._parse_and_recursec c s t | | j d | j \ } } t | } x | D] \ } } y | j | \ } } WnF t k
r }
z& d j | |
j } t | WYd d }
~
Xn Xt | | | j | | | Vq4 Wd S)Nr# zInvalid requirement: {}
{})
get_file_contentrm ro rE rn OptionParsingErrorrF msgr r, ) r' r- r% _rC rD line_numberrK args_strr/ er} r r r rq v s z"RequirementsFileParser._parse_fileN)r) r* r+ r( r rp rq r r r r r6 B s !r6 c s f d d } | S)Nc s t } | j } d | _ r0 j | _ t | \ } } t j d k r` | j d } | j t j
| | \ } } | | f S)N utf8)r r r ) build_parserget_default_valuesrW format_controlbreak_args_optionssys version_infoencode
parse_argsshlexsplit)rK r9 defaultsr options_strr/ r~ )r3 r r
parse_line s z#get_line_parser.<locals>.parse_liner )r3 r r )r3 r r5 s r5 c C s | j d } g } | d d } xJ | D]B } | j d sP | j d rT Pq, | j | | j d q, Wd j | d j | f S)zBreak up the line into an args and options string. We only want to shlex
(and then optparse) the options, not the args. args can contain markers
which are corrupted by shlex.
N-z--r )r
startswithr` popr^ )rK tokensr2 r$ tokenr r r r s
r c @ s e Z d Z d d Z d S)r| c C s
| | _ d S)N)r} )r' r} r r r r( s zOptionParsingError.__init__N)r) r* r+ r( r r r r r| s r| c C s\ t j d d } t t } x$ | D] } | } | j | q# Wd d } | | _ | S)z7
Return a parser for parsing requirement lines
add_help_optionFc S s t | d S)N)r| )r' r} r r r parser_exit s z!build_parser.<locals>.parser_exit)optparse OptionParserSUPPORTED_OPTIONSSUPPORTED_OPTIONS_REQ
add_optionexit)r9 option_factoriesoption_factoryoptionr r r r r s
r c c s d } g } x | D] \ } } | j d s> t j | r t j | rW d | } | r | j | | d k s| t | d j | f Vg } q | | f Vq | s | } | j | j d q W| r | d k s t | d j | f Vd S)zJoins a line ending in '' with the previous line (except when following
comments). The joined line takes on the index of the first line.
N\r )endswith
COMMENT_REmatchr` rG r^ strip)rD primary_line_numbernew_liner rK r r r r@ s$
r@ c c sJ xC | D]; \ } } t j d | } | j } | r | | f Vq Wd S)z1
Strips comments and filter empty lines.
r N)r subr )rD r rK r r r rA s
rA c c sp xi | D]a \ } } xG t j | D]6 \ } } t j | } | sG q# | j | | } q# W| | f Vq Wd S)a Replace all environment variables that can be retrieved via `os.getenv`.
The only allowed format for environment variables defined in the
requirement file is `${MY_VARIABLE_1}` to ensure two things:
1. Strings that contain a `$` aren't accidentally (partially) expanded.
2. Ensure consistency across platforms for requirement files.
These points are the result of a discussion on the `github pull
request #3514 <https://github.com/pypa/pip/pull/3514>`_.
Valid characters in variable names follow the `POSIX standard
<http://pubs.opengroup.org/onlinepubs/9699919799/>`_ and are limited
to uppercase letter, digits and the `_` (underscore).
N)
ENV_VAR_REfindallrZ getenvreplace)rD r rK env_varvar_namerh r r r rB s rB c
C s t | } | d
k rA | j | } t | | j | j f S| d k r| rz | j d rz t d j | | | j d d d } | j d d } t
j | } | r | j d d | j d d d } t
j | } | j d rd | j d } | } y/ t | d
} t | j } Wd QRXWn: t k
r} z t d j | WYd d } ~ Xn X| | f S)aZ Gets the content of a file; it may be a filename, file: URL, or
http: URL. Returns (location, content). Content is unicode.
Respects # -*- coding: declarations on the retrieved files.
:param url: File path or url.
:param session: PipSession instance.
:param comes_from: Origin description of requirements.
httphttpsfilez6Requirements file {} references URL {}, which is local:r= r /|rbNz$Could not open requirements file: {})r r )r getr urltextr r rF r r _url_slash_drive_rer grouprv unquotelstripopenr readIOError)
r r4 r# schemerespr[ r rP rC excr r r r{ # s4
' %r{ z /*([a-z])\|)Z__doc__
__future__r r rZ rer r Z pip._vendor.six.moves.urllibr rv Zpip._internal.clir pip._internal.exceptionsr r !pip._internal.models.search_scoper pip._internal.network.utilsr pip._internal.utils.encodingr pip._internal.utils.typingr
pip._internal.utils.urlsr r typingr
r r r r r r r r "pip._internal.index.package_finderr pip._internal.network.sessionr intZ ReqFileLinesr Z
LineParser__all__compileIrt r r rW extra_index_urlrX rs rr editablerR no_binary only_binaryrd rU rb trusted_hostuse_new_featurer install_optionsglobal_optionshashr rI objectr r, r rE rN rl r7 r6 r5 r Exceptionr| r r@ rA rB r{ r r r r r <module> s @ ! .7)N -