File: //lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyo
�
d�bc
@ s� d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l j j Z d d l j j
Z
d d l j j j
Z
d d l m Z m Z m Z d d l m Z m Z m Z d d l m Z m Z m Z e a d Z d Z d Z d Z d Z e j! d � Z" e j# e j$ e j% e j& e j' e j( e j) e j* e j+ d
g
Z, e, Z- e- j. e j/ � e j0 g Z1 e j2 e j3 e j4 g Z5 e j6 g Z7 d g Z8 e j% e j) d
g Z9 e j: e j; e j< e j= g Z> d Z? d
Z@ d ZA d jB e e � ZC d jB eC � ZD d ZE d ZF d ZG d ZH d eI f d � � YZJ d e d � ZK d d � ZM d � ZN d � ZO d � ZP d � ZQ d � ZR d � ZS d � ZT d � ZU d! � ZV d" � ZW e d# � ZX d$ � ZY d d e d d d e d% � ZZ d e d d e e e d& � Z[ d e d d e e d' � Z\ d e d d e d( � Z] d e d d e d) � Z^ d e d d e e d* � Z_ d e d d e d+ � Z` d d, � Za d d- � Zb d. � Zc d d/ � Zd d0 � Ze d S(1 i����N( t HttpErrort ResourceGoneErrort InvalidContainerError( t
httpclientt urlparset ustr( t PY_VERSION_MAJORt
AGENT_NAMEt GOAL_STATE_AGENT_VERSIONi i i s <SAS_SIGNATURE>s3 ^(https?://[a-zA-Z0-9.].*sig=)([a-zA-Z0-9%-]*)(.*)$i� i� t
http_proxyt https_proxyt no_proxys {0}/{1}s
{0}+healtht InvalidContainerConfigurationt RequestRoleConfigFileNotFounds
168.63.129.16i t IOErrorCounterc B sz e Z e j � Z e Z i d d 6d d 6d d 6Z e d d d � � Z
e d � � Z e d � � Z e e d � � Z
RS( i t
hostplugint protocolt otherc C sn t j �_ | t j k rQ | t k r; t j d c d 7<qd t j d c d 7<n t j d c d 7<Wd QXd S( NR i R R ( R t _lockt _protocol_endpointt HOST_PLUGIN_PORTt _counts( t hostt port( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt incrementv s
c C s1 t j �" t j j � } t j � | SWd QXd S( N( R R R t copyt reset( t counts( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt
get_and_reset� s
c C s2 t j �# i d d 6d d 6d d 6t _ Wd QXd S( Ni R R R ( R R R ( ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyR � s
c C s
| t _ d S( N( R R ( t endpoint( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt set_protocol_endpoint� s N( t __name__t
__module__t threadingt RLockR t KNOWN_WIRESERVER_IPR R t staticmethodt NoneR R R R ( ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyR q s
c C sE d } x0 t | � D]" } | d | d | d f } q W| | d S( Ni i ( i i ( t range( t
retry_attemptt delayt fibt _( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt _compute_delay� s c C s | d k r t } n | | k S( N( R% t RETRY_CODES( t statust retry_codes( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt _is_retry_status� s c C s2 t g t D] } t | | � r
| ^ q
� d k S( Ni ( t lent RETRY_EXCEPTIONSt
isinstance( t et x( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt _is_retry_exception� s c C s
| t k S( N( t THROTTLE_CODES( R- ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt _is_throttle_status� s c C s� t | � } | j } | j r6 d j | | j � } n | j rW d j | | j � } n t } | j j � d k r{ t } n | j | j
| | f S( st
Parse URL to get the components of the URL broken down to host, port
:rtype: string, int, bool, string
s {0}#{1}s {0}?{1}t https( R t patht fragmentt formatt queryt Falset schemet lowert Truet hostnameR ( t urlt ot rel_urit secure( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt
_parse_url� s c C sc t | � } | j r_ | j r@ d j | j | j | j | j � Sd j | j | j | j � Sn | S( s:
Parse URL and return scheme://hostname:port/path
s {0}://{1}:{2}{3}s {0}://{1}{2}( R RA R R; R> R9 ( RB RC ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt _trim_url_parameters� s " c C s� | j d � d k r� y t | j d � d � } Wn t k
rF t SX| d k s_ | d k rc t Sy t j | j d � d � Wq� t j k
r� t SXn t St S( sU
Very simple check of the cidr format in no_proxy variable.
:rtype: bool
t /i i i ( t countt intt splitt
ValueErrorR= t sockett inet_atont errorR@ ( t string_networkt mask( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt
is_valid_cidr� s
c C s/ d d d | >d A} t j t j d | � � S( s Converts mask from /xx format to xxx.xxx.xxx.xxx
Example: if mask is 24 function returns 255.255.255.0
:rtype: str
I���� i i s >I( RM t inet_ntoat structt pack( RQ t bits( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt dotted_netmask� s c C s� t j d t j | � � d } | j d � \ } } t j d t j t t | � � � � d } t j d t j | � � d | @} | | @| | @k S( s� This function allows you to check if an IP belongs to a network subnet
Example: returns True if ip = 192.168.1.1 and net = 192.168.1.0/24
returns False if ip = 192.168.1.1 and net = 192.168.100.0/24
:rtype: bool
s =Li RH ( RT t unpackRM RN RK RW RJ ( t ipt nett ipaddrt netaddrRV t netmaskt network( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt address_in_network� s
+#c C s- y t j | � Wn t j k
r( t SXt S( s
:rtype: bool
( RM RN RO R= R@ ( t string_ip( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt is_ipv4_address� s
c C sk t j j t � p' t j j t j � � } | rg g | j d d � j d � D] } | rL | ^ qL } n | S( Nt t t ,( t ost environt gett NO_PROXY_ENVt uppert replaceRK ( R R ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt get_no_proxy� s *7c C s� t � } | r� t | � ra xs | D]8 } t | � rJ t | | � rZ t Sq" | | k r" t Sq" Wq� x0 | D]% } | j � j | j � � rh t Sqh Wn t S( N( Rk Ra RR R_ R@ R? t endswithR= ( R R t proxy_ipt proxy_domain( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt bypass_proxy s
c C s� t j � } d } | d k r- t j � } n| | r9 t n t } d } x: | | j � g D]& } | t j k rX t j | } PqX qX W| d k r� t | � \ } } } } n | | f S( N(
t conft get_httpproxy_hostR% t get_httpproxy_portt HTTPS_PROXY_ENVt HTTP_PROXY_ENVRi Re Rf RF ( RE R R t http_proxy_envt http_proxy_urlt vR* ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt _get_http_proxy s
c C s t j d t d | � S( Ns \1s \3( t SAS_TOKEN_RETRIEVAL_REGEXt subt
REDACTED_TEXT( RB ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt redact_sas_tokens_in_urls4 s c
C s� | d k r i n | } d | d <| d k o7 | d k }
| d k r[ | rR d n d } n d | k rt t | d <n |
r� | | } } | r� d n d }
d j |
| | | � } n | | } } | } | rt j | | d d
�} |
r| j | | � qn t j | | d d
�} | } | r.d } n t j d | t | � t
j | � | � | j d
| d | d | d | � | j
� S( Nt closet
Connectioni� iP s
User-AgentR8 t https {0}://{1}:{2}{3}t timeouti
s
[REDACTED]s' HTTP connection [{0}] [{1}] [{2}] [{3}]t methodRB t bodyt headers( R% t HTTP_USER_AGENTR; R t HTTPSConnectiont
set_tunnelt HTTPConnectiont loggert verboseR| t textutilt str_to_encoded_ustrt requestt getresponse( R� R RD R t dataRE R� t
proxy_hostt
proxy_portt redact_datat use_proxyt conn_hostt conn_portR> RB t connt payload( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt
_http_request8 s@
"c
C s� | d k r t } n | d k r* t } n t | � \ }
} } }
d \ } } | r� t |
� r� t d | � \ } } | s� | r� t j d | | � q� n | r� t t d � r� t
j � s� t d � � n t
} t s� t j d � t a q� n | rb| d k rb| d k rbt t j d � rbt
j � s=t d � � n t
} t sbt j d � t a qbn d } d
} d
} t
} xU| | k r�| d
k r�| r�t n t d | d | � } t j d
| d | | | � t j | � n | d 7} y0t | |
|
d | d | d | d | d | d | d | �} t j d | j � | rI| St | � r�t | j d | �r�d j | | | j � } t | j � r�t } t | t � } n w}q�n | j t k r�t | � } t | � � n | j t j! k rt | � } t" | k rt# | � � qn | SWq}t j$ k
ru} | r>� n t% | � } d j | | | � } t& | � rqq}n Pq}t' k
r�} | r�� n t( j) d |
d | � t% | � } d j | | | � } q}q}Xq}Wt d j | | � � � d S( s�
NOTE: This method provides some logic to handle errors in the HTTP request, including checking the HTTP status of the response
and handling some exceptions. If return_raw_response is set to True all the error handling will be skipped and the
method will return the actual HTTP response and bubble up any exceptions while issuing the request. Also note that if
return_raw_response is True no retries will be done.
RE s HTTP proxy: [{0}:{1}]R� s! HTTPS is unavailable and requireds# Python does not include SSL supportR� s, HTTPS tunnelling is unavailable and requireds( Python does not support HTTPS tunnellingRc i R' R( s; [HTTP Retry] Attempt {0} of {1} will delay {2} seconds: {3}i R R� R� R� R� R� s [HTTP Response] Status Code {0}R. s' [HTTP Retry] {0} {1} -- Status Code {2}s* [HTTP Failed] {0} {1} -- HttpException {2}R s$ [HTTP Failed] {0} {1} -- IOError {2}s {0} -- {1} attempts madeN( NN(* R% t DEFAULT_RETRIESR, RF Ro Rx R� R� t hasattrR Rp t get_allow_httpR R= t SECURE_WARNING_EMITTEDt warnR@ R� t THROTTLE_DELAY_IN_SECONDSR+ t timet sleepR� R- t request_failedR/ R; R7 t maxt THROTTLE_RETRIESt RESOURCE_GONE_CODESt read_response_errorR t BAD_REQUESTt INVALID_CONTAINER_CONFIGURATIONR t
HTTPExceptionRG R5 t IOErrorR R ( R� RB R� R� R� t max_retryR. t retry_delayR� t return_raw_responseR R RE RD R� R� t msgt attemptR( t
was_throttledt respt response_errorR3 t clean_url( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt http_requesth s�
c C s^ | d k r t } n | d k r* t } n t d | d d | d | d | d | d | d | �S( s�
NOTE: This method provides some logic to handle errors in the HTTP request, including checking the HTTP status of the response
and handling some exceptions. If return_raw_response is set to True all the error handling will be skipped and the
method will return the actual HTTP response and bubble up any exceptions while issuing the request. Also note that if
return_raw_response is True no retries will be done.
t GETR� R� R� R. R� R� N( R% R� R, R� ( RB R� R� R� R. R� R� ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt http_get� s c C sX | d k r t } n | d k r* t } n t d | d d | d | d | d | d | �S( Nt HEADR� R� R� R. R� ( R% R� R, R� ( RB R� R� R� R. R� ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt http_head s c C sX | d k r t } n | d k r* t } n t d | | d | d | d | d | d | �S( Nt POSTR� R� R� R. R� ( R% R� R, R� ( RB R� R� R� R� R. R� ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt http_post) s c C s^ | d k r t } n | d k r* t } n t d | | d | d | d | d | d | d | �S( Nt PUTR� R� R� R. R� R� ( R% R� R, R� ( RB R� R� R� R� R. R� R� ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt http_put= s c C sX | d k r t } n | d k r* t } n t d | d d | d | d | d | d | �S( Nt DELETER� R� R� R. R� ( R% R� R, R� ( RB R� R� R� R. R� ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt http_deleteS s c C s& | d k r t } n t | d | � S( Nt ok_codes( R% t OK_CODESt request_succeeded( R� R� ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyR� f s c C s. | d k r t } n | d k o- | j | k S( N( R% R� R- ( R� R� ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyR� l s c C s | d k o | j t k S( N( R% R- t NOT_MODIFIED_CODES( R� ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt request_not_modifiedr s c C s= | d k r t } n | d k o< | j d k o< | j | k S( s`
Host plugin will return 502 for any upstream issue, so a failure is any 5xx except 502
i� N( R% t! HOSTPLUGIN_UPSTREAM_FAILURE_CODESR- ( R� t upstream_failure_codes( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt request_failed_at_hostpluginv s c C s� d } | d k r� y� d j | j | j | j � � } t d k r] t | d d d d �} n* | j d d d d � j d d d d � } t j
| � } Wq� t k
r� } t j
t j | � � q� Xn | S( NRc s [HTTP Failed] [{0}: {1}] {2}i t encodingt asciit errorst ignore( R% R; R- t reasont readR R t encodet decodeR� t replace_non_asciit ExceptionR� R� t format_exception( R� t resultR3 ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyR� s (f Re t reR! R� RM RT t azurelinuxagent.common.conft commonRp t azurelinuxagent.common.loggerR� t% azurelinuxagent.common.utils.textutilt utilsR� t azurelinuxagent.common.exceptionR R R t azurelinuxagent.common.futureR R R t azurelinuxagent.common.versionR R R R= R� R� t DELAY_IN_SECONDSR� R� R{ t compileRy t
RESET_CONTENTt PARTIAL_CONTENTt FORBIDDENt INTERNAL_SERVER_ERRORt NOT_IMPLEMENTEDt BAD_GATEWAYt SERVICE_UNAVAILABLEt GATEWAY_TIMEOUTt INSUFFICIENT_STORAGER, t' HGAP_GET_EXTENSION_ARTIFACT_RETRY_CODESt appendR� t GONER� t OKt CREATEDt ACCEPTEDR� t NOT_MODIFIEDR� R� R6 t NotConnectedt IncompleteReadt ImproperConnectionStatet
BadStatusLineR1 Rt Rs Rh R; R� t HTTP_USER_AGENT_HEALTHR� t" REQUEST_ROLE_CONFIG_FILE_NOT_FOUNDR# R t objectR R+ R% R/ R5 R7 RF RG RR RW R_ Ra Rk Ro Rx R| R� R� R� R� R� R� R� R� R� R� R� R� ( ( ( sI /usr/lib/python2.7/site-packages/azurelinuxagent/common/utils/restutil.pyt <module> s� !
0 �