File: //opt/alt/python37/lib/python3.7/site-packages/bs4/__pycache__/__init__.cpython-37.pyc
B
I.�`�O � @ s d Z dZdZdZdZdgZddlZddlZddlZddl Z dd l
m Z m Z dd
l
mZ dd lmZmZmZmZmZmZmZmZmZmZmZ d d
k G dd� de�ZeZ eZ G dd� de�Z G dd� de �Z G dd� de!�Z"e#dk�rddl$Z$ee$j%�Z&e'e&�(� � dS )aH Beautiful Soup
Elixir and Tonic
"The Screen-Scraper's Friend"
http://www.crummy.com/software/BeautifulSoup/
Beautiful Soup uses a pluggable XML or HTML parser to parse a
(possibly invalid) document into a tree representation. Beautiful Soup
provides methods and Pythonic idioms that make it easy to navigate,
search, and modify the parse tree.
Beautiful Soup works with Python 2.7 and up. It works better if lxml
and/or html5lib is installed.
For more than you ever wanted to know about Beautiful Soup, see the
documentation:
http://www.crummy.com/software/BeautifulSoup/bs4/doc/
z*Leonard Richardson (leonardr@segfault.org)z4.5.1z*Copyright (c) 2004-2016 Leonard RichardsonZMIT�
BeautifulSoup� N� )�builder_registry�ParserRejectedMarkup)�
UnicodeDammit) �CData�Comment�DEFAULT_OUTPUT_ENCODING� Declaration�Doctype�NavigableString� PageElement�ProcessingInstruction� ResultSet� SoupStrainer�Tagz`You are trying to run the Python 2 version of Beautiful Soup under Python 3. This will not work.zuYou need to convert the code, either by installing it (`python setup.py install`) or by running 2to3 (`2to3 -w bs4`).c s� e Zd ZdZdZddgZdZdZd2d d
�Zd d � Z d
d� Z
e dd� �Z dd� Z
dd� Zd3dd�Zefdd�Zdd� Zdd � Zd d � Zd d � Zefd!d"�Zd4d#d$�Zd5d&d'�Zd(d)� Zd6d*d+�Zd,d-� Zd.e d/f� fd0d1� Z � Z S )7r a
This class defines the basic interface called by the tree builders.
These methods will be called by the parser:
reset()
feed(markup)
The tree builder may call these methods from its feed() implementation:
handle_starttag(name, attrs) # See note about return value
handle_endtag(name)
handle_data(data) # Appends to the current data node
endData(containerClass=NavigableString) # Ends the current data node
No matter how complicated the underlying parser is, you should be
able to build a tree using 'start tag' events, 'end tag' events,
'data' events, and "done with data" events.
If you encounter an empty-element tag (aka a self-closing tag,
like HTML's <br> tag), call handle_starttag and then
handle_endtag.
z
[document]ZhtmlZfastz
a No parser was explicitly specified, so I'm using the best available %(markup_type)s parser for this system ("%(parser)s"). This usually isn't a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently.
The code that caused this warning is on line %(line_number)s of the file %(filename)s. To get rid of this warning, change code that looks like this:
BeautifulSoup([your markup])
to this:
BeautifulSoup([your markup], "%(parser)s")
� Nc
s d� krt �d� d� kr*� d= t �d� d� krB� d= t �d� d� krZ� d= t �d� d � krr� d = t �d
� � fd d �}|p�|d
d�}|p�|dd�}|r�t|t�r�t �d� d}t� �dkr�t� �� ��� } td| ��|dk�r�|}
t|t�r�|g}|dk�st|�dk�r| j }t
j |� } | dk�r@t dd�
|� ��| � }|
|jk�s�|
|jk�s�|j�rld} nd} t�� d }
|
d }|
d }t �| jt|||j| d� � || _|j| _| j| _| | j_|| _t|d��r�|�� }n�t|�d k�r�t|t��rd |k�s t|t��r�d |k�r�t|t��r@t j j �s@|� d �}n|}d }yt j � |�}W n$ t!k
�r| } zW dd}~X Y nX |�r�t|t��r�|� d �}t �d!| � | �"|� xZ| jj#|||d"�D ]D\| _$| _%| _&| _'| �(� y| �)� P W n t*k
�r Y nX �q�W d| _$d| j_dS )#z�The Soup object is initialized as the 'root tag', and the
provided markup (which can be a string or a file-like object)
is fed into the underlying parser.ZconvertEntitiesz�BS4 does not respect the convertEntities argument to the BeautifulSoup constructor. Entities are always converted to Unicode characters.Z
markupMassagez�BS4 does not respect the markupMassage argument to the BeautifulSoup constructor. The tree builder is responsible for any necessary markup massage.Z
smartQuotesToz�BS4 does not respect the smartQuotesTo argument to the BeautifulSoup constructor. Smart quotes are always converted to Unicode characters.ZselfClosingTagsz�BS4 does not respect the selfClosingTags argument to the BeautifulSoup constructor. The tree builder is responsible for understanding self-closing tags.ZisHTMLz�BS4 does not respect the isHTML argument to the BeautifulSoup constructor. Suggest you use features='lxml' for HTML and features='lxml-xml' for XML.c s0 | � kr,t �d| |f � � | }� | = |S d S )NzLThe "%s" argument to the BeautifulSoup constructor has been renamed to "%s.")�warnings�warn)Zold_name�new_name�value)�kwargs� �=/opt/alt/python37/lib/python3.7/site-packages/bs4/__init__.py�deprecated_argument� s z3BeautifulSoup.__init__.<locals>.deprecated_argumentZparseOnlyThese�
parse_onlyZ fromEncoding�
from_encodingzlYou provided Unicode markup but also provided a value for from_encoding. Your from_encoding will be ignored.Nr z2__init__() got an unexpected keyword argument '%s'zjCouldn't find a tree builder with the features you requested: %s. Do you need to install a parser library?�,ZXMLZHTMLr )�filename� line_number�parser� markup_type�read� � <�<�utf8Fzu"%s" looks like a filename, not markup. You shouldprobably open this file and pass the filehandle intoBeautiful Soup.)�exclude_encodings)+r r �
isinstance�str�len�list�keys�pop� TypeError�DEFAULT_BUILDER_FEATURESr �lookup�FeatureNotFound�join�NAMEZALTERNATE_NAMES�is_xml� traceback�
extract_stack�NO_PARSER_SPECIFIED_WARNING�dict�builderZ known_xml�soupr �hasattrr" �bytes�os�path�supports_unicode_filenames�encode�exists� Exception�_check_markup_is_urlZprepare_markup�markup�original_encodingZdeclared_html_encodingZ contains_replacement_characters�reset�_feedr )�selfrD �featuresr9 r r r' r r �argZoriginal_featuresZ
builder_classr! Zcallerr r Zpossible_filename�is_file�er )r r �__init__W s�
zBeautifulSoup.__init__c C s& t | �| �d�| jdd�}| j|_|S )Nzutf-8)r9 r )�typer@ r9 rE )rH �copyr r r �__copy__� s zBeautifulSoup.__copy__c C s& t | j�}d|kr"| jjs"d |d< |S )Nr9 )r8 �__dict__r9 Z picklable)rH �dr r r � __getstate__� s
zBeautifulSoup.__getstate__c sx t � t�rd}d}nt � t�r(d}d}ndS t� fdd�|D ��rt|� krtt � t�rb� �dd �}n� }t�d
| � dS ) z�
Check if markup looks like it's actually a url and raise a warning
if so. Markup can be unicode or str (py2) / bytes (py3).
� )s http:s https:� )zhttp:zhttps:Nc 3 s | ]}� � |�V qd S )N)�
startswith)�.0�prefix)rD r r � <genexpr> s z5BeautifulSoup._check_markup_is_url.<locals>.<genexpr>zutf-8�replacez�"%s" looks like a URL. Beautiful Soup is not an HTTP client. You should probably use an HTTP client like requests to get the document behind the URL, and feed that document to Beautiful Soup.)r( r< r) �any�decoder r )rD ZspaceZcant_start_withZdecoded_markupr )rD r rC s
z"BeautifulSoup._check_markup_is_urlc C s@ | j �� | j �| j� | �� x| jj| jkr:| �� q"W d S )N) r9 rF ZfeedrD �endData�
currentTag�name�
ROOT_TAG_NAME�popTag)rH r r r rG s
zBeautifulSoup._feedc C sJ t �| | | j| j� d| _| j�� g | _d | _g | _g | _ | �
| � d S )Nr ) r rM r9 r` ZhiddenrF � current_datar^ �tagStack� preserve_whitespace_tag_stack�pushTag)rH r r r rF ' s
zBeautifulSoup.resetc K s t d| j||||�S )z+Create a new tag associated with this soup.N)r r9 )rH r_ � namespace�nsprefix�attrsr r r �new_tag1 s zBeautifulSoup.new_tagc C s ||�S )z7Create a new NavigableString associated with this soup.r )rH �s�subclassr r r �
new_string5 s zBeautifulSoup.new_stringc C s t d��d S )Nz4BeautifulSoup objects don't support insert_before().)�NotImplementedError)rH � successorr r r �
insert_before9 s zBeautifulSoup.insert_beforec C s t d��d S )Nz3BeautifulSoup objects don't support insert_after().)rm )rH rn r r r � insert_after< s zBeautifulSoup.insert_afterc C s@ | j �� }| jr(|| jd kr(| j�� | j r:| j d | _| jS )N���)rc r- rd r^ )rH �tagr r r ra ? s
zBeautifulSoup.popTagc C sJ | j r| j j�|� | j�|� | jd | _ |j| jjkrF| j�|� d S )Nrq )r^ �contents�appendrc r_ r9 Zpreserve_whitespace_tagsrd )rH rr r r r re H s zBeautifulSoup.pushTagc C s� | j r�d�| j �}| jsPd}x |D ]}|| jkr"d}P q"W |rPd|krLd}nd}g | _ | jr�t| j�dkr�| jjr~| j�|�s�d S ||�}| � |� d S )Nr TF�
rU r )
rb r2 rd � ASCII_SPACESr r* rc �text�search�object_was_parsed)rH ZcontainerClassrb Z
strippable�i�or r r r] Q s&
zBeautifulSoup.endDatac C sV |p| j }|p| j}d } }}t|t�rF|j}|j}|j}|sF|j}|�|||||� || _|j �
|� |j�rRt |j �d }x4|dkr�|j | |kr�P |d8 }q�W t d||f ��|dkr�|}d}n|j |d }}|t |j �d kr�|j}d}n|j |d }}||_|�r ||_||_|�r.||_||_|�r@||_||_|�rR||_dS )z Add an object to the parse tree.Nr r z[Error building tree: supposedly %r was inserted into %r after the fact, but I don't see it!)
r^ �_most_recent_elementr( r � next_element� next_sibling�previous_sibling�previous_elementZsetuprs rt r* �
ValueError) rH r{ �parentZmost_recent_elementr� r} r r~ �indexr r r ry o sR
z BeautifulSoup.object_was_parsedTc C sn || j krdS d}t| j�}xLt|d dd�D ]8}| j| }||jkr^||jkr^|r\| �� }P | �� }q.W |S )z�Pops the tag stack up to and including the most recent
instance of the given tag. If inclusivePop is false, pops the tag
stack up to but *not* including the most recent instqance of
the given tag.Nr r rq )r` r* rc �ranger_ rX ra )rH r_ rg Z inclusivePopZmost_recently_popped�
stack_sizerz �tr r r � _popToTag� s
zBeautifulSoup._popToTagc C s� | � � | jr6t| j�dkr6| jjs2| j�||�s6dS t| | j||||| j| j �}|dkr^|S | j rl|| j _
|| _ | � |� |S )a Push a start tag on to the stack.
If this method returns None, the tag was rejected by the
SoupStrainer. You should proceed as if the tag had not occurred
in the document. For instance, if this was a self-closing tag,
don't call handle_endtag.
r N) r] r r* rc rw Z
search_tagr r9 r^ r| r} re )rH r_ rf rg rh rr r r r �handle_starttag� s
z BeautifulSoup.handle_starttagc C s | � � | �||� d S )N)r] r� )rH r_ rg r r r �
handle_endtag� s zBeautifulSoup.handle_endtagc C s | j �|� d S )N)rb rt )rH �datar r r � handle_data� s zBeautifulSoup.handle_dataFZminimalc sN | j r$d}|dkrd| }d| }nd}|s2d}nd}|tt| ��|||� S )zlReturns a string or Unicode representation of this document.
To get Unicode, pass None for encoding.r Nz encoding="%s"z<?xml version="1.0"%s?>
r )r4 �superr r\ )rH Z pretty_printZeventual_encodingZ formatterZ
encoding_partrX Z indent_level)� __class__r r r\ � s
zBeautifulSoup.decode)r NNNNN)NN)NN)NT)N) �__name__�
__module__� __qualname__�__doc__r` r/ rv r7 rM rP rS � staticmethodrC rG rF ri r rl ro rp ra re r] ry r� r� r� r� r r\ �
__classcell__r r )r� r r 7 s8
9
c s e Zd ZdZ� fdd�Z� ZS )�BeautifulStoneSoupz&Deprecated interface to an XML parser.c s( d|d< t �d� tt| �j||� d S )NZxmlrI zxThe BeautifulStoneSoup class is deprecated. Instead of using it, pass features="xml" into the BeautifulSoup constructor.)r r r� r� rM )rH �argsr )r� r r rM � s zBeautifulStoneSoup.__init__)r� r� r� r� rM r� r r )r� r r� � s r� c @ s e Zd ZdS )� StopParsingN)r� r� r� r r r r r� s r� c @ s e Zd ZdS )r1 N)r� r� r� r r r r r1 s r1 �__main__))r� �
__author__� __version__Z
__copyright__Z __license__�__all__r= �rer5 r r9 r r Zdammitr Zelementr r r r
r r r
r r r r r Z_sZ_soupr� rB r� r� r1 r� �sys�stdinr: �printZprettifyr r r r �<module> s4 4 D