Ë
|
ê^iÒ1 ã óÐ d dl mZ d dlmZ d dlmZ d dlmZ d dlm Z d dl
|
m Z m Z m Z mZ ddlmZmZ dd lmZmZmZ G d
|
d « Z G d d « Zeeef Ze e Z G d d« Z y)é )Ú annotations)Úaliases)Úsha256)Údumps)Úsub)ÚAnyÚIteratorÚListÚTupleé )Ú RE_POSSIBLE_ENCODING_INDICATIONÚTOO_BIG_SEQUENCE)Ú iana_nameÚis_multi_byte_encodingÚ unicode_rangec ó e Zd Z d ddZd dZd dZed d« Zd dZd dZ d dZ
|
ed d « Z ed d
|
« Z ed!d « Z ed!d « Zed d « Zed d« Zed d« Zed d« Zed d« Zed d« Zed"d« Zed#d« Zed!d« Zed d« Zed d« Zd$d%dZed d« Zy)&Ú CharsetMatchNc ó¬ || _ || _ || _ || _ || _ d | _ g | _ d| _ d | _ d | _ || _
|
|| _ y )Nç ) Ú_payloadÚ _encodingÚ_mean_mess_ratioÚ
|
_languagesÚ_has_sig_or_bomÚ_unicode_rangesÚ_leavesÚ_mean_coherence_ratioÚ_output_payloadÚ_output_encodingÚ_stringÚ_preemptive_declaration)ÚselfÚpayloadÚguessed_encodingÚmean_mess_ratioÚhas_sig_or_bomÚ languagesÚdecoded_payloadÚpreemptive_declarations õl H:\项ç®\archive\æµè¯ç»\èæ¬\Change_password\venv_build\Lib\site-packages\charset_normalizer/models.pyÚ__init__zCharsetMatch.__init__ s_ ð ' à .Ø'6Ô Ø,5Ø%3Ô Ø15Ô à+- Ø,/Ô"à-1Ô Ø,0Ô à#2 à3IÕ$ó c óÜ t |t « s)t |t « rt |« | j k( S y| j |j k( xr | j
|
|j
|
k( S )NF)Ú
|
isinstancer Ústrr ÚencodingÚ fingerprint©r" Úothers r* Ú__eq__zCharsetMatch.__eq__* sV Ü%¤ Ô.Ü%¤Ô%Ü Ó'¨4¯=©=Ñ8Ð8ØØ}} §¡Ñ.ÒX°4×3CÑ3CÀu×GXÑGXÑ3XÐXr, c óÞ t |t « st t | j |j z
|
« }t | j
|
|j
|
z
|
« }|dk r |dkD r| j
|
|j
|
kD S |dk rS|dk rNt | j « t k\ r| j |j k S | j |j kD S | j |j k S )zQ
|
Implemented to make sorted available upon CharsetMatches items.
|
g{®Gáz?g{®Gáz?)
|
r. r Ú
|
ValueErrorÚabsÚchaosÚ coherenceÚlenr r Úmulti_byte_usage)r" r3 Úchaos_differenceÚcoherence_differences r* Ú__lt__zCharsetMatch.__lt__1 sÊ ô %¤ Ô.Ü Ð ä"% d§j¡j°5·;±;Ñ&>Ó"?ÐÜ&)¨$¯.©.¸5¿?¹?Ñ*JÓ&KÐ ð dÒ "Ð';¸dÒ'BØ>> E§O¡OÑ3Ð 3Ø Ò $Ð)=ÀÒ)Eô 4==Ó!Ô%5Ò5Øzz E§K¡KÑ/Ð/Ø×(Ñ(¨5×+AÑ+AÑAÐ AàzzEKKÑ'Ð'r, c ó\ dt t | « « t | j « z z
|
S )Ng ð?)r: r/ Úraw©r" s r* r; z CharsetMatch.multi_byte_usageG s" àc#d)n¤s¨4¯8©8£}Ñ4Ñ5Ð5r, c ó~ | j &t | j | j d« | _ | j S )NÚstrict)r r/ r r rA s r* Ú__str__zCharsetMatch.__str__K s. à <<Ð Ü t}}¨d¯n©n¸hÓGDLØ||Ðr, c ó< d| j d| j dS )Nz<CharsetMatch 'z' bytes(z)>)r0 r1 rA s r* Ú__repr__zCharsetMatch.__repr__Q s" Ø § ¡ ¨x¸×8HÑ8HÐ7IÈÐLÐLr, c óº t |t « r|| k( r$t dj |j « « d |_ | j j |« y )Nz;Unable to add instance <{}> as a submatch of a CharsetMatch)r. r r6 ÚformatÚ __class__r r Úappendr2 s r* Ú add_submatchzCharsetMatch.add_submatchT sO Ü%¤ Ô.°%¸4²-Ü ØM×TÑTØOOóóð ð Ø ×ÑEÕ"r, c ó | j S ©N)r rA s r* r0 zCharsetMatch.encoding_ s à~~Ð r, c óÆ g }t j « D ]G \ }}| j |k( r|j |« '| j |k( s7|j |« I |S )z
|
Encoding name are known by many name, using this could help when searching for IBM855 when it's listed as CP855.
|
)r Úitemsr0 rJ )r" Ú also_known_asÚuÚps r* Úencoding_aliasesz CharsetMatch.encoding_aliasesc s^ ð
|
$& ÜMMOò (DAqØ}} Ò!Ø ×$Ñ$ QÕ'Ø !Ó#Ø ×$Ñ$ QÕ'ð (ð
|
Ð r, c ó | j S rM ©r rA s r* ÚbomzCharsetMatch.bomp ó à×#Ñ#Ð#r, c ó | j S rM rU rA s r* Úbyte_order_markz CharsetMatch.byte_order_markt rW r, c óF | j D cg c] }|d c}S c c}w )zÔ
|
Return the complete list of possible languages found in decoded sequence.
|
Usually not really useful. Returned list may be empty even if 'language' property return something != 'Unknown'.
|
r ©r )r" Úes r* r' zCharsetMatch.languagesx s ð #ooÖ.!Ò.Ð.ùÒ.s c ó | j shd| j v ryddlm}m} t | j « r || j « n || j « }t |« dk( sd|v ry|d S | j d d S )z
|
Most probable language found in decoded sequence. If none were detected or inferred, the property will return
|
"Unknown".
|
ÚasciiÚEnglishr )Úencoding_languagesÚmb_encoding_languagesz Latin BasedÚUnknown)r Úcould_be_from_charsetÚcharset_normalizer.cdr` ra r r0 r: )r" r` ra r' s r* ÚlanguagezCharsetMatch.language s ð ð $×4Ñ4Ñ4Ø ÷ Xô *¨$¯-©-Ô8ñ & d§m¡mÔ4á'¨¯ © Ó6ð ô 9~ Ò" m°yÑ&@Ø à Q<Ð àqÑ! !Ñ$Ð$r, c ó | j S rM )r rA s r* r8 zCharsetMatch.chaos s à×$Ñ$Ð$r, c ó@ | j sy| j d d S )Nr r r r[ rA s r* r9 zCharsetMatch.coherence s àØØqÑ! !Ñ$Ð$r, c ó6 t | j dz d¬« S ©Néd é )Úndigits)Úroundr8 rA s r* Ú percent_chaoszCharsetMatch.percent_chaos¦ s äTZZ #Ñ%¨qÔ1Ð1r, c ó6 t | j dz d¬« S ri )rm r9 rA s r* Úpercent_coherencez CharsetMatch.percent_coherenceª s äT^^ cÑ)°1Ô5Ð5r, c ó | j S )z+
|
Original untouched bytes.
|
)r rA s r* r@ zCharsetMatch.raw® s ð
|
}}Ð r, c ó | j S rM )r rA s r* ÚsubmatchzCharsetMatch.submatchµ s à||Ðr, c ó2 t | j « dkD S ©Nr )r: r rA s r* Ú has_submatchzCharsetMatch.has_submatch¹ s ä4<<Ó 1Ñ$Ð$r, c óô | j | j S t | « D cg c] }t |« }}t t |D ch c] }|s| c}« « | _ | j S c c}w c c}w rM )r r/ r ÚsortedÚlist)r" ÚcharÚdetected_rangesÚrs r* Ú alphabetszCharsetMatch.alphabets½ sk à × Ñ Ð +Ø×'Ñ'Ð 'äMPÐQUËYÖ,WÀT¬]¸4Õ-@Ð,WÐ,Wä %¤d°Ö+L°!Ê!ªAÒ+LÓ&MÓ NÔ Ø×#Ñ#Ð#ùò -Xùâ+Ls ¦A0ÁA5 ÁA5 c óp | j g| j D cg c] }|j c}z S c c}w )zÜ
|
The complete list of encoding that output the exact SAME str result and therefore could be the originating
|
encoding.
|
This list does include the encoding available in property 'encoding'.
|
)r r r0 )r" Úms r* rc z"CharsetMatch.could_be_from_charsetÇ s, ð Ð °t·|±|Ö"D°! 1§:£:Ò"DÑDÐDùÒ"Ds 3c ó6 j j |k7 rr| _ t « } j = j j « dvr!t t
|
fd|dd d¬« }||dd z }|j |d« _ j S )z®
|
Method to get re-encoded bytes payload using given target encoding. Default to UTF-8.
|
Any errors will be simply ignored by the encoder NOT replaced.
|
N)zutf-8Úutf8Úutf_8c óî | j | j « d | j « d j | j « d t j
|
« j dd« « S )Nr r Ú_ú-)ÚstringÚspanÚreplaceÚgroupsr r )r r" s r* ú<lambda>z%CharsetMatch.output.<locals>.<lambda>ß sY ø ahh q§v¡v£x°¡{°Q·V±V³X¸a±[Ð A× IÑ IØ
|
1 Ü! $×"7Ñ"7Ó8×@Ñ@ÀÀcÓJó r, i r )Úcountr )r r/ r! Úlowerr r Úencoder )r" r0 Údecoded_stringÚpatched_headers ` r* ÚoutputzCharsetMatch.outputÐ s¬ ø ð
|
× Ñ Ð (¨D×,AÑ,AÀXÒ,MØ$,DÔ !Ü YNà×,Ñ,Ð8Ø×0Ñ0×6Ñ6Ó8Ø1ñ2ô "%Ü3óð # 5 DÐ)Øô"ð "0°.ÀÀÐ2GÑ!Gà#1×#8Ñ#8¸À9Ó#MDÔ à×#Ñ#Ð#r, c óP t | j « « j « S )zw
|
Retrieve the unique SHA256 computed using the transformed (re-encoded) payload. Not the original one.
|
)r r Ú hexdigestrA s r* r1 zCharsetMatch.fingerprintí s ô
|
dkkmÓ$×.Ñ.Ó0Ð0r, )NN)r# Úbytesr$ r/ r% Úfloatr& Úboolr' ÚCoherenceMatchesr( ú
|
str | Noner) r )r3 ÚobjectÚreturnr )r r ©r r/ )r3 r r ÚNone)r ú list[str]©r r )r r )r zlist[CharsetMatch])r )r0 r/ r r ) Ú__name__Ú
|
__module__Ú __qualname__r+ r4 r> Úpropertyr; rD rF rK r0 rS rV rY r' re r8 r9 rn rp r@ rs rv r} rc r r1 © r, r* r r sÑ ð '+Ø-1ðJàðJð ðJð ð Jð
|
ð Jð $ð Jð $ðJð !+óJó8Yó(ð, ò6ó ð6ó ó Mó #ð ò ó ð ð ò
|
ó ð
|
ð ò$ó ð$ð ò$ó ð$ð ò/ó ð/ð ò%ó ð%ð6 ò%ó ð%ð ò%ó ð%ð
|
ò2ó ð2ð ò6ó ð6ð ò ó ð ð ò ó ð ð ò%ó ð%ð ò$ó ð$ð òEó ðEô$ð: ò1ó ñ1r, r c óR e Zd ZdZd d dZd dZddZddZddZddZ dd Z
|
dd
|
Z y)ÚCharsetMatchesz³
|
Container with every CharsetMatch items ordered by default from most probable to the less one.
|
Act like a list(iterable) but does not implements all related methods.
|
Nc ó8 |rt |« | _ y g | _ y rM )rx Ú_results)r" Úresultss r* r+ zCharsetMatches.__init__û s Ù?F¬F°7«O ÈB r, c # ó8 K | j E d { y 7 wrM ©r¦ rA s r* Ú__iter__zCharsetMatches.__iter__þ s è ø Ø==× Ò ús c óÊ t |t « r| j | S t |t « r/t |d« }| j D ] }||j
|
v s|c S t )z¸
|
Retrieve a single item either by its position or encoding name (alias may be used here).
|
Raise KeyError upon invalid index or encoding not present in results.
|
F)r. Úintr¦ r/ r rc ÚKeyError)r" ÚitemÚresults r* Ú __getitem__zCharsetMatches.__getitem__ s` ô
|
dCÔ Ø== Ñ&Ð &Ü dCÔ Ü T 5Ó)DØ --ò "Ø6×7Ñ7Ò7Ø!Mð "ô r, c ó, t | j « S rM ©r: r¦ rA s r* Ú__len__zCharsetMatches.__len__ s Ü4==Ó!Ð!r, c ó2 t | j « dkD S ru r² rA s r* Ú__bool__zCharsetMatches.__bool__ s Ü4==Ó! AÑ%Ð%r, c óÎ t |t « s-t dj t |j
|
« « « t |j « t k rW| j D ]H }|j |j k( s |j |j k( s7|j |« y | j j |« t | j « | _ y)z~
|
Insert a single match. Will be inserted accordingly to preserve sort.
|
Can be inserted as a submatch.
|
z-Cannot append instance '{}' to CharsetMatchesN)r. r r6 rH r/ rI r: r@ r r¦ r1 r8 rK rJ rx )r" r® Úmatchs r* rJ zCharsetMatches.append s³ ô
|
$¤ Ô-Ü Ø?×FÑFÜÓ'óóð ô txx=Ô+Ò +Ø ò Ø×$Ñ$¨×(8Ñ(8Ó8¸U¿[¹[ÈDÏJÉJÓ=VØ×&Ñ& tÔ,Ùð ð × Ñ TÔ"Ü t}}Ó- r, c ó: | j sy| j d S )zQ
|
Simply return the first match. Strict equivalent to matches[0].
|
Nr r© rA s r* ÚbestzCharsetMatches.best) s ð }}ØØ}}QÑ Ð r, c ó" | j « S )zP
|
Redundant method, call the method best(). Kept for BC reasons.
|
)r¹ rA s r* ÚfirstzCharsetMatches.first1 s ð yy{Ðr, rM )r§ zlist[CharsetMatch] | None)r zIterator[CharsetMatch])r® z int | strr r )r r¬ r )r® r r r )r zCharsetMatch | None) r r r Ú__doc__r+ rª r° r³ rµ rJ r¹ r» r¢ r, r* r¤ r¤ õ s0 ñô
|
Oó!ó ó "ó&ó.ó( ôr, r¤ c óZ e Zd Z ddZedd« ZddZy)ÚCliDetectionResultc ó || _ |
|
| _ || _ || _ || _ || _ || _ || _ || _ | | _ | | _
|
y rM ) ÚpathÚ unicode_pathr0 rS Úalternative_encodingsre r} r& r8 r9 Ú is_preferred) r" rÀ r0 rS r re r} r& r8 r9 rÁ rà s r* r+ zCliDetectionResult.__init__= sV ð Ø(4ÔØ$, Ø+;Ô Ø0EÔ"Ø % Ø$-Ø$2ÔØ !
|
Ø )Ø".Õr, c óú | j | j | j | j | j | j
|
| j | j | j | j | j d S )N© rÀ r0 rS r re r} r& r8 r9 rÁ rà rÅ rA s r* Ú__dict__zCliDetectionResult.__dict__W se ð IIØ Ø $× 5Ñ 5Ø%)×%?Ñ%?Ø Ø Ø "× 1Ñ 1ØZZØ Ø × -Ñ -Ø × -Ñ -ñ
|
ð
|
r, c ó2 t | j dd¬« S )NTé )Ú ensure_asciiÚindent)r rÆ rA s r* Úto_jsonzCliDetectionResult.to_jsong s ÜT]]°¸aÔ@Ð@r, N)rÀ r/ r0 r rS r r r re r/ r} r r& r r8 r r9 r rÁ r rà r )r zdict[str, Any]r )r r r r+ r¡ rÆ rË r¢ r, r* r¾ r¾ < s ð/àð/ð ð/ð $ð /ð
|
)ð /ð ð /ð ð/ð ð/ð ð/ð ð/ð !ð/ð ó/ð4 ò
|
ó ð
|
ô Ar, r¾ N) Ú
|
__future__r Úencodings.aliasesr Úhashlibr Újsonr Úrer Útypingr r r
|
r Úconstantr r Úutilsr r r r r¤ r/ r ÚCoherenceMatchr r¾ r¢ r, r* ú<module>rÕ sd ðÝ "å %Ý Ý Ý ß -Ó -ç Gß CÑ C÷e1ñ e1÷P@ñ @ðF sEzÑ"ØÑ'Ð ÷,Aò ,Ar,
|
