Ë
|
nñúhÏJ ã ó d dl mZ d dlmZmZ d dlZd dlZd dlm Z m
|
Z m Z mZ d dlmZ d dlmZ d dlmZ d dlmZmZ d d lmZmZmZ d d
|
l m Z d d l m Z m Z d d l!m"Z"m#Z#m$Z$ d d l%m&Z& d dl'm(Z( d dl)m*Z*m+Z+ d dl,m-Z-m.Z. er"d dl/m0Z0 d dl1m2Z2m3Z3m4Z4m5Z5m6Z6 d dl7m8Z8 d dl)m9Z9m:Z: d"dZ; d#dZ< d$dZ=d%dZ> d&dZ? d'dZ@ d(dZA G d d « ZBd)d ZCd*d ZDd+d ZEd,d!ZFy)-é )Ú annotations)Ú TYPE_CHECKINGÚcastN)ÚNaTÚalgosÚ internalsÚlib)ÚNA)Úcache_readonly)Úfind_stack_level)Úensure_dtype_can_hold_naÚfind_common_type)Úis_1d_only_ea_dtypeÚ is_scalarÚneeds_i8_conversion)Ú concat_compat)ÚExtensionDtypeÚ SparseDtype)Úis_valid_na_for_dtypeÚisnaÚisna_all)Ú ensure_wrapped_if_datetimelike)Ú ArrayManager)Úensure_block_shapeÚ new_block_2d)Ú BlockManagerÚ make_na_array)ÚSequence)Ú ArrayLikeÚAxisIntÚDtypeObjÚ Manager2DÚShape)ÚIndex)ÚBlockÚBlockPlacementc ón |dk( r| d j | |« S |dk( sJ | d j | |« S )zí
|
Concatenate array managers into one.
|
|
Parameters
|
----------
|
mgrs_indexers : list of (ArrayManager, {axis: indexer,...}) tuples
|
axes : list of Index
|
concat_axis : int
|
|
Returns
|
-------
|
ArrayManager
|
é r )Úconcat_verticalÚconcat_horizontal)ÚmgrsÚaxesÚ concat_axiss úOH:\Change_password\venv_build\Lib\site-packages\pandas/core/internals/concat.pyÚ_concatenate_array_managersr/ F sJ ð aÒØAw×&Ñ& t¨TÓ2Ð2ð aÒ Ð Ð ØAw×(Ñ(¨¨tÓ4Ð4ó c ó* |xr |dk( }t | d d t « rt || |« }t |||« S |dk( r"t || |« }|d j ||« S t | « dkD r¤| d d j dkD r| d d j d j t j t j fv rNt fd| D « « r:t | « dkD r,t d |D « « }t | |« }t |f|« S t || |« }t |« dk( r |d }|j! d¬« } || _ | S t% |« }
|
g } |
|
D ] \ } } | d }|j& }t) | « r´| D cg c] }|j& j* }}|j, st j. |d¬« }n>t1 |j « r t3 |dd¬ « }t5 |d
|
¬ « }n t3 |d¬« }t7 |« }|j* j |j k( }nt9 | |¬ « }d}|r|j; || ¬ « }n t= || ¬ « }| j? |« t t | « |« S c c}w )zý
|
Concatenate block managers into one.
|
|
Parameters
|
----------
|
mgrs_indexers : list of (BlockManager, {axis: indexer,...}) tuples
|
axes : list of Index
|
concat_axis : int
|
copy : bool
|
|
Returns
|
-------
|
BlockManager
|
r c 3 ó< K | ] \ }}t |« y w©N)Ú_is_homogeneous_mgr)Ú.0ÚmgrÚ_Ú first_dtypes r. ú <genexpr>z'concatenate_managers.<locals>.<genexpr> s øè ø ÒV¹f¸cÀ1Ô'¨¨[×9ÑVùs r( c 3 ó2 K | ] }t |« y wr3 )Úlen)r5 Úxs r. r9 z'concatenate_managers.<locals>.<genexpr> s è ø Ò 3¨c !fÑ 3ùó F)Údeep©ÚaxisT©r@ Úea_compat_axisé )Úndim)Úcopy)Ú placement) Ú
|
isinstancer Ú _maybe_reindex_columns_na_proxyr/ r* r; ÚnblocksÚblocksÚdtypeÚnpÚfloat64Úfloat32ÚallÚtupleÚ _concat_homogeneous_fastpathr rE r, Ú_get_combined_planÚblockÚ_is_uniform_join_unitsÚvaluesÚ is_extensionÚ concatenater r r r Ú_concatenate_join_unitsÚmake_block_same_classr Úappend)Ú mgrs_indexersr, r- rE Ú
|
needs_copyr+ ÚshapeÚnbr6 ÚoutÚ concat_planrJ rF Ú
|
join_unitsÚunitÚblkÚjuÚvalsrU ÚfastpathÚbr8 s @r. Úconcatenate_managersrh ^ s
ø ð$ Ò*+¨Ñ*Jô - Ñ" 1Ñ%¤|Ô4Ü.¨t°]ÀJÓOô +Ø $ ó
|
ð
|
ð aÒÜ.¨t°]ÀJÓOØAw×(Ñ(¨¨tÓ4Ð4ä
|
=ÓAÒ -°Ñ"2°1Ñ"5×"=Ñ"=ÀÒ"AØ# AÑ& qÑ)×0Ñ0°Ñ3×9Ñ9 Ø 2::¤r§z¡zÐ2Ñ 2ô ÓVÈ ÔVÔVÜ Ó&¨Ò*ô Ñ 3¨dÔ 3Ó3Ü1°-ÀÈ ÓTÜ# R E¨4Ó0Ð0ä *¨4° À
|
Ó KDä
|
4yA~Ø1gØhhEhÓ"ØØ
|
ä$ TÓ*Kà Fð "-ó #Ñ :Ø!}Øjjä ! *Ô -Ø.8Ö9¨BHHOOÐ9DÐ9à×#Ò#ô ¨°1Ô5Ü$ S§Y¡YÔ/ä& t°!ÀDÔIÜ+¨F¸Ô;ä& t°!Ô4ä3°FÓ;Fàzz×'Ñ'¨6¯<©<Ñ7Hä,¨Z¸dÔCFØ Há Ø×)Ñ)¨&¸IÐ)ÓFAä V¨yÔ9Aà aÖðG#ôJ f tÓ ,Ð,ùòA :s Æ Jc óÔ g }|D ]` \ }}|j « D ]# \ }}|j | | || |dddd¬« }% |r|s|j « }|j |« b |S )zô
|
Reindex along columns so that all of the BlockManagers being concatenated
|
have matching columns.
|
|
Columns added in this reindexing have dtype=np.void, indicating they
|
should be ignored when choosing a column's final dtype.
|
FT)r@ rE Ú
|
only_sliceÚ
|
allow_dupsÚ use_na_proxy)ÚitemsÚreindex_indexerrE rZ )r, r[ r\ Únew_mgrsr6 ÚindexersÚiÚindexers r. rH rH Ê s ð Hà&ò Xð #..Ó*ò JAwØ×%Ñ%ØQØ ØØØ Ø Ø !ð &ó Cð ñ hØ((*CàÕ ð! ð" Or0 c óÒ | j dk7 ry| j d }|j j r#|j j j
|
dk( sy|j |k( S )zC
|
Check if this Manager can be treated as a single ndarray.
|
r( Fr )rI rJ Úmgr_locsÚ is_slice_likeÚas_sliceÚsteprK )r6 r8 rc s r. r4 r4 ì sV ð {{aÒØØ
|
**Q-CØ LL× &Ò &¨3¯<©<×+@Ñ+@×+EÑ+EÈÒ+JØà 99 Ñ #Ð#r0 c ó t d | D « « r| D cg c]( \ }}|j d j j * }}}t j
|
|« j }t j t |d « « }t ||« }|S t j ||¬« }|t j k( rt j } nt j } d}
|
| D ]r \ }} |j d } |
|
| z } d| v r. | |j d j | d |dd
|
|
|
f « n"|j d j |dd
|
|
|
f< |
|
| z }
|
t t j t |d « « }t ||« }|S c c}}w )zl
|
With single-Block managers with homogeneous dtypes (that can already hold nan),
|
we avoid [...]
|
c 3 ó( K | ]
|
\ }}| y wr3 © )r5 r7 rp s r. r9 z/_concat_homogeneous_fastpath.<locals>.<genexpr> s è ø Ò
|
9KAxx<Ñ
|
9ùs r )rK r( N)rO rJ rU ÚTrL rW Ú libinternalsr& Úslicer ÚemptyrM ÚlibalgosÚ take_2d_axis0_float64_float64Ú take_2d_axis0_float32_float32r] )r[ r] r8 r6 r7 ÚarrsÚarrÚbpr^ Ú take_funcÚstartrp Úmgr_lenÚends r. rQ rQ ù so ô Ñ
|
9¨=Ô
|
9Ô9à5B×C©6¨3°
|
|
1 ×$Ñ$×&Ó&ÐCÑCÜnnTÓ"×$Ñ$Ü × (Ñ (¬¨u°Q©x« Ó 9Ü #rÓ "Ø ä
|
((5 Ô
|
,CàbjjÒ Ü ×:Ñ: ä ×:Ñ: à EØ&ò XØ))A,Øgoà =Ù Ø
|
|
1 ×$Ñ$Ø ØAuSyLÑ!õ ð !$§
|
¡
|
¨1¡ × 4Ñ 4C59 Ñ à Ñð ô
|
× $Ñ $¤U¨5°©8£_Ó 5BÜ c2Ó BØ IùóA Ds -F c óp g }| d j d }| D cg c] }|j }}t j |« }t |« D ]` \ }\ }}g } t | « D ]5 \ }
|
}||
|
} t ||| |¬« } t | « } | j | « 7 |j || f« b |S c c}w )Nr )Úmax_len)r] Úblknosr| Úget_concat_blkno_indexersÚ enumerateÚ_get_block_for_concat_planÚJoinUnitrZ )r+ Úplanr r6 Ú blknos_listÚpairsÚindr r Ú units_for_bpÚkÚblknor^ rb s r. rR rR ( sÌ ð Dà1gmmAÑ Gà)-Ö. #3::Ð.KÐ.Ü × 2Ñ 2°;Ó ?EÜ & uÓ -ò (Ñ\fbð Ü oò &FAsØ1IEä+¨C°°UÀGÔLBÜB<DØ × Ñ Õ %ð &ð R Ð&Õ'ð (ð Kùò! /s B3c ó¦ | j | }t |« t |j « k( r=|j j r'|j j j
|
dk( r|}|S | j |j }t j ||« }t |t « r|j |« }|S |j |« }|S )Nr( )rJ r; rt ru rv rw Úblklocsrr r Úmaybe_indices_to_slicerG r} Úslice_block_columnsÚtake_block_columns)r6 r r r rc r^ Úax0_blk_indexerÚslcs r. r r B s» ð **UÑ
|
Cô 2w#cllÓ#Ò#Ø ×"Ò" s§|¡|×'<Ñ'<×'AÑ'AÀQÒ'Fà ð Ið ++ b§j¡jÑ1ä×(Ñ(¨ ¸'ÓBô c5Ô !Ø×(Ñ(¨Ó-Bð
|
Ið ×'Ñ'¨Ó,Bð Ir0 c óP e Zd ZddZd dZd
|
dZed d« Zed d« Zd dZ y) r c ó || _ y r3 )rS )ÚselfrS s r. Ú__init__zJoinUnit.__init___ s Ø
|
r0 c ó^ t | « j dt | j « dS )Nú(ú))ÚtypeÚ__name__ÚreprrS )r s r. Ú__repr__zJoinUnit.__repr__b s* Üt*×%Ñ%Ð& a¬¨T¯Z©ZÓ(8Ð'9¸Ð;Ð;r0 c óx | j sy| j }|j j dk( ry|j t k( r0|j
|
}t fd|j d¬« D « « S |j }|t u r|j k7 ry|t u r t « ryt |« S )z¯
|
Check that we are all-NA of a type/dtype that is compatible with this dtype.
|
Augments `self.is_na` with an additional check of the type of NA values.
|
FÚVTc 3 ó6 K | ] }t |« y wr3 )r )r5 r< rK s r. r9 z,JoinUnit._is_valid_na_for.<locals>.<genexpr>s s øè ø ÒX¸1Ô,¨Q°×6ÑXùs ÚK)Úorder) Úis_narS rK ÚkindÚobjectrU rO ÚravelÚ
|
fill_valuer r
|
r r )r rK rc rU Úna_values ` r. Ú_is_valid_na_forzJoinUnit._is_valid_na_fore s ø ð
|
zzØàjjØ 99>>SÒ Øà 99Ò ØZZFÜÓXÀÇ Á ÐSVÀ Ó@WÔXÓXÐ Xà>>Ø s?syy¨EÒ 1ð à r>Ô 1°%Ô 8ð ô % X¨uÓ5Ð5r0 c ó¤ | j }|j j dk( ry|j sy|j }|j
|
dk( ryt |j t « ry|j dk( r'|d }t |« r t |« syt |« S |d d }t |« r t |« syt d |D « « S )Nrª TFr r( c 3 ó2 K | ] }t |« y wr3 )r )r5 Úrows r. r9 z!JoinUnit.is_na.<locals>.<genexpr>¢ s è ø Ò7¨x }Ñ7ùr= ) rS rK r¯ Ú _can_hold_narU ÚsizerG r rD r r r rO )r rc rU Úvals r. r® zJoinUnit.is_na
s± àjjØ 99>>SÒ Øà× Ò ØàØ ;;!Ò àä fll¤KÔ 0Øà ;;!Ò à)CÜ S>¬¨c¬à ÜFÓ#Ð #à)A,CÜ S>¬¨c¬à ÜÑ7°Ô7Ó7Ð 7r0 c óP | j }|j j dk( ryy)z{
|
Will self.is_na be True after values.size == 0 deprecation and isna_all
|
deprecation are enforced?
|
rª TF©rS rK r¯ )r rc s r. Ú)is_na_after_size_and_isna_all_deprecationz2JoinUnit.is_na_after_size_and_isna_all_deprecation¤ s# ð jjØ 99>>SÒ ØØr0 c óê |9| j j j dk7 r| j j S |}| j |« r| j j }|t j d« k( rAt t
|
j | j j « }|j r|d d }t || j j |« S | j j S )Nrª r° )r r ) rS rK r¯ rU r´ rL r Úndarrayr¹ r r] )r Ú empty_dtypeÚ upcasted_nar² Ú blk_dtyperU s r. Úget_reindexed_valuesz JoinUnit.get_reindexed_values¯ s¾ ð Ð 4§:¡:×#3Ñ#3×#8Ñ#8¸CÒ#?à::×$Ñ$Ð $à$Jà×$Ñ$ [Ô1à JJ× ,Ñ , à ¤§¡¨Ó 2Ò2ô "¤"§*¡*¨d¯j©j×.?Ñ.?Ó @FØ {{ v¨d¡|Ð';Ø%)
|
ä$ [°$·*±*×2BÑ2BÀJÓOÐOà::×$Ñ$Ð $r0 N)rS r% ÚreturnÚNone)rÄ Ústr)rK r! rÄ Úbool)rÄ rÇ )rÀ r! rÄ r )
|
r¦ Ú
|
__module__Ú __qualname__r¡ r¨ r´ r r® r½ rà rz r0 r. r r ^ s? óó<ó 6ð@ ò 8ó ð 8ð< òó ðô%r0 r c óð t | « \ }}t d | D « « }t ||« }| D cg c] }|j ||¬« }}t d |D « « rH|D cg c]" }t |j
|
« r|n|ddd
f $ }}t |dd¬« } t | d« } n t |d ¬
|
« } ||k7 r3|| j
|
k( r$t j d t t « ¬ « | S c c}w c c}w ) zB
|
Concatenate values from several join units along axis=1.
|
c 3 ób K | ]' }|j j j d k( ) yw©rª Nr¼ ©r5 rb s r. r9 z*_concatenate_join_units.<locals>.<genexpr>Ï ó% è ø ÒN¸4$**×*Ñ*×/Ñ/°3Õ6ÑNùó -/)rÀ rÁ c 3 óF K | ] }t |j « y wr3 )r rK )r5 Úts r. r9 z*_concatenate_join_units.<locals>.<genexpr>× s è ø Ò
|
;¨AÔ qww× 'Ñ
|
;ùs !r NTrA rC r( r? a The behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.)Ú
|
stacklevel) Ú_get_empty_dtypeÚanyÚ_dtype_to_na_valuerà r rK r r ÚwarningsÚwarnÚ FutureWarningr )
|
ra rE rÀ Úempty_dtype_futureÚhas_none_blocksrÁ rd Ú to_concatrÑ Ú concat_valuess
|
r. rX rX É s ô '7°zÓ&BÑ#KÐ#äÑNÀ:ÔNÓNOÜ$ [°/ÓBKð öà ð × Ñ ¨KÀ[Ð ÕQðIð ô
|
Ñ
|
;°Ô
|
;Ô;ð ö
|
ð ô # 1§7¡7Ô+ñ à1a4ñ ð
|
ð
|
ô & i°aÈÔM Ü*¨=¸!Ó< ô & i°aÔ8 àÐ(Ò(Ø -×-Ñ-Ò -ä MMð(ô
|
Ü+Ó-õ ð ÐùòEùò
|
s ±C.Á#'C3c ób t | t « r | j S | j dv r| j d« S | j dv r| j d« S | j dk( ry| j dv r|syt
|
j S | j dk( rt
|
j S t ) z2
|
Find the NA value to go with this dtype.
|
ÚmMr ÚfcÚNaNrg NÚiuÚO)rG r r³ r¯ r¥ rL ÚnanÚNotImplementedError)rK rÚ s r. rÕ rÕ ÷ s ô % Ô(Ø~~Ð Ø tÑ Øzz%Ó Ð Ø tÑ Øzz%Ó Ð Ø sÒ àØ tÑ Ù àÜvv Ø sÒ Üvv Ü
|
Ð r0 c óÎ t j | D cg c] }|j j c}« r | d j j }||fS t d | D « « }| D cg c]% }|j
|
r|j j ' }}t |« sG| D cg c]< }|j j j dk7 s'|j j > }}t |« }|r t |« }|}t |« t | « k7 r°| D cg c]$ }|j s|j j & }}t |« sG| D cg c]< }|j j j dk7 s'|j j > }}t |« t |« k7 rt |« }|r t |« }||fS c c}w c c}w c c}w c c}w c c}w )zÂ
|
Return dtype and N/A values to use when concatenating specified units.
|
|
Returned N/A value may be None which means there was no casting involved.
|
|
Returns
|
-------
|
dtype
|
r c 3 ób K | ]' }|j j j d k( ) ywrÌ r¼ rÍ s r. r9 z#_get_empty_dtype.<locals>.<genexpr> rÎ rÏ rª ) r Údtypes_all_equalrS rK rÔ r® r; r¯ r r r½ ) ra rd rÀ rÚ rb ÚdtypesrK Ú dtype_futureÚ dtypes_futures r. rÓ rÓ s² ô ×Ñ°jÖ A°RXX^^Ò AÔBØ m×)Ñ)×/Ñ/ ØKÐ'Ð'äÑNÀ:ÔNÓNOà+5Ö H 4¸T¿Z»Zdjj× Ó Ð HFÐ HÜ v;à)3ö
|
Ø!%°t·z±z×7GÑ7G×7LÑ7LÐPSÓ7SDJJ× Ó ð
|
ð
|
ô VÓ $EÙÜ(¨Ó/àLÜ
|
6{c*oÒ%ð #ö
|
àØ×AÒAð JJ× Ó ð
|
ð
|
ô
|
=Ô!à-7ö Ø%)¸4¿:¹:×;KÑ;K×;PÑ;PÐTWÓ;W
|
|
× Ó ð Mð ô v;#mÓ,Ò ,Ü+¨MÓ:LÙ Ü 7¸ Ó E à ,Ð Ð ùòC Bùò Iùò
|
ùò
|
ùò s/ GÁ+GÁ=GÂ&(GÃGÄ )G Å(G"ÆG"c óÒ | d j j j dk( ryt fd| D « « xr( t fd| D « « xr t d | D « « S )zÏ
|
Check if the join units consist of blocks of uniform type that can
|
be concatenated using Block.concat_same_type instead of the generic
|
_concatenate_join_units (which uses `concat_compat`).
|
|
r rª Fc 3 ó^ K | ]$ }t |j « t « u & y wr3 )r¥ rS ©r5 rd Úfirsts r. r9 z)_is_uniform_join_units.<locals>.<genexpr>H s" øè ø Ò ?¨bDNd 5kÔ )Ñ ?ùs *-c 3 ó¬ K | ]K }|j j j k( xs" |j j j d v M yw)ÚiubNr¼ rí s r. r9 z)_is_uniform_join_units.<locals>.<genexpr>K sN øè ø ò
|
ð
|
ð HHNNekkÑ )ò ,ð xx~~×"Ñ" eÐ+ó ,ñ
|
ùs AAc 3 óf K | ]) }|j xs |j j + y wr3 )r® rS rV )r5 rd s r. r9 z)_is_uniform_join_units.<locals>.<genexpr>U s( è ø Ò G°bLÒ 1BHH× 1Ñ 1Ó 1Ñ Gùs /1)rS rK r¯ rO )ra rî s @r. rT rT < ss ø ð qM× Ñ EØ {{×Ñ3Ò Øô Ó ?°JÔ ?Ó?ò Hô ó
|
ð
|
!ô
|
ó
|
ò Hô Ñ G¸JÔ GÓGð r0 )r+ zlist[ArrayManager]r, ú list[Index]r- r rÄ r" )r, rò r- r rE rÇ rÄ r" )r, rò r[ z0list[tuple[BlockManager, dict[int, np.ndarray]]]r\ rÇ rÄ úlist[BlockManager])r6 r r8 r! rÄ rÇ )r] r# r8 znp.dtyperÄ r% )r+ ró rÄ z+list[tuple[BlockPlacement, list[JoinUnit]]])
|
r6 r r r& r Úintr rô rÄ r% )ra úlist[JoinUnit]rE rÇ rÄ r )rK r! rÚ rÇ )ra zSequence[JoinUnit]rÄ ztuple[DtypeObj, DtypeObj])ra rõ rÄ rÇ )GÚ
|
__future__r Útypingr r rÖ ÚnumpyrL Ú pandas._libsr r r r r| r Úpandas._libs.missingr
|
Úpandas.util._decoratorsr Úpandas.util._exceptionsr Úpandas.core.dtypes.castr r Úpandas.core.dtypes.commonr r r Úpandas.core.dtypes.concatr Úpandas.core.dtypes.dtypesr r Úpandas.core.dtypes.missingr r r Úpandas.core.constructionr Ú#pandas.core.internals.array_managerr Ú pandas.core.internals.blocksr r Ú pandas.core.internals.managersr r Úcollections.abcr Úpandas._typingr r r! r" r# Úpandasr$ r% r& r/ rh rH r4 rQ rR r r rX rÕ rÓ rT rz r0 r. ú<module>r s~ ðÝ "÷ó ã ÷ó õ $Ý 2Ý 4÷÷ñ õ
|
4÷÷ñ õ DÝ <÷÷ñ
|
Ý(÷õ õ ÷ð 5Ø
|
ð5Ø$/ð5Ø>Eð5àó5ð0i-Ø$ði-Ø3:ði-ØBFði-àói-ðX Ø
|
ð àCð ð ð ð ó óD
|
$ð,Ø ð,Ø.6ð,à
|
ó,ð^Ø
|
ðà0óð4Ø ðØ)ðØ25ðØCFðà
|
ó÷8h%ñ h%óV+ó\ ó.+ ô\r0
|
