Ë
|
nñúhH+ ã óº d dl mZ d dlmZ d dlZd dlmZ d dlmZ d dl m
|
Z
|
m Z d dl m Z d dlmZ d d lmZ d d
|
lmZ d d lmZ er d d lmZ d d lmZ G d de« Zy)é )Ú annotations)Ú TYPE_CHECKINGN)Úlib)Úimport_optional_dependency)Ú ParserErrorÚ ParserWarning)Úfind_stack_level)Ú pandas_dtype)Ú
|
is_integer)Úarrow_table_to_pandas)Ú
|
ParserBase)Ú
|
ReadBuffer)Ú DataFramec óL e Zd ZdZd fd Zd dZd dZd
|
dZd dZd dZ xZ
|
S ) ÚArrowParserWrapperz7
|
Wrapper for the pyarrow engine for read_csv()
|
c ó` t | |« || _ || _ | j « y ©N)ÚsuperÚ__init__ÚkwdsÚsrcÚ _parse_kwds)Úselfr r Ú __class__s úYH:\Change_password\venv_build\Lib\site-packages\pandas/io/parsers/arrow_parser_wrapper.pyr zArrowParserWrapper.__init__ s* ø Ü ÑÔ Ø Øà ×ÑÕó c óÞ | j j d« }|dn|| _ | j d }t |t « r t d« t | j d « | _ y)z?
|
Validates keywords before passing to pyarrow.
|
ÚencodingNzutf-8Ú na_valuesz?The pyarrow engine doesn't support passing a dict for na_values)r Úgetr Ú
|
isinstanceÚdictÚ
|
ValueErrorÚlistr )r r r s r r z ArrowParserWrapper._parse_kwds& sc ð $yy}}¨ZÓ 8Ø#+Ð#3¸ àIIkÑ* Ü i¤Ô &Ü ØQóð ô dii¨ Ñ 4Ó5r c ó0 ddddddd}|j « D ]X \ }}|| j v s| j j |« 1| j j |« | j |< Z | j }t |t « r|g}nd}|| j d < | j j « D ci c] \ }}||d
|
v r|| c}}| _ | j j d « }|¦t |« r|| j d < n|t j j k( rd| j d < n^|t j j k( rdd }|| j d < n-|t j j k( rd | j d < | j j « D ci c] \ }}||dv r|| c}}| _ d| j d v | j d< | j ;d| j v r-| j d D cg c] } d| c} | j d< | j du | j | j n| j d | j d| _ yc c}}w c c}}w c c} w )z:
|
Rename some arguments to pass to pyarrow
|
Úinclude_columnsÚ null_valuesÚ escape_charÚignore_empty_linesÚ decimal_pointÚ
|
quote_char)Úusecolsr Ú
|
escapecharÚskip_blank_linesÚdecimalÚ quotecharNÚtimestamp_parsers)Ú delimiterr+ r( r) Ú on_bad_linesÚinvalid_row_handlerc ó t j d| j d| j d| j t
|
t « ¬« y)Nz Expected z columns, but found z: )Ú
|
stacklevelÚskip)ÚwarningsÚwarnÚexpected_columnsÚactual_columnsÚtextr r )Ú invalid_rows r Úhandle_warningz?ArrowParserWrapper._get_pyarrow_options.<locals>.handle_warninge sL Ü MMØ# K×$@Ñ$@Ð#AÐAUØ&×5Ñ5Ð6°b¸×9IÑ9IÐ8JðLä%Ü#3Ó#5õ ð "r c ó y)Nr7 © )Ú_s r ú<lambda>z9ArrowParserWrapper._get_pyarrow_options.<locals>.<lambda>p s r )r& r' Ú true_valuesÚ false_valuesr* r1 Ú Ústrings_can_be_nullÚfÚskiprows)Úautogenerate_column_namesÚ skip_rowsr )ÚreturnÚstr)Úitemsr r ÚpopÚ date_formatr! rL Ú parse_optionsÚcallabler ÚBadLineHandleMethodÚERRORÚWARNÚSKIPÚconvert_optionsÚheaderr Ú read_options)
|
r ÚmappingÚ pandas_nameÚ pyarrow_namerO Ú option_nameÚ option_valuer3 r> Úns
|
r Ú_get_pyarrow_optionsz'ArrowParserWrapper._get_pyarrow_options4 s ð
|
)Ø&Ø'Ø 4Ø&Ø%ñ
|
ð *1¯ © « ò EÑ %K ØdiiÒ'¨D¯I©I¯M©M¸+Ó,FÑ,RØ*.¯)©)¯-©-¸ Ó*D ,Ò'ð Eð ×&Ñ& Ü k¤3Ô 'Ø&-Kð KØ)4 Ð%Ñ&ð .2¯Y©Y¯_©_Ó->÷
|
á) \ØÐ'ØØOñPð Ñ %ó
|
Ôð yy}} ^Ó4 Ø Ð #Ü Ô%Ø<H×"Ñ"Ð#8Ò9Ø ¤×!?Ñ!?×!EÑ!EÒEð ð ×"Ñ"Ø)òð ¤×!?Ñ!?×!DÑ!DÒDó"ð =K×"Ñ"Ð#8Ò9Ø ¤×!?Ñ!?×!DÑ!DÒDÙ<L×"Ñ"Ð#8Ñ9ð .2¯Y©Y¯_©_Ó->÷
|
á) \ØÐ'Øðñð Ñ %ó
|
Ô ð 79¸D¿I¹IÀmÑ<TÐ6T× Ñ Ð 2Ñ3à ;;Ð Ð#4¸×8LÑ8LÑ#Là!%×!5Ñ!5Ð6GÑ!Hö7Ø !A3ò7D× Ñ Ð!2Ñ 3ð
|
*.¯©¸Ð)<à{{Ð&ð à:Ñ&Ø ñ
|
Õùói
|
ùó>
|
ùò"7s ÃJÆ?J È$ Jc óX t |j « }d}| j | j | j t |« | _ t | j « |k7 rMt |t | j « z
|
« D cg c] }t |« }}|| j z | _ d}| j |_ | j |j |« \ }}| j l| j j « }t | j « D ]æ \ }} t | « r|j | ||< n | |j vrt d| d« | j N| j j | « | | j j | « fn6|j | | j j |j | « f\ }
|
} | Ã||
|
j | « ||
|
< | j |
|
= è |j |dd¬« | j 4|s2dgt |j j « z |j _ | j t# | j t$ « rK| j j' « D ci c] \ } } | |j v r | t) | « ! c} } | _ nt) | j « | _ |j | j « }|S |S c c}w c c} } w # t* $ r}t |« d}~ww xY w)z÷
|
Processes data read in based on kwargs.
|
|
Parameters
|
----------
|
frame: DataFrame
|
The DataFrame to process.
|
|
Returns
|
-------
|
DataFrame
|
The processed DataFrame.
|
TNFzIndex z invalid)ÚdropÚinplace)ÚlenÚcolumnsrW ÚnamesÚrangerL Ú_do_date_conversionsÚ index_colÚcopyÚ enumerater r# Údtyper ÚastypeÚ set_indexÚindexr! r" rM r
|
Ú TypeError)r ÚframeÚnum_colsÚmulti_index_namedÚxÚcolumns_prefixrA Ú index_to_setÚiÚitemÚkeyÚ new_dtypeÚkÚvÚes r Ú_finalize_pandas_outputz*ArrowParserWrapper._finalize_pandas_output s¹ ô u}}Ó%Ø ÐØ ;;Ð ØzzÐ!Ø;;Ð&Ü!& x£ DJÜ4:: (Ò*ô
|
38¸Ä3ÀtÇzÁzÃ?Ñ8RÓ2SÖ!T¨Q¤# a¥&Ð!TÐ!TØ +¨d¯j©jÑ 8
|
Ø$)Ð!Ø JJEMà×,Ñ,¨U¯]©]¸EÓB5Ø >>Ñ %Ø >>×.Ñ.Ó0LÜ$ T§^¡^Ó4ò ,4Ü dÔ#Ø&+§m¡m°DÑ&9L Oà § ¡ Ñ.Ü$ v¨d¨V°8Ð%<Ó=Ð=ð ::Ñ)ð ::>>¨$Ó/Ð;ð tzz~~¨dÓ 3Ñ4à #mm¨DÑ 1°4·:±:·>±>À%Ç-Á-ÐPTÑBUÓ3VÐ Wñ #Cð
|
!Ñ,Ø%*¨3¡Z×%6Ñ%6°yÓ%Ac
|
Ø JJ sOð! ,ð$ OOL¨t¸TOÔ Bà{{Ð"Ñ+<Ø%) F¬S°·±×1BÑ1BÓ-CÑ$C Ô!à ::Ð !ô $**¤dÔ+ð !%§
|
¡
|
× 0Ñ 0Ó 2÷ á 1ØEMMÑ)ð | AÑ&ó
|
ô *¨$¯*©*Ó 5
|
ð $Ø T§Z¡ZÓ0ð u ùò_ "UùóF øô ò $ä mÐ#ûð $ús$ ÂLÊ $L
|
Ë&L Ì L)Ì L$Ì$L)c ó t j |« r t d |D « « s t d« t |« r t d« y )Nc 3 ó< K | ] }t |t « y wr ©r! rL ©Ú.0rs s r ú <genexpr>z7ArrowParserWrapper._validate_usecols.<locals>.<genexpr>Ú s è ø Ò0UÈ´¸A¼s×1CÑ0Uùó zwThe pyarrow engine does not allow 'usecols' to be integer column positions. Pass a list of string column names instead.z=The pyarrow engine does not allow 'usecols' to be a callable.)r Ú is_list_likeÚallr# rQ )r r, s r Ú_validate_usecolsz$ArrowParserWrapper._validate_usecolsÙ sO Ü × Ñ GÔ $¬SÑ0UÈWÔ0UÔ-UÜ ðPóð ô gÔ Ü ØOóð ð r c óä t d« }t d« }| j « |j di | j ¤} |j | j |j di | j ¤ |j di | j ¤|¬« }| j& d }|t j( u r |j* } |j- « }
|
t/ |j* j0 « D ]Q \ } } |j0 j3 | « s"| j | | j5 | « j7 |
|
« « } S |j9 | « }t; j< « 5 t; j> d
|
d t@ « tC ||d ¬ « } ddd« | jE « S # t $ r | j j dd« }|| j |« | j j dt « « }t j |« rt d |D « « s t d« w xY w# |j" $ r}t% |« |d}~ww xY w# 1 sw Y ÐxY w)zÿ
|
Reads the contents of a CSV file into a DataFrame and
|
processes it according to the kwargs passed in the
|
constructor.
|
|
Returns
|
-------
|
DataFrame
|
The DataFrame created from the CSV file.
|
Úpyarrowz pyarrow.csvr& Nr' c 3 ó< K | ] }t |t « y wr r r s r r z*ArrowParserWrapper.read.<locals>.<genexpr>û s è ø ò 6Ø'(
|
1c×"ñ6ùr z9The 'pyarrow' engine requires all na_values to be strings)rX rP rV Ú dtype_backendÚignorezmake_block is deprecatedT)r Ú null_to_int64r@ )#r r_ ÚConvertOptionsrV ro r r Úsetr r
r Úread_csvr Ú ReadOptionsrX Ú ParseOptionsrP Ú ArrowInvalidr r Ú
|
no_defaultÚschemaÚfloat64rj ÚtypesÚis_nullÚfieldÚ with_typeÚcastr8 Úcatch_warningsÚfilterwarningsÚDeprecationWarningr r} )r ÚpaÚ pyarrow_csvrV ÚincludeÚnullsÚtabler| r Ú
|
new_schemaÚnew_typerv Ú
|
arrow_typerp s r ÚreadzArrowParserWrapper.readä sJ ô (¨ Ó 2Ü0° Ó? Ø ×!Ñ!Ô#ð Ø 8k× 8Ñ 8Ñ P¸4×;OÑ;OÑ POð (Ø ×(Ñ(ØØ 4[× 4Ñ 4Ñ I°t×7HÑ7HÑ IØ 6k× 6Ñ 6Ñ L¸×9KÑ9KÑ LØ /ð )ó Eð /Ñ2 ð CNNÑ *Ø JØzz|HÜ!*¨5¯<©<×+=Ñ+=Ó!>ò :Ø88×#Ñ# JÕ/Ø!+§ ¡ Ø:×+Ñ+¨AÓ.×8Ñ8¸ÓBó"Jð ð JJzÓ*Eä × $Ñ $Ó &ñ Ü × #Ñ #ØØ*Ü"ô ô
|
*Ø ]À$ôE÷ ð ×+Ñ+¨EÓ2Ð2øôe ò Ø×*Ñ*×.Ñ.Ð/@À$ÓGGØÐ"Ø×&Ñ& wÔ/à×(Ñ(×,Ñ,¨]¼C»EÓBEÜ×#Ñ# EÔ*´#ñ 6Ø,1ô6ô 3ô ØOóð ð ð ûð, ò (Ü a. aÐ 'ûð (ú÷$ ð ús1 ¨ F0 ÁAI Å-*I&Æ0BI ÉI#É I É I#É&I/)r zReadBuffer[bytes]rK ÚNone)rK r¨ )rp r rK r )rK r ) Ú__name__Ú
|
__module__Ú __qualname__Ú__doc__r r r_ r} r r§ Ú __classcell__)r s @r r r s+ ø ñõó 6ó Y
|
óvHóT ÷C3r r )Ú
|
__future__r Útypingr r8 Ú pandas._libsr Úpandas.compat._optionalr Ú pandas.errorsr r Úpandas.util._exceptionsr Úpandas.core.dtypes.commonr
|
Ú pandas.core.dtypes.inferencer Úpandas.io._utilr Ú pandas.io.parsers.base_parserr Úpandas._typingr Úpandasr r r@ r r ú<module>rº sA ðÝ "å Û å Ý >÷õ 5å 2Ý 3å 1Ý 4áÝ)å ôM3õ M3r
|
