Ë
|
nñúh© ã ó¤ U d Z ddlmZ ddlmZ ddlmZmZ ddlmZ ddl Z ddl
|
Z
|
ddl Z ddl m Z mZmZmZmZmZ ddlZddlZddlmZ dd lmZ dd
|
lmZ dd l m Z m Z m Z m Z dd l!m"Z"m#Z# dd l$m%Z% ddl&m'Z' ddl(m)Z)m*Z*m+Z+ ddl,m-Z- ddl.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5 ddl6m7Z7 ddl8m9Z9 ddl:m;Z; ddl<m=Z= ddl>m?Z? ddl@mAZA er$ddlBmCZCmDZD ddlEmFZF ddl mGZG ddlHmIZImJZJmKZKmLZLmMZMmNZN d ZOd ZPd ZQd ZRd ZSd!ZTd"eP d#eQ d#eR d#eS d#e?d$ d%z d#e?d& d'eT d(ZUd)eP d#eQ d*ZVd+eP d#eQ d#eR d#e?d$ d#e?d& d,eT d# ZWg d-¢ZX ed.d/d/« ZYd0eZd1< dad2Z[dad3Z\d4Z]d0eZd5< d6Z^d0eZd7< d8Z_d0eZd9< d:Z`d0eZd;< d<Zad0eZd=< dbd>Zb G d? d@« Zc G dA dBec« Zd G dC dD« Ze G dE dF« Zf G dG dHefejÎ « Zh e"eU« dIdIddJdIddIddJdKddL dcdM« ZidddNZjdedOZkdfdPZldgdQZmdhdRZn di djdSZo e#e?d& e?dT dUz ¬V« G dW dXef« « ZpdkdYZqdldZZr G d[ d\« Zs G d] d^ep« Zt G d_ d`et« Zuy)ma°
|
Module contains tools for processing Stata files into DataFrames
|
|
The StataReader below was originally written by Joe Presbrey as part of PyDTA.
|
It has been extended and improved by Skipper Seabold from the Statsmodels
|
project who also developed the StataWriter and was finally added to pandas in
|
a once again improved version.
|
|
You can find more information on http://presbrey.mit.edu/PyDTA and
|
https://www.statsmodels.org/devel/
|
é )Ú annotations)Úabc)ÚdatetimeÚ timedelta)ÚBytesION)ÚIOÚ TYPE_CHECKINGÚAnyStrÚCallableÚFinalÚcast)Úlib)Ú infer_dtype)Úmax_len_string_array)Ú CategoricalConversionWarningÚInvalidColumnNameÚPossiblePrecisionLossÚValueLabelTypeMismatch)ÚAppenderÚdoc)Úfind_stack_level)ÚExtensionDtype)Ú ensure_objectÚis_numeric_dtypeÚis_string_dtype)ÚCategoricalDtype)Ú CategoricalÚ DatetimeIndexÚNaTÚ TimestampÚisnaÚ to_datetimeÚ to_timedelta)Ú DataFrame)ÚIndex)Ú
|
RangeIndex)ÚSeries)Ú _shared_docs)Ú
|
get_handle)ÚHashableÚSequence)Ú TracebackType)ÚLiteral)ÚCompressionOptionsÚFilePathÚ
|
ReadBufferÚSelfÚStorageOptionsÚ WriteBufferzîVersion of given Stata file is {version}. pandas supports importing versions 105, 108, 111 (Stata 7SE), 113 (Stata 8/9), 114 (Stata 10/11), 115 (Stata 12), 117 (Stata 13), 118 (Stata 14/15/16),and 119 (Stata 15/16, over 32,767 variables).zÌconvert_dates : bool, default True
|
Convert date variables to DataFrame time values.
|
convert_categoricals : bool, default True
|
Read value labels and convert columns to Categorical/Factor variables.a index_col : str, optional
|
Column to set as index.
|
convert_missing : bool, default False
|
Flag indicating whether to convert missing values to their Stata
|
representations. If False, missing values are replaced with nan.
|
If True, columns containing missing values are returned with
|
object data types and missing values are represented by
|
StataMissingValue objects.
|
preserve_dtypes : bool, default True
|
Preserve Stata datatypes. If False, numeric data are upcast to pandas
|
default types for foreign data (float64 or int64).
|
columns : list or None
|
Columns to retain. Columns will be returned in the given order. None
|
returns all columns.
|
order_categoricals : bool, default True
|
Flag indicating whether converted categorical data are ordered.zzchunksize : int, default None
|
Return StataReader object for iterations, returns chunks with
|
given number of lines.z=iterator : bool, default False
|
Return StataReader object.zúNotes
|
-----
|
Categorical variables read through an iterator may not have the same
|
categories and dtype. This occurs when a variable stored in a DTA
|
file is associated to an incomplete set of value labels that only
|
label a strict subset of the values.a>
|
Read Stata file into DataFrame.
|
|
Parameters
|
----------
|
filepath_or_buffer : str, path object or file-like object
|
Any valid string path is acceptable. The string could be a URL. Valid
|
URL schemes include http, ftp, s3, and file. For file URLs, a host is
|
expected. A local file could be: ``file://localhost/path/to/table.dta``.
|
|
If you want to pass in a path object, pandas accepts any ``os.PathLike``.
|
|
By file-like object, we refer to objects with a ``read()`` method,
|
such as a file handle (e.g. via builtin ``open`` function)
|
or ``StringIO``.
|
ú
|
Údecompression_optionsÚfilepath_or_bufferÚstorage_optionsz¼
|
|
Returns
|
-------
|
DataFrame or pandas.api.typing.StataReader
|
|
See Also
|
--------
|
io.stata.StataReader : Low-level reader for Stata data files.
|
DataFrame.to_stata: Export Stata data files.
|
|
a
|
|
Examples
|
--------
|
|
Creating a dummy stata for this example
|
|
>>> df = pd.DataFrame({'animal': ['falcon', 'parrot', 'falcon', 'parrot'],
|
... 'speed': [350, 18, 361, 15]}) # doctest: +SKIP
|
>>> df.to_stata('animals.dta') # doctest: +SKIP
|
|
Read a Stata dta file:
|
|
>>> df = pd.read_stata('animals.dta') # doctest: +SKIP
|
|
Read a Stata dta file in 10,000 line chunks:
|
|
>>> values = np.random.randint(0, 10, size=(20_000, 1), dtype="uint8") # doctest: +SKIP
|
>>> df = pd.DataFrame(values, columns=["i"]) # doctest: +SKIP
|
>>> df.to_stata('filename.dta') # doctest: +SKIP
|
|
>>> with pd.read_stata('filename.dta', chunksize=10000) as itr: # doctest: +SKIP
|
>>> for chunk in itr:
|
... # Operate on a single chunk, e.g., chunk.mean()
|
... pass # doctest: +SKIP
|
zReads observations from Stata file, converting them into a dataframe
|
|
Parameters
|
----------
|
nrows : int
|
Number of lines to read from data file, if None read whole file.
|
z
|
|
Returns
|
-------
|
DataFrame
|
zæClass for reading Stata dta files.
|
|
Parameters
|
----------
|
path_or_buf : path (string), buffer or path object
|
string, path object (pathlib.Path or py._path.local.LocalPath) or object
|
implementing a binary read() functions.
|
z
|
|
) ú%tcú%tCú%tdú%dú%twú%tmú%tqú%thú%tyé¨ é r Ú stata_epochc óÀ t j j t j j ct j t ddd« z
|
j
|
t j t ddd« z
|
j
|
dz dz dz dz dz dz d"fd }d"fd }d"fd }t j | « }d }|j « rd
|
}d | j |< | j t j « } |j d « rt }| } |||d « } n|j d« r=t j dt! « ¬« t# | t$ ¬« } |r t& | |< | S |j d« rt }| }
|
|||
|
d« } n+|j d« r(t j | dz z } | dz dz }
|
|| |
|
« } nò|j d« r(t j | dz z } | dz dz } || | « } n¹|j d« r+t j | dz z } | dz dz dz } || | « } n}|j d « r+t j | d z z } | d z d z dz } || | « } nA|j d « r!| } t j( | « } || |« } nt+ d | d!« |r t& | |< | S )#a
|
Convert from SIF to datetime. https://www.stata.com/help.cgi?datetime
|
|
Parameters
|
----------
|
dates : Series
|
The Stata Internal Format date to convert to datetime according to fmt
|
fmt : str
|
The format to convert to. Can be, tc, td, tw, tm, tq, th, ty
|
Returns
|
|
Returns
|
-------
|
converted : Series
|
The converted dates
|
|
Examples
|
--------
|
>>> dates = pd.Series([52])
|
>>> _stata_elapsed_date_to_datetime_vec(dates , "%tw")
|
0 1961-01-01
|
dtype: datetime64[ns]
|
|
Notes
|
-----
|
datetime/c - tc
|
milliseconds since 01jan1960 00:00:00.000, assuming 86,400 s/day
|
datetime/C - tC - NOT IMPLEMENTED
|
milliseconds since 01jan1960 00:00:00.000, adjusted for leap seconds
|
date - td
|
days since 01jan1960 (01jan1960 = 0)
|
weekly date - tw
|
weeks since 1960w1
|
This assumes 52 weeks in a year, then adds 7 * remainder of the weeks.
|
The datetime value is the start of the week in terms of days in the
|
year, not ISO calendar weeks.
|
monthly date - tm
|
months since 1960m1
|
quarterly date - tq
|
quarters since 1960q1
|
half-yearly date - th
|
half-years since 1960h1 yearly
|
date - ty
|
years since 0000
|
rA rB é i éè c ó | j « k r&| j « kD rt d| z |z d¬« S t | dd« }t t | |« D cg c] \ }}t ||d« c}}|¬« S c c}}w )zú
|
Convert year and month to datetimes, using pandas vectorized versions
|
when the date range falls within the range supported by pandas.
|
Otherwise it falls back to a slower but more robust method
|
using datetime.
|
éd z%Y%m©ÚformatÚindexNrB ©rK )ÚmaxÚminr" Úgetattrr' Úzipr )ÚyearÚmonthrK ÚyÚmÚMAX_YEARÚMIN_YEARs úBH:\Change_password\venv_build\Lib\site-packages\pandas/io/stata.pyÚconvert_year_month_safezD_stata_elapsed_date_to_datetime_vec.<locals>.convert_year_month_safe! st ø ð 88:Ò T§X¡X£Z°(Ò%:Ü s Tz¨EÑ 1¸&ÔAÐ AäD '¨4Ó0Eܼ¸TÀ5Ó9I×J±°°A8 A q¨!Õ,ÓJÐRWÔXÐ XùÓJs Á A=
|
c
|
óJ | j « dz
|
k r.| j « kD rt | d¬« t |d¬« z S t | dd« }t | |« D cg c]( \ }}t |dd« t t |« ¬« z * }}}t ||¬ « S c c}}w )
|
z{
|
Converts year (e.g. 1999) and days since the start of the year to a
|
datetime or datetime64 Series
|
rB ú%YrI Úd©ÚunitrK N©ÚdaysrL )
|
rM rN r" r# rO rP r r Úintr' )rQ r_ rK rS r[ ÚvaluerU rV s rW Úconvert_year_days_safezC_stata_elapsed_date_to_datetime_vec.<locals>.convert_year_days_safe. s ø ð
|
88: A Ò &¨4¯8©8«:¸Ò+@Ü t¨DÔ1´LÀÈCÔ4PÑPÐ PäD '¨4Ó0EäGJÈ4ÐQUÃ÷Ù?C¸qÀ!AqÓ!¤I´3°q³6Ô$:Ó:ðEñ ô % uÔ-Ð -ùós Á"-B c óü t |dd« }|dk( rX|j « kD s|j « k r|D cg c] }| t t |« ¬« z }}t ||¬« S |dk( r[|j « kD s|j « k r@|D cg c] }| t t |« dz ¬« z }}t ||¬« S t d « t | « } t ||¬
|
« }| |z S c c}w c c}w ) z¾
|
Convert base dates and deltas to datetimes, using pandas vectorized
|
versions if the deltas satisfy restrictions required to be expressed
|
as dates in pandas.
|
rK Nr[ r^ rL ÚmsrF )Ú microsecondszformat not understoodr\ ) rO rM rN r r` r' Ú
|
ValueErrorr" r# )
|
ÚbaseÚdeltasr] rK r[ ÚvaluesÚ MAX_DAY_DELTAÚ MAX_MS_DELTAÚ MIN_DAY_DELTAÚ MIN_MS_DELTAs
|
rW Úconvert_delta_safez?_stata_elapsed_date_to_datetime_vec.<locals>.convert_delta_safe< s÷ ø ô ¨Ó.Ø 3;Øzz|mÒ+¨v¯z©z«|¸mÒ/KØAGÖH¸A$¤´°A³Ô!7Ó7ÐHÐHÜ f¨EÔ2Ð2Ø T\Øzz|lÒ*¨f¯j©j«l¸\Ò.IàLRöØGHD9´3°q³6¸D±=ÔBÓBðð ô f¨EÔ2Ð2ä Ð 4Ó5Ð 5Ü4Ó Ü f¨4Ô0Øf}Ð ùò Iùòs ¾ C4Â"C9FTg ð?©r8 Útcrd ©r9 ÚtCz9Encountered %tC format. Leaving in Stata Internal Format.©Ú
|
stacklevel©Údtype)r: Útdr; r[ r[ ©r< Útwé4 é ©r= Útmé ©r> Útqé é ©r? Úthé é ©r@ Útyz Date fmt ú not understood)Úreturnr' )r rN rQ rM r r_ ÚnpÚisnanÚanyÚ_valuesÚastypeÚint64Ú
|
startswithrC ÚwarningsÚwarnr r' Úobjectr Ú ones_likerf )ÚdatesÚfmtrX rb rn Úbad_locsÚhas_bad_valuesrg rd Ú
|
conv_datesr_ rQ rR Ú quarter_monthÚ first_monthrj rk rU rl rm rV s @@@@@@rW Ú#_stata_elapsed_date_to_datetime_vecr í s® ý ô\ # ×+Ñ+¬Y¯]©]×-?Ñ-?ÐHhÜ ]]¤X¨d°A°qÓ%9Ñ9×?Ñ?MÜ ]]¤X¨d°A°qÓ%9Ñ9×?Ñ?MØ 2Ñ%¨Ñ,¨tÑ3LØ 2Ñ%¨Ñ,¨tÑ3Lö Yö .÷ ð ô2 xxHØNØ||~Ø Ø"% hÑ Ø LLÓ "Eà
|
~~mÔ$ÜØ Ù'¨¨b°$Ó7
|
Ø Ô &Ü Ø GÜ'Ó)õ
|
ô E¬Ô0
|
Ù Ü#&JxÑ ØÐà Ð0Ô 1ÜØÙ'¨¨d°CÓ8
|
ð
|
Ô &Ü× Ñ %¨2¡+Ñ-Ø
|
aÑ Ù+¨D°$Ó7
|
Ø Ô &Ü× Ñ %¨2¡+Ñ-ØqÑ Ù,¨T°5Ó9
|
Ø Ô &Ü× Ñ %¨1¡*Ñ,Ø a¨!Ñ+ Ù,¨T°=ÓA
|
Ø Ô &Ü× Ñ %¨1¡*Ñ,Øa !Ñ#Ù,¨T°5Ó9
|
Ø Ô &ØÜll 5Ó) Ù,¨T°;Ó?
|
ä9 S E¨ Ð9Ó:Ð:áÜ "
|
8Ñ à Ðó c ó | j ddz d# d$ fd }t | « }| j |j « rPt j | j
|
d« r t t « | j |< nt | j |< |dv r || d¬« }|j dz }n|d v r#t j d
|
t « ¬ « | }n\|d v r || d¬« }|j z }n=|d v r< || dd¬« }d|j t j z
|
z |j dz z }ný|dv r; || d¬« }d|j t j z
|
z |j z dz
|
}n¾|dv r> || d¬« }d|j t j z
|
z |j dz
|
dz z }n||dv rN || d¬« }d|j t j z
|
z |j dkD j! t" « z }n*|dv r || d¬« }|j }nt% d | d « t' |t( j* d¬ « }t- j. d d « d! }|||< t' | d¬"« S )%aO
|
Convert from datetime to SIF. https://www.stata.com/help.cgi?datetime
|
|
Parameters
|
----------
|
dates : Series
|
Series or array containing datetime or datetime64[ns] to
|
convert to the Stata Internal Format given by fmt
|
fmt : str
|
The format to convert to. Can be, tc, td, tw, tm, tq, th, ty
|
l "R: rF Fc óÚ i }t j | j d« r |rP| t t « j d« z
|
}|j j t j « dz |d< |s|r=t | « }|j j |d< |j j |d< |r%| j j t j « t |d d¬« j j t j « z
|
}| z |d < n»t | d
|
¬ « d k( r |r9| j t z
|
}d fd }t j |« } | |« |d< |r<| j# d « }
|
|
|
j dz |d< |
|
j |d dz z
|
|d< |r0dd} t j | « } | | « |d < n t% d« t' |¬« S )NÚMÚnsrF ÚdeltarQ rR rZ rI r_ F©Úskipnar c ó\ | j z d| j z z | j z S )Ni@B )r_ Úsecondsre )ÚxÚ
|
US_PER_DAYs rW ÚfzC_datetime_to_stata_elapsed_vec.<locals>.parse_dates_safe.<locals>.f³ s) ø Ø%¨¯©Ñ.°¸1¿9¹9Ñ1DÑDÀqÇ~Á~ÑUÐUr c ó: d| j z | j z S )NrH )rQ rR ©r¨ s rW ú<lambda>zJ_datetime_to_stata_elapsed_vec.<locals>.parse_dates_safe.<locals>.<lambda>¹ s °3¸¿¹±<À!Ç'Á'Ñ3I r rH c óJ | t | j dd« z
|
j S )NrB )r rQ r_ r¬ s rW ÚgzC_datetime_to_stata_elapsed_vec.<locals>.parse_dates_safe.<locals>.g¾ s Ø ¤¨¯©°°AÓ 6Ñ 6×<Ñ<Ð<r zQColumns containing dates must contain either datetime64, datetime or null values.rL )r¨ r r Úfloat)r¨ r r r` )r Ú is_np_dtyperv r rC Úas_unitr Úviewr r r Ú_datarQ rR r" r Ú vectorizeÚapplyrf r$ )r r£ rQ r_ r[ Ú
|
time_deltaÚ
|
date_indexÚ
|
days_in_nsrª ÚvÚ
|
year_monthr¯ Ú
|
NS_PER_DAYr© rK s rW Úparse_dates_safez8_datetime_to_stata_elapsed_vec.<locals>.parse_dates_safe s¯ ø ð Ü ??5;;¨Õ ,ÙØ "¤Y¬{Ó%;×%CÑ%CÀDÓ%IÑ I
|
Ø '× /Ñ /× 4Ñ 4´R·X±XÓ >À$Ñ F'
|
ÙtÜ *¨5Ó 1
|
Ø &× ,Ñ ,× 1Ñ 1& Ø '× -Ñ -× 3Ñ 3'
|
ÚØ "]]× /Ñ /´·±Ó 9¼KØfI dô=ç'$$rxx.ñ )
|
ð '¨*Ñ 4& ä uÔ -°Ò ;ÙØ ¬ Ñ3õVô LL OÙ uX'
|
ÙØ "[[Ñ)IÓ J
|
Ø &× .Ñ .°#Ñ 5& Ø '× /Ñ /°!°F±)¸c±/Ñ A'
|
Ùó=ô LL OÙ eH& ä ð7óð ô
|
%Ô(Ð(r r¡ ro T)r£ rq z'Stata Internal Format tC not supported.rs )r: rw rx )rQ r_ rz r{ r| )rQ r~ rB r r r r r
r r úFormat z! is not a known Stata date format)rv Úcopyú<dó àr ©rK r¿ )FFF)r r' r£ ÚboolrQ rà r_ rà )rK r! r r r± rv r" rC r r£ r r r rQ r_ rR r r` rf r' r Úfloat64ÚstructÚunpack)
|
r r r½ Úbad_locr[ r Ú missing_valuer¼ r© rK s
|
@@@rW Ú _datetime_to_stata_elapsed_vecrÉ so ú ð KKEØ/JØdÑ"Jð NSð,)Øð,)Ø "ð,)Ø26ð,)ØFJ÷,)ô\ 5kGØ KKEØ{{}Ü ??5;;¨Ô ,Ü%0´Ó%=EMM'Ò "ä%0EMM'Ñ "à
|
mÑÙ U¨$Ô /ØWWt^
|
Ø Ñ Ü Ø 5Ü'Ó)õ
|
ð
|
Ø Ñ Ù U¨$Ô /ØWW
|
Ñ*
|
Ø Ñ Ù U¨°DÔ 9Ø166¤K×$4Ñ$4Ñ4Ñ5¸¿¹À!¹ ÑC
|
Ø Ñ Ù U¨Ô .Ø166¤K×$4Ñ$4Ñ4Ñ5¸¿¹Ñ?À!ÑC
|
Ø Ñ Ù U¨Ô .Ø!&&¤;×#3Ñ#3Ñ3Ñ4¸¿¹À!¹ ÈÑ7IÑI
|
Ø Ñ Ù U¨Ô .Ø!&&¤;×#3Ñ#3Ñ3Ñ4¸¿¹À!¹ ×7KÑ7KÌCÓ7PÑP
|
Ø Ñ Ù U¨Ô .ØVV
|
ä7 3 %Ð'HÐIÓJÐJä
|
¬"¯*©*¸5ÔAJÜMM $Ð(KÓLÈQÑOMØ'JwÑä * E°Ô 6Ð6r zÔ
|
Fixed width strings in Stata .dta files are limited to 244 (or fewer)
|
characters. Column '{0}' does not satisfy this restriction. Use the
|
'version=117' parameter to write the newer (Stata 13 and later) format.
|
Ú excessive_string_length_errorz
|
Column converted from {0} to {1}, and some data are outside of the lossless
|
conversion range. This may result in a loss of precision in the saved data.
|
Úprecision_loss_doczä
|
Stata value labels (pandas categories) must be strings. Column {0} contains
|
non-string labels which will be converted to strings. Please check that the
|
Stata data file created has not lost information due to duplicate labels.
|
Úvalue_label_mismatch_doca;
|
Not all pandas column names were valid Stata variable names.
|
The following replacements have been made:
|
|
{0}
|
|
If this is not what you expect, please make sure you have Stata-compliant
|
column names in your DataFrame (strings only, max 32 characters, only
|
alphanumerics and underscores, no Stata reserved words)
|
Úinvalid_name_docaï
|
One or more series with value labels are not fully labeled. Reading this
|
dataset with an iterator results in categorical variable with different
|
categories. This occurs since it is not possible to know all possible values
|
until the entire dataset has been read. To avoid this warning, you can either
|
read dataset without an iterator, or manually convert categorical data by
|
``convert_categoricals`` to False and then accessing the variable labels
|
through the value_labels method of the reader.
|
Ú categorical_conversion_warningc
|
ó d}t j t j t j ft j t j t j ft j
|
t j t j ft j t j t j ft j t j t j ff}t j dd« d }t j dd« d }| D ]û }t | | j t « xr | | j j dv }| | j# « }|r]| | j j dv rdnd }| | j% |« j' | | j j( « | |< n·t | | j t « rt+ | | j d
|
d « /| | j' | | j j( « | |< nQt- | | j « r9| | j' d « | |< d | j. | | j# « |f< | | j } | j0 d dk( }
|
|D ]§ } | | d k( s |
|
s6| | j3 « t j4 | d « j2 k r| d } n| d } | d t j k( r,| | j3 « dk\ rt6 j9 dd« }| | j' | « | |< © | t j k( rV|
|
sT| | j3 « dkD s| | j; « dk r5| | j' t j « | |< n| t j k( rV|
|
sT| | j3 « dkD s| | j; « dk rÌ| | j' t j « | |< n¥| t j k( r½|
|
s,| | j3 « dk r=| | j; « dk\ r'| | j' t j « | |< n=| | j' t j « | |< | | j3 « dk\ s| | j; « dk rìt6 j9 dd« }nÕ| t j< t j fv r³t j> | | « jA « rtC d| d« | | j3 « } | t j< k( r+| |kD r&| | j' t j « | |< n-| t j k( r| |kD rtC d| d | d | d « |s¯|jA « sÁtD jF | | j jH } | | j. ||f< þ |r$tK jL |tN tQ « ¬ « | S ) a-
|
Checks the dtypes of the columns of a pandas DataFrame for
|
compatibility with the data types and ranges supported by Stata, and
|
converts if necessary.
|
|
Parameters
|
----------
|
data : DataFrame
|
The DataFrame to check and convert
|
|
Notes
|
-----
|
Numeric columns in Stata must be one of int8, int16, int32, float32 or
|
float64, with some additional value restrictions. int8 and int16 columns
|
are checked for violations of the value restrictions and upcast if needed.
|
int64 data is not usable in Stata, and so it is downcast to int32 whenever
|
the value are in the int32 range, and sidecast to float64 when larger than
|
this range. If the int64 values are outside of the range of those
|
perfectly representable as float64 values, a warning is raised.
|
|
bool columns are cast to int8. uint columns are converted to int of the
|
same size if there is no loss in precision, otherwise are upcast to a
|
larger type. uint64 is currently not supported since it is concerted to
|
object in a DataFrame.
|
Ú ú<fó ÿÿÿ~r rÀ ó ÿÿÿÿÿÿßÚiubÚiuFÚ numpy_dtypeNr rB r
l Úuint64rÄ rH éÿÿÿéä éÿÿéäÿÿé lüÿÿÿ r zColumn zM contains infinity or -infinitywhich is outside the range supported by Stata.z has a maximum value (z() outside the range supported by Stata (ú)rs ))r Úbool_Úint8Úuint8Úint16Úuint16Úint32Úuint32r r× rÄ rÅ rÆ Ú
|
isinstancerv r Úkindr! Úfillnar rÖ rO r ÚlocÚshaperM ÚiinforË rJ rN Úfloat32Úisinfr rf ÚStataMissingValueÚBASE_MISSING_VALUESÚnamer r r r )ÚdataÚwsÚconversion_dataÚ float32_maxÚ float64_maxÚcolÚis_nullable_intÚ orig_missingÚfvrv Úempty_dfÚc_datara Úsentinels rW Ú_cast_to_stata_typesrü # s ð4
|
Bô
|
277BGGÐ$Ü 277BHHÐ%Ü BHHbhhÐ'Ü BHHbhhÐ'Ü BHHbjjÐ)ð ð ô -- Ð&9Ó:¸1Ñ=KÜ-- Ð&IÓJÈ1ÑMKàó H7ô tCy¬Ó 7ò .ØS ×$Ñ$¨Ð-ð ð
|
Cy~~Ó' Ù Ø3ioo×*Ñ*¨dÑ2¸Bà S ×(Ñ(¨Ó,×3Ñ3°D¸±I·O±O×4OÑ4OÓPDIÜ S ¬ Ô 8ÜtCy¨ °tÓ<ÐHØ I× ,Ñ ,¨T°#©Y¯_©_×-HÑ-HÓ IS Ü c¡§ ¡ Ô1ð ! I× ,Ñ ,¨XÓ 6S à26c Ó)¨3Ð.Ñ/àS Ø::a= AÑ%Ø%ò
|
4FØq Ó!Ùt Cy}}´"·(±(¸6À!¹9Ó2E×2IÑ2IÒ IØ " 1IEà " 1IEØ!9¤§¡Ò(ØCy}}¨%Ò/Ü /× 6Ñ 6°xÀÓ Kà I× ,Ñ ,¨UÓ 3S ð
|
4ð BGGÒ ¡HØCy}} Ò$¨¨S© ¯ © «¸$Ó(>Ø I× ,Ñ ,¬R¯X©XÓ 6S Ø bhhÒ ¡xØCy}} Ò&¨$¨s©)¯-©-«/¸FÓ*BØ I× ,Ñ ,¬R¯X©XÓ 6S Ø bhhÒ ÙØS :Ò-°$°s±)·-±-³/À[Ò2Pà I× ,Ñ ,¬R¯X©XÓ 6S à I× ,Ñ ,¬R¯Z©ZÓ 8S Ø9==? eÒ+¨t°C©y¯}©}«À(Ò/JÜ+×2Ñ2°7¸IÓFBØ rzz¤2§:¡:Ð.Ñ .ÜxxS Ó"×&Ñ&Ô(Ü Ø cUð #Eð Eóð ð IMMOEØ
|
|
Ò" u¨{Ò':Ø I× ,Ñ ,¬R¯Z©ZÓ 8S Ø"**Ò$Ø;Ò&Ü$Ø! # Ð&<¸U¸Gð D/Ø/:¨m¸1ð>óð ó Ø× Ñ Ö!ä,×@Ñ@ÀÀcÁÇ Á ×AUÑAUÑVØ.6 sÐ*Ó+ðQH7ñR
|
Ü Ø Ü !Ü'Ó)õ
|
ð Kr c ó6 e Zd ZdZ d ddZddZd dZy)
|
ÚStataValueLabelzé
|
Parse a categorical column and prepare formatted output
|
|
Parameters
|
----------
|
catarray : Series
|
Categorical Series to encode
|
encoding : {"latin-1", "utf-8"}
|
Encoding to use for value labels.
|
c ó¾ |dvr t d« |j | _ || _ |j j
|
}t |« | _ | j « y )N©úlatin-1úutf-8ú%Only latin-1 and utf-8 are supported.) rf rï ÚlabnameÚ _encodingÚcatÚ
|
categoriesÚ enumerateÚ value_labelsÚ_prepare_value_labels)ÚselfÚcatarrayÚencodingr s rW Ú__init__zStataValueLabel.__init__¯ sS ð Ð/Ñ /Ü Ð DÓEÐ EØ }} Ø!Ø \\×,Ñ,
|
Ü % jÓ 1Ôà ×"Ñ"Õ$r c óL d| _ g | _ d| _ t j g t j
|
¬« | _ t j g t j
|
¬« | _ d| _ g }g }| j D ]ÿ }|d }t |t « sLt |« }t j t j | j « t" t% « ¬« |j' | j( « }|j+ | j « | xj t |« dz z c_ |j+ |d « | j j+ |« | xj dz c_ | j dkD r t- d« t j |t j
|
¬« | _ t j |t j
|
¬« | _ dd| j z z d| j z z | j z | _ y )
|
zEncode value labels.r ru rB rs i } zaStata value labels for a single variable must have a combined length less than 32,000 characters.é r N)Útext_lenÚtxtÚnr Úarrayrã ÚoffÚvalÚlenr rå Ústrr r rÌ rJ r r r Úencoder Úappendrf )r Úoffsetsri ÚvlÚcategorys rW r
|
z%StataValueLabel._prepare_value_labels» s ð Ø "Øä88B¤b§h¡hÔ/ä88B¤b§h¡hÔ/Øð Ø Ø×#Ñ#ò BØ$& q¡EHÜ h¬Ô,Ü x=Ü Ü,×3Ñ3°D·L±LÓAÜ*Ü /Ó 1õð
|
t§~¡~Ó6HØ NN4==Ô )Ø MMS ]¨QÑ .Ñ .MØ MM"Q%Ô Ø HHOOHÔ %Ø FFaKFð ð ==5Ò Ü ðFóð ô 88G¬2¯8©8Ô4Ü88F¬"¯(©(Ô3ð 1tvv:Ñ%¨¨D¯F©F©
|
Ñ2°T·]±]ÑBr c ó´ | j }t « }d}|j t j |dz | j
|
« « t | j « dd j |« }|dvrdnd}t ||dz « }|j |« t d« D ]' }|j t j d |« « ) |j t j |dz | j « « |j t j |dz | j « « | j D ]* }|j t j |dz |« « , | j D ]* } |j t j |dz | « « , | j D ] }
|
|j |
|
|z « |j! « S )
|
a!
|
Generate the binary representation of the value labels.
|
|
Parameters
|
----------
|
byteorder : str
|
Byte order of the output
|
|
Returns
|
-------
|
value_label : bytes
|
Bytes containing the formatted value label
|
ó ÚiNé )r Úutf8é rB r Úc)r r ÚwriterÅ Úpackr r r r Ú
|
_pad_bytesÚranger r r r r Úgetvalue) r Ú byteorderr ÚbioÚ null_byter Úlab_lenr Úoffsetra Útexts rW Úgenerate_value_labelz$StataValueLabel.generate_value_labelç s ð >>ÜiØ ð &++i¨#o¨t¯x©xÓ8Ô9ô dllÓ# C RÐ(×/Ñ/°Ó9Ø Ð(9Ñ9"¸sÜ W g°¡kÓ2Ø 'Ôô qò 3AØ IIfkk # yÓ1Õ 2ð 3ð
|
&++i¨#o¨t¯v©vÓ6Ô7ð &++i¨#o¨t¯}©}Ó=Ô>ð hhò <FØ IIfkk )¨c¡/°6Ó:Õ ;ð <ð XXò ;EØ IIfkk )¨c¡/°5Ó9Õ :ð ;ð HHò (DØ IIdYÑ&Õ 'ð (ð ||~Ð r N©r )r r' r úLiteral['latin-1', 'utf-8']r ÚNone©r r3 )r* r r Úbytes)Ú__name__Ú
|
__module__Ú __qualname__Ú__doc__r r
|
r0 © r rW rþ rþ £ s7 ñ ð IRð
|
%Ø ð
|
%Ø*Eð
|
%à ó
|
%ó*CôX2 r rþ c ó* e Zd ZdZ d ddZy)ÚStataNonCatValueLabela
|
Prepare formatted version of value labels
|
|
Parameters
|
----------
|
labname : str
|
Value label name
|
value_labels: Dictionary
|
Mapping of values to labels
|
encoding : {"latin-1", "utf-8"}
|
Encoding to use for value labels.
|
c ó |dvr t d« || _ || _ t |j « d ¬« | _ | j « y )Nr r c ó | d S )Nr r: r¬ s rW r z0StataNonCatValueLabel.__init__.<locals>.<lambda>6 s
|
°°!± r )Úkey)rf r r ÚsortedÚitemsr r
|
)r r r r s rW r z StataNonCatValueLabel.__init__* sP ð Ð/Ñ /Ü Ð DÓEÐ Eà Ø!Ü "Ø × Ñ Ó ¡nô
|
Ôð ×"Ñ"Õ$r Nr1 )r r r údict[float, str]r r2 r r3 )r6 r7 r8 r9 r r: r rW r< r< s7 ñ ð" 1:ð %àð%ð 'ð%ð .ð %ð
|
|
ô %r r< c óÈ e Zd ZU dZi Zded< dZded< eD ]) Zdee< edd « D ] Z d e
|
d
|
e z « z ee ez < + d Z d ed < e j dd« d Zded< ed « D ]u Z e j de « d Zdee< e dkD reexx e
|
d
|
e z « z cc< e j d e j de« « d ez Z e j de« Z w dZd ed< e j dd« d Z ed « D ]u Z e j de« d Zdee< e dkD reexx e
|
d
|
e z « z cc< e j d e j de« « d ez Z e j de« Zw ddd e j de « d e j de« d d Zded < d&d Zed'd « Zed(d « Zd'd!Zd'd"Zd)d#Ze d*d$« Z y%)+rí a
|
An observation's missing value.
|
|
Parameters
|
----------
|
value : {int, float}
|
The Stata missing value code
|
|
Notes
|
-----
|
More information: <https://www.stata.com/help.cgi?missing>
|
|
Integer missing values make the code '.', '.a', ..., '.z' to the ranges
|
101 ... 127 (for int8), 32741 ... 32767 (for int16) and 2147483621 ...
|
2147483647 (for int32). Missing values for floating point data types are
|
more complex but the pattern is simple to discern from the following table.
|
|
np.float32 missing values (float in Stata)
|
0000007f .
|
0008007f .a
|
0010007f .b
|
...
|
00c0007f .x
|
00c8007f .y
|
00d0007f .z
|
|
np.float64 missing values (double in Stata)
|
000000000000e07f .
|
000000000001e07f .a
|
000000000002e07f .b
|
...
|
000000000018e07f .x
|
000000000019e07f .y
|
00000000001ae07f .z
|
rB ÚMISSING_VALUES)ée éå éåÿÿr Úbasesú.rB é é` ó r5 Ú float32_basez<is r r` Ú increment_32rÑ rÁ Ú float64_baseÚqs rÀ rE rF rG )rß rá rã rë rÄ rî c óp || _ |dk r t |« n
|
t |« }| j | | _ y )Nl )Ú_valuer` r° rD Ú_str©r ra s rW r zStataMissingValue.__init__
s1 Ø à # jÒ 0E
|
´e¸E³lØ×'Ñ'¨Ñ. r c ó | j S )z²
|
The Stata representation of the missing value: '.', '.a'..'.z'
|
|
Returns
|
-------
|
str
|
The representation of the missing value.
|
)rS ©r s rW ÚstringzStataMissingValue.string s ð yyÐr c ó | j S )z³
|
The binary representation of the missing value.
|
|
Returns
|
-------
|
{int, float}
|
The binary representation of the missing value.
|
)rR rV s rW ra zStataMissingValue.value s ð {{Ðr c ó | j S ©N)rW rV s rW Ú__str__zStataMissingValue.__str__£ s Ø{{Ðr c ó$ t | « d| dS )Nú(rÝ )ÚtyperV s rW Ú__repr__zStataMissingValue.__repr__¦ s Üt* Qtf AÐ&Ð&r c ó t |t | « « xr4 | j |j k( xr | j |j k( S rZ )rå r^ rW ra )r Úothers rW Ú__eq__zStataMissingValue.__eq__© s? ä ud 4jÓ )ò *Ø u||Ñ+ò *à
|
|
ekkÑ)ð
|
r c óÚ |j t j u r| j d }|S |j t j u r| j d }|S |j t j
|
u r| j d }|S |j t j u r| j d }|S |j t j u r| j d }|S t d« )Nrß rá rã rë rÄ zUnsupported dtype) r^ r rß rî rá rã rë rÄ rf )Úclsrv ra s rW Úget_base_missing_valuez(StataMissingValue.get_base_missing_value° sÛ à ::Ñ Ø×+Ñ+¨FÑ3Eð ð ZZ288Ñ #Ø×+Ñ+¨GÑ4Eð ð ZZ288Ñ #Ø×+Ñ+¨GÑ4Eð ð ZZ2::Ñ %Ø×+Ñ+¨IÑ6Eð
|
ð ZZ2::Ñ %Ø×+Ñ+¨IÑ6Eð ô Ð 0Ó1Ð 1r N)ra r° r r3 ©r r )r r° )ra r r rà )rv únp.dtyper r° ) r6 r7 r8 r9 rD Ú__annotations__rH Úbr( r ÚchrrM rÅ rÆ rN r? r& Ú int_valuerO Ú increment_64rî r ÚpropertyrW ra r[ r_ rb Ú classmethodre r: r rW rí rí ; se
ñ"ðJ (*NÐ$Ó)Ø+E5Ó+Ø ò 6à qÑÙq" ò 6AØ$'©#¨b°1©f«+Ñ$5N1q5Ò !ñ 6ð6ð .L%Ó-Ø% dÐ,?Ó@ÀÑCL#ÓCÙ 2Yò 4ØfmmD ,Ó/°Ñ2Ø !sÑØ q5Ø 3Ó ¡3 r¨A¡v£;Ñ .Ó Ø!FMM $¨ ¨¯ © °D¸#Ó(>Ó?ÀÑBÀ\ÑQ Ø"v{{ 4¨Ó3 ð 4ð >L%Ó=Ø 6== Ð&IÓJÈ1ÑMLÙ 2Yò 3ØfmmD ,Ó/°Ñ2Ø !sÑØ q5Ø 3Ó ¡3 r¨A¡v£;Ñ .Ó Ø!FMM # { v§{¡{°4¸Ó'=Ó>¸qÑAÀLÑP Ø"v{{ 3¨ Ó2 ð 3ð ØØØ 6== |Ó4°QÑ7Ø 6== |Ó4°QÑ7ñ "Ðó ó/ð ò ó ð ð ò ó ð óó'ó
|
ð ò ó ñ r rí c ó e Zd ZddZy)Ú StataParserc ó¨ t t dd« D cg c] }|t j d| « f c}dt j t j « fdt j t j
|
« fdt j t j « fdt j t j « fdt j t j « fgz « | _ t j t j « t j t j « t j t j « t j t j « t j t j
|
« t j t j « d | _ t t t d« « t d
|
« z « | _ d d d dddd | _ d}d}d}d}dddt j t! j" d|« d « t j t! j" d|« d « ft j t! j" d|« d « t j t! j" d|« d « fd| _ dddddd | _ d d d t j t! j" dd « d « t j t! j" dd!« d « d| _ d"d#d$d%d&d'd(| _ h d)£| _ y c c}w )*NrB éõ ÚSéû éü éý éþ éÿ )é éöÿ é÷ÿ éøÿ éùÿ éúÿ ÚbhlfdÚQr[ rª ÚlÚhri s ÿÿÿþrÒ s ÿÿÿÿÿÿïÿrÓ )rØ rH )rÚ rÙ )rÜ rÛ rÑ r rÀ )ri r r rª r[ )éb éi él éf rH rE rF rG rL rÁ Úi1Úi2Úi4Úf4Úf8Úu8)ri r r rª r[ r >< ústr#Ú_NÚ_bÚ_nÚdoÚifÚinÚ_piÚ_rcÚ_seÚendÚforr` ÚNULLÚ_allÚbyteÚcaseÚelseÚenumÚgotoÚlongÚquadÚstrLÚwithÚ_coefÚ_consÚ_predÚ_skipr ÚbreakÚcatchÚclassÚconstr° ÚlocalÚshortÚusingÚdeleteÚdoubleÚexportÚfriendÚglobalÚinlineÚpragmaÚbooleanÚcomplexÚdefaultÚtypedefÚvirtualÚcontinueÚdelegateÚexplicitÚexternalÚfunctionÚtypenameÚ aggregateÚ colvectorÚ eltypedefÚ protectedÚ rowvector)Údictr( r rv rß rá rã rë rÄ Ú DTYPE_MAPrà Ú DTYPE_MAP_XMLÚlistÚtupleÚTYPE_MAPÚ TYPE_MAP_XMLrÅ rÆ Ú VALID_RANGEÚOLD_TYPE_MAPPINGrD ÚNUMPY_TYPE_MAPÚRESERVED_WORDS)r r Ú float32_minró Ú float64_minrô s rW r zStataParser.__init__Â s ô Ü-2°1°c«]Ö ;¨aAaS'Ó"Ò #Ò ;àbhhrwwÓ'Ð(ØbhhrxxÓ(Ð)ØbhhrxxÓ(Ð)ØbhhrzzÓ*Ð+ØbhhrzzÓ*Ð+ð ñ ó
|
ô 88BHHÓ%Ü88BJJÓ'Ü88BJJÓ'Ü88BHHÓ%Ü88BHHÓ%Ü88BGGÓ$ñ 3
|
Ôô U¤5¨£:Ó .´°w³ Ñ ?Ó@ ð ØØØØØñ
|
Ôð * Ø) Ø9 Ø9 à Ø Ø*ä
|
|
6==¨¨{Ó;¸AÑ>Ó?Ü
|
|
6==¨¨{Ó;¸AÑ>Ó?ðô
|
|
|
6==¨¨{Ó;¸AÑ>Ó?Ü
|
|
6==¨¨{Ó;¸AÑ>Ó?ðñ
|
Ôð ØØØØñ !
|
Ô ð ØØÜFMM¨$Ð0CÓ DÀQÑ GÓHÜÜ dÐ$GÓHÈÑKóñ
|
Ôð ØØØØØñ
|
Ôò=
|
Õùò[ <s !MNr4 )r6 r7 r8 r r: r rW rp rp Á s ô[
|
r rp c óX e Zd ZU eZded< d/ d0 fd Zd1dZd1dZd2dZ d3dZ
|
d1dZ d1d Z d4d
|
Z d4d Zd4d Zd4d Zd4dZd4dZd4dZd4dZd5dZd6dZd1dZd1dZ d7dZd8dZd8dZd8dZ d8dZ d4dZ d9d Z d9d Z d4d Z!d:d Z"d;d Z#d<d!Z$d1d"Z%d1d#Z&d=d$Z'd>d?d%Z( e)e*« d@ dAd&« Z+dBd'Z,dCd(Z-dDd)Z. dEd*Z/e0d9d+« Z1e0d9d,« Z2dFd-Z3dGd.Z4 xZ5S )HÚ StataReaderz IO[bytes]Ú _path_or_bufc óú t | « || _ || _ || _ || _ || _ || _ || _ || _ |
|
| _
|
| | _ d| _ | | _ d| _ d| _ | j d| _ n t! | t" « r| dk r t% d« d | _ d| _ d| _ d| _ d| _ d| _ d | _ d| _ t7 t8 j: « | _ y )NrÐ FrB r z.chunksize must be a positive integer when set.) Úsuperr Ú_convert_datesÚ_convert_categoricalsÚ
|
_index_colÚ_convert_missingÚ_preserve_dtypesÚ_columnsÚ_order_categoricalsÚ_original_path_or_bufÚ _compressionÚ_storage_optionsr Ú
|
_chunksizeÚ_using_iteratorÚ_enteredrå r` rf Ú _close_fileÚ_missing_valuesÚ_can_read_value_labelsÚ_column_selector_setÚ_value_labels_readÚ
|
_data_readÚ_dtypeÚ _lines_readÚ_set_endiannessÚsysr* Ú_native_byteorder) r Ú path_or_bufÚ convert_datesÚconvert_categoricalsÚ index_colÚconvert_missingÚpreserve_dtypesÚcolumnsÚorder_categoricalsÚ chunksizeÚ compressionr7 Ú __class__s rW r zStataReader.__init__e sû ø ô ÑÔð ,ÔØ%9Ô"Ø#Ø /Ô Ø /Ô Ø Ø#5Ô Ø%0Ô"Ø 'ÔØ /Ô ØØ#Ø $Ô Ø Ø ??Ð "Ø DOÜI¤sÔ+¨y¸Aª~Ü Ð MÓNÐ Nð 7;ÔØ $Ô Ø&+Ô#Ø$)Ô!Ø"'Ô Ø Ø'+ Ø Ôä!0´· ± Ó!?Õ r c ó> t | d« s| j « yy)zK
|
Ensure the file has been opened and its header data read.
|
rÕ N)ÚhasattrÚ
|
_open_filerV s rW Ú _ensure_openzStataReader._ensure_open s ô t^Ô,Ø OOÕ ð -r c óZ | j s$t j dt t « ¬« t | j d| j d| j ¬« }t |j d« r=|j j « r#|j | _ |j | _ nN|5 t |j j! « « | _ ddd« | j j | _ | j# « | j% « y# 1 sw Y ExY w)z^
|
Open the file (with compression options, etc.), and read header information.
|
zStataReader is being used without using a context manager. Using StataReader as a context manager is the only supported method.rs ÚrbF)r7 Úis_textrù ÚseekableN)rä r r ÚResourceWarningr r) rß rá rà rü Úhandler rÕ Úcloserå r ÚreadÚ _read_headerÚ _setup_dtype)r Úhandless rW rý zStataReader._open_file sî ð }}Ü MMðWä Ü+Ó-õ ô Ø × &Ñ &Ø Ø × 1Ñ 1ØØ ×)Ñ)ô
|
ô 7>> :Ô .°7·>±>×3JÑ3JÔ3Là '§¡DÔ Ø &}}DÕ ð ñ CÜ$+¨G¯N©N×,?Ñ,?Ó,AÓ$BÔ!÷ Cà #× 0Ñ 0× 6Ñ 6DÔ à ×ÑÔØ ×ÑÕ÷ Cð Cús Â4)D!Ä!D*c ó d| _ | S )zenter context managerT)rä rV s rW Ú __enter__zStataReader.__enter__¼ s à Ø r c ó> | j r| j « y y rZ )rå )r Úexc_typeÚ exc_valueÚ tracebacks rW Ú__exit__zStataReader.__exit__Á s ð × Ò Ø × Ñ Õ ð r c ó t j dt t « ¬« | j r| j « yy)zØClose the handle if its open.
|
|
.. deprecated: 2.0.0
|
|
The close method is not part of the public API.
|
The only supported way to use StataReader is to use it as a context manager.
|
z¹The StataReader.close() method is not part of the public API and will be removed in a future version without notice. Using StataReader as a context manager is the only supported method.rs N)r r Ú FutureWarningr rå rV s rW r zStataReader.closeÊ s= ô ð Sô Ü'Ó)õ
|
ð × Ò Ø × Ñ Õ ð r c ó@ | j dk rd| _ yd| _ y)zC
|
Set string encoding which depends on file version
|
év r r N)Ú_format_versionr rV s rW Ú _set_encodingzStataReader._set_encodingÜ s ð × Ñ #Ò %Ø &DNà $DNr c óf t j d| j j d« « d S )Nri rB r ©rÅ rÆ rÕ r rV s rW Ú
|
_read_int8zStataReader._read_int8å ó) Ü}}S $×"3Ñ"3×"8Ñ"8¸Ó";Ó<¸QÑ?Ð?r c óf t j d| j j d« « d S )NÚBrB r r rV s rW Ú _read_uint8zStataReader._read_uint8è r r c ó t j | j d| j j d« « d S )NÚHr
r ©rÅ rÆ Ú
|
_byteorderrÕ r rV s rW Ú _read_uint16zStataReader._read_uint16ë ó5 Ü}} §¡Ð 0°Ð 2°D×4EÑ4E×4JÑ4JÈ1Ó4MÓNÈqÑQÐQr c ó t j | j d| j j d« « d S )NÚIr r r rV s rW Ú _read_uint32zStataReader._read_uint32î r# r c ó t j | j d| j j d« « d S )Nr r r r rV s rW Ú _read_uint64zStataReader._read_uint64ñ r# r c ó t j | j d| j j d« « d S )Nr r
r r rV s rW Ú _read_int16zStataReader._read_int16ô r# r c ó t j | j d| j j d« « d S )Nr r r r rV s rW Ú _read_int32zStataReader._read_int32÷ r# r c ó t j | j d| j j d« « d S )NrP r r r rV s rW Ú _read_int64zStataReader._read_int64ú r# r c óf t j d| j j d« « d S )Nr$ rB r r rV s rW Ú _read_char8zStataReader._read_char8ý r r c ó t j | j d|z | j j d|z « « S )Nr r
r )r Úcounts rW Ú_read_int16_countz StataReader._read_int16_count s@ Ü}}ØÐ e¡ }Ð -Ø × Ñ × "Ñ " 1 u¡9Ó -ó
|
ð
|
r c ór | j « }|dk( r| j « y | j |« y )Nó <)r0 Ú_read_new_headerÚ_read_old_header)r Ú
|
first_chars rW r zStataReader._read_header s2 Ø×%Ñ%Ó'
|
Ø Ò Ø × !Ñ !Õ #à × !Ñ ! *Õ -r c ó | j j d« t | j j d« « | _ | j dvr)t t
|
j | j ¬« « | j « | j j d« | j j d« dk( rdnd| _ | j j d « | j d
|
k r| j « n| j « | _ | j j d « | j « | _ | j j d « | j « | _ | j j d « | j! « | _ | j j d« | j j d« | j j d« | j% « dz | _ | j% « dz | _ | j% « dz | _ | j% « dz | _ | j% « d z | _ | j1 « | _ | j j d« | j% « dz | _ | j% « d z | _ | j% « dz | _ | j; | j& « \ | _ | _ | j jA | j( « | jC « | _" | j jA | j* « | jG | j dz « d d | _$ | j jA | j, « | jK « | _& | j jA | j. « | jO « | _( | j jA | j2 « | jS « | _* y )NrJ r ©éu r éw ©Úversioné s MSFú>ú<é r r{ é é é r é é
|
é r é rB éÿÿÿÿ)+rÕ r r` r rf Ú_version_errorrJ r r! r" r& Ú_nvarÚ _get_nobsÚ_nobsÚ_get_data_labelÚ _data_labelÚ_get_time_stampÚ _time_stampr. Ú_seek_vartypesÚ_seek_varnamesÚ_seek_sortlistÚ _seek_formatsÚ_seek_value_label_namesÚ_get_seek_variable_labelsÚ_seek_variable_labelsÚ_data_locationÚ _seek_strlsÚ_seek_value_labelsÚ _get_dtypesÚ_typlistÚ _dtyplistÚseekÚ _get_varlistÚ_varlistr3 Ú_srtlistÚ _get_fmtlistÚ_fmtlistÚ _get_lbllistÚ_lbllistÚ_get_variable_labelsÚ_variable_labelsrV s rW r6 z StataReader._read_new_header se à ×Ñ× Ñ rÔ"Ü " 4×#4Ñ#4×#9Ñ#9¸!Ó#<Ó =Ô Ø × Ñ Ñ 6Ü ^× 2Ñ 2¸4×;OÑ;OÐ 2Ó PÓQÐ QØ ×ÑÔ Ø ×Ñ× Ñ rÔ"Ø!%×!2Ñ!2×!7Ñ!7¸Ó!:¸fÒ!D#È#Ø ×Ñ× Ñ rÔ"à#'×#7Ñ#7¸3Ò#>D× Ñ Ô ÀD×DUÑDUÓDWð
|
ð ×Ñ× Ñ qÔ!à^^Ó%
|
Ø ×Ñ× Ñ rÔ"Ø ×/Ñ/Ó1ÔØ ×Ñ× Ñ rÔ"Ø ×/Ñ/Ó1ÔØ ×Ñ× Ñ rÔ"Ø ×Ñ× Ñ qÔ!Ø ×Ñ× Ñ qÔ!à "× .Ñ .Ó 0°2Ñ 5ÔØ "× .Ñ .Ó 0°2Ñ 5ÔØ "× .Ñ .Ó 0°2Ñ 5ÔØ !× -Ñ -Ó /°!Ñ 3ÔØ'+×'7Ñ'7Ó'9¸BÑ'>Ô$ð &*×%CÑ%CÓ%EÔ"à ×Ñ× Ñ qÔ!Ø "× .Ñ .Ó 0°1Ñ 4ÔØ ×+Ñ+Ó-°Ñ1ÔØ"&×"2Ñ"2Ó"4°rÑ"9Ô à(,×(8Ñ(8¸×9LÑ9LÓ(MÑ% t~à ×Ñ× Ñ t× 2Ñ 2Ô3Ø ×)Ñ)Ó+ à ×Ñ× Ñ t× 2Ñ 2Ô3Ø ×.Ñ.¨t¯z©z¸A©~Ó>¸sÀÐC à ×Ñ× Ñ t× 1Ñ 1Ô2Ø ×)Ñ)Ó+ à ×Ñ× Ñ t× ;Ñ ;Ô<Ø ×)Ñ)Ó+ à ×Ñ× Ñ t× 9Ñ 9Ô:Ø $× 9Ñ 9Ó ;Õ r c óº | j j |« g }g }t | j « D ] }| j « }|dk r,|j |« |j t |« « D |j | j | « |j | j | « ||fS # t $ r}t d| d« |d }~ww xY w)Néý ú cannot convert stata types [ú]) rÕ r` r( rL r" r r rÌ rÈ ÚKeyErrorrf )r Ú seek_vartypesÚtyplistÚdtyplistÚ_ÚtypÚerrs rW r] zStataReader._get_dtypesE sÚ ð ×Ñ× Ñ }Ô-ØØÜtzzÓ"ò
|
UAØ×#Ñ#Ó%CØd{ØsÔ#ؤ C£Õ)ðUØNN 4×#4Ñ#4°SÑ#9Ô:Ø OO D×$6Ñ$6°sÑ$;Õ<ð
|
Uð Ð Ð øô ò UÜ$Ð'CÀCÀ5ÈÐ%JÓKÐQTÐTûðUús Á:<B<Â< CÃCÃCc óÈ | j dk rdnd}t | j « D cg c], }| j | j j |« « . c}S c c}w )Nr é! é ©r r( rL Ú_decoderÕ r ©r ri rr s rW ra zStataReader._get_varlistY sM à×&Ñ&¨Ò,B°#ÜAFÀtÇzÁzÓARÖS¸A T× .Ñ .× 3Ñ 3°AÓ 6Õ7ÒSÐSùÒSs «1A c ó | j dk\ rd}n&| j dkD rd}n| j dkD rd}nd}t | j « D cg c], }| j | j j |« « . c}S c c}w )Nr é9 éq é1 éh r~ r{ rx rz s rW rd zStataReader._get_fmtlist_ sw Ø × Ñ 3Ò &ØAØ × !Ñ ! CÒ 'ØAØ × !Ñ ! CÒ 'ØAàAäAFÀtÇzÁzÓARÖS¸A T× .Ñ .× 3Ñ 3°AÓ 6Õ7ÒSÐSùÒSs Á1Bc óî | j dk\ rd}n| j dkD rd}nd}t | j « D cg c], }| j | j j |« « . c}S c c}w )Nr rw r
rv rH rx rz s rW rf zStataReader._get_lbllistl sd Ø × Ñ 3Ò &ØAØ × !Ñ ! CÒ 'ØAàAÜAFÀtÇzÁzÓARÖS¸A T× .Ñ .× 3Ñ 3°AÓ 6Õ7ÒSÐSùÒSs ¾1A2c ó$ | j dk\ rLt | j « D cg c], }| j | j j d« « . }}|S | j dkD rLt | j « D cg c], }| j | j j d« « . }}|S t | j « D cg c], }| j | j j d« « . }}|S c c}w c c}w c c}w )Nr iA r éQ r! rx )r rr Úvlblists rW rh z StataReader._get_variable_labelsu sÿ Ø × Ñ 3Ò &äCHÈÏÉÓCTöØ>? T× .Ñ .× 3Ñ 3°CÓ 8Õ9ðGð ð ð × !Ñ ! CÒ 'äBGÈÏ
|
É
|
ÓBSöØ=> T× .Ñ .× 3Ñ 3°BÓ 7Õ8ðGð ð ô CHÈÏ
|
É
|
ÓBSöØ=> T× .Ñ .× 3Ñ 3°BÓ 7Õ8ðGð ð ùòùòùòs §1DÂ1DÃ1D c ó` | j dk\ r| j « S | j « S )Nr )r r( r& rV s rW rM zStataReader._get_nobs s. Ø × Ñ 3Ò &Ø×$Ñ$Ó&Ð &à×$Ñ$Ó&Ð &r c óì | j dk\ r:| j « }| j | j j |« « S | j dk( r:| j « }| j | j j |« « S | j dkD r*| j | j j d« « S | j | j j d« « S )Nr r; r r r! )r r" ry rÕ r r ©r Ústrlens rW rO zStataReader._get_data_label sÆ Ø × Ñ 3Ò &Ø×&Ñ&Ó(FØ<< × 1Ñ 1× 6Ñ 6°vÓ >Ó?Ð ?Ø × !Ñ ! SÒ (Ø__Ó&FØ<< × 1Ñ 1× 6Ñ 6°vÓ >Ó?Ð ?Ø × !Ñ ! CÒ 'Ø<< × 1Ñ 1× 6Ñ 6°rÓ :Ó;Ð ;à<< × 1Ñ 1× 6Ñ 6°rÓ :Ó;Ð ;r c ó¬ | j dk\ r:| j « }| j j |« j d« S | j dk( r:| j « }| j | j j |« « S | j dkD r*| j | j j d« « S t « )Nr r r; r é )r r rÕ r Údecodery rf r s rW rQ zStataReader._get_time_stamp s® Ø × Ñ 3Ò &Ø__Ó&FØ×$Ñ$×)Ñ)¨&Ó1×8Ñ8¸ÓAÐ AØ × !Ñ ! SÒ (Ø__Ó&FØ<< × 1Ñ 1× 6Ñ 6°vÓ >Ó?Ð ?Ø × !Ñ ! CÒ 'Ø<< × 1Ñ 1× 6Ñ 6°rÓ :Ó;Ð ;ä ,Ð r c óò | j dk( r=| j j d« | j d| j z z dz dz S | j dk\ r| j « dz S t « )Nr; r rv é é r )r rÕ r rW rL r. rf rV s rW rX z%StataReader._get_seek_variable_labels¢ ss Ø × Ñ 3Ò &Ø × Ñ × "Ñ " 1Ô %ð ×/Ñ/°2¸¿
|
¹
|
±?ÑCÀbÑHÈ2ÑMÐ MØ × !Ñ ! SÒ (Ø×#Ñ#Ó%¨Ñ*Ð *ä ,Ð r c óü t |d « | _ | j dvr)t t j | j ¬« « | j « | j « dk( rdnd| _ | j « | _ | j j d« | j « | _ | j « | _ | j « | _ | j# « | _ | j dkD r<| j j | j « D cg c] }t |« }}n| j j | j « }t' j( |t& j* ¬« }g }|D ]C }|| j, v r |j/ | j, | « 0|j/ |d z
|
« E |D cg c] }| j0 | c}| _ |D cg c] }| j8 | c}| _ | j dkD rQt= | j « D cg c], } | j? | j j d« « . c} | _ nPt= | j « D cg c], } | j? | j j d« « . c} | _ | jC | j dz « d d | _" | jG « | _$ | jK « | _& | jO « | _( | j dkD rc | j « } | j dkD r| jS « }n| jU « }| dk( rn | j j |« b| j jW « | _, y c c}w c c}w # t $ rC}d
|
j5 |D cg c] } t7 | « nc c} w c} « }
|
t d |
|
d « |d }~ww xY wc c}w # t $ rC}d
|
j5 |D cg c] } t7 | « nc c} w c} « } t d | d « |d }~ww xY wc c} w c c} w )Nr )r r r
éo r} ér és r= rB r@ rA r
ru é ú,rl rm z cannot convert stata dtypes [rv rH rJ r )-r` r rf rK rJ r r r! Ú _filetyperÕ r r" rL rM rN rO rP rQ rR r Ú
|
frombufferrà rÎ r rË r^ Újoinr rÇ r_ r( ry rb r3 rc rd re rf rg rh ri r, r* ÚtellrZ )r r8 r$ rp ÚbufÚtyplistbÚtprs rt r¨ Ú invalid_typesÚinvalid_dtypesrr Ú data_typeÚdata_lens rW r7 z StataReader._read_old_header® sÌ Ü " :¨a¡=Ó 1Ô Ø × Ñ Ð'JÑ JÜ ^× 2Ñ 2¸4×;OÑ;OÐ 2Ó PÓQÐ QØ ×ÑÔ Ø!%§ ¡ Ó!2°cÒ!9#¸sØ Ó*Ø ×Ñ× Ñ qÔ!à×&Ñ&Ó(
|
Ø^^Ó%
|
à ×/Ñ/Ó1Ôà ×/Ñ/Ó1Ôð × Ñ #Ò %Ø'+×'8Ñ'8×'=Ñ'=¸d¿j¹jÓ'IÖJ !s1vÐJGÑJà×#Ñ#×(Ñ(¨¯©Ó4CÜ}} S´·±Ô9HØGØ ò -Ø×.Ñ.Ñ.ØNN 4×#8Ñ#8¸Ñ#<Õ=àNN 2¨¡8Õ,ð -ð WØ;BÖ C°CT]]¨3Ó /Ò CDMð YØ=DÖ E°cdnn¨SÓ 1Ò EDNð
|
× Ñ #Ò %äBGÈÏ
|
É
|
ÓBSö Ø=> T× .Ñ .× 3Ñ 3°BÓ 7Õ8ò DMô
|
BGÀtÇzÁzÓARö Ø<= T× .Ñ .× 3Ñ 3°AÓ 6Õ7ò DMð ×.Ñ.¨t¯z©z¸A©~Ó>¸sÀÐC à ×)Ñ)Ó+ à ×)Ñ)Ó+ à $× 9Ñ 9Ó ;Ô ð × Ñ #Ò %ØØ OOÓ - Ø×'Ñ'¨#Ò-Ø #× /Ñ /Ó 1Hà #× /Ñ /Ó 1HØ >ØØ×!Ñ!×&Ñ& xÔ0ð ð #× /Ñ /× 4Ñ 4Ó 6Õùòo Kùò DøÜò WØ HH°gÖ%>°¤c¨!¥fÑ%>ùÔ%>Ó ?MÜ Ð ;¸M¸?È!Ð LÓMÐSVÐ Vûð Wüò FøÜò YØ XX°wÖ&?°!¤s¨1¥vÑ&?ùÔ&?Ó @NÜ Ð <¸^Ð<LÈAÐ NÓOÐUXÐ Xûð Yüò
|
ùò s~ Ä1OÇO Ç O Ç5O Ç>P% ÈP ÈP% É1Q4Ê1Q9Ï O Ï P ÏPÏ)O<
|
Ï; PÐP Ð P% Ð% Q1Ð.Q,Ð=Q
|
Ñ Q,Ñ,Q1c ó | j | j S g }t | j « D ]n \ }}|| j v rBt t
|
|« }|j d| | j | j | f« V|j d| d| f« p t j |« | _ | j S )z"Map between numpy and state dtypesÚsrs )
|
rë r r^ rÏ r r r r! r rv )r Údtypesr rs s rW r zStataReader._setup_dtypeù s» à ;;Ð "Ø;;Ð àÜ § ¡ Ó.ò 4FAsØd×)Ñ)Ñ)Ü3 nØ 1 #w¨4¯?©?Ð*;¸D×<OÑ<OÐPSÑ<TÐ;UÐ(VÐ WÕXà 1 #w¨!¨C¨5¨ Ð 2Õ3ð 4ô hhvÓ& à{{Ðr c ó |j d« d } |j | j « S # t $ rJ | j }d| d}t j
|
|t t « ¬« |j d« cY S w xY w)Nr r z@
|
One or more strings in the dta file could not be decoded using zÍ, and
|
so the fallback encoding of latin-1 is being used. This can happen when a file
|
has been incorrectly encoded by Stata or some other software. You should verify
|
the string values returned are correct.rs r )Ú partitionr r ÚUnicodeDecodeErrorr r ÚUnicodeWarningr )r r r Úmsgs rW ry zStataReader._decode s à KKÓ qÑ !ð 'Ø88DNNÓ+Ð +øÜ!ò 'ð ~~Hð@Ø@H¸zð J(ð+Cô
|
MMØÜ Ü+Ó-õ ð
|
88IÓ&Ò &ð 'ús 1 ±ABÂBc ó. | j « | j ry | j dk rd| _ i | _ y | j dk\ r&| j j | j « nY| j J | j | j j z }| j j | j |z « d| _ i | _ | j dk\ r'| j j d« dk( r d| _ y | j j d« }|s d| _ y | j dk r+| j | j j d« « }n*| j | j j d« « }| j j d « | j « }| j « }t j | j j d|z « | j d
|
|¬ « }t j | j j d|z « | j d
|
|¬ « }t j" |« }|| }|| }| j j |« } i | j |< t% |« D ]> }
|
|
|
|d z
|
k r||
|
d z n|} | j | ||
|
| « | j | ||
|
< @ | j dk\ r| j j d « >)Nr
Tr; é s </valr rv rw r r ©rv r2 rB r )rþ ré r Ú_value_label_dictrÕ r` r\ rë rN ÚitemsizerZ r ry r& r r r! Úargsortr( ) r r. Úslengthr r Útxtlenr r Úiir r r s rW Ú_read_value_labelsz StataReader._read_value_labels sÔ Ø ×ÑÔØ × "Ò "à Ø × Ñ 3Ò &à&*DÔ #ØBDDÔ "Ø à × Ñ 3Ò &Ø × Ñ × "Ñ " 4×#:Ñ#:Õ ;à;;Ð*Ð *Ð*ØZZ $§+¡+×"6Ñ"6Ñ6FØ × Ñ × "Ñ " 4×#6Ñ#6¸Ñ#?Ô @à"&Ô Ø!#Ô àØ×#Ñ# sÒ*Ø×$Ñ$×)Ñ)¨!Ó,°Ò8Øð> #'Õ ð; ×'Ñ'×,Ñ,¨QÓ/GÙØð6 #'Õ ð5 ×#Ñ# sÒ*Ø ,, t×'8Ñ'8×'=Ñ'=¸bÓ'AÓBà ,, t×'8Ñ'8×'=Ñ'=¸cÓ'BÓCØ × Ñ × "Ñ " 1Ô %à×!Ñ!Ó#AØ×&Ñ&Ó(FÜ--Ø×!Ñ!×&Ñ& q¨1¡uÓ-¸¿¹Ð7HÈÐ5KÐSTôCô --Ø×!Ñ!×&Ñ& q¨1¡uÓ-¸¿¹Ð7HÈÐ5KÐSTôCô C BØb'CØb'CØ×#Ñ#×(Ñ(¨Ó0CØ.0D× "Ñ " 7Ñ +Ü1Xò Ø$%¨¨A©¢Ic!a%j°6Ø:>¿,¹,ØA Ð%ó;×&Ñ& wÑ/°°A±Ò7ð ð
|
×#Ñ# sÒ*Ø×!Ñ!×&Ñ& qÔ)ñC r c óÌ | j j | j « ddi| _ | j j d« dk7 ry | j
|
dk( r| j « }ns| j j d« }| j
|
dk( rdnd}| j d k( r|d
|
| |d d|z
|
z }n|d
|
| |d |z d z }t j d |« d
|
}| j « }| j « }| j j |« }|d k( r |d
|
d j | j « }n t |« }|| j t |« < 6)NÚ0rÐ r s GSOr; r~ r r
rA r r r é rJ )rÕ r` r[ ÚGSOr r r( r! rÅ rÆ r r& r r r )r Úv_or Úv_sizers ÚlengthÚvaÚ
|
decoded_vas rW Ú _read_strlszStataReader._read_strlsW sX Ø ×Ñ× Ñ t× /Ñ /Ô0à9ØØ× Ñ ×%Ñ% aÓ(¨FÒ2Øà×#Ñ# sÒ*Ø×'Ñ'Ó)à×'Ñ'×,Ñ,¨RÓ0à "× 2Ñ 2°cÒ 9¸qØ?? cÒ)Ø a -¨#¨a°2¸±;Ð*@Ñ@Cð a -¨#¨q°6©z¨nÐ*=Ñ=CÜ mm C¨Ó-¨aÑ0Ø×"Ñ"Ó$CØ×&Ñ&Ó(FØ×"Ñ"×'Ñ'¨Ó/BØczØ "X__¨T¯^©^Ó <
|
ô ! W
|
à!+DHHSXÑ ñ3 r c óH d| _ | j | j ¬« S )NT©Únrows)rã r râ rV s rW Ú__next__zStataReader.__next__v s Ø #Ô ØyytyÓ/Ð/r c óB | | j }| j |¬« S )a
|
Reads lines from Stata file and returns as dataframe
|
|
Parameters
|
----------
|
size : int, defaults to None
|
Number of lines to read. If None, reads whole file.
|
|
Returns
|
-------
|
DataFrame
|
r¼ )râ r )r Úsizes rW Ú get_chunkzStataReader.get_chunkz s# ð <Ø??DØyytyÓ$Ð$r c óì | j « | | j }| | j }| | j }| | j }| | j
|
}| | j }| | j }| | j }| j dk( r|dk( r¨d| _ d| _
|
t | j ¬« } t | j « D ]V \ }
|
} | j |
|
} t! | t" j$ « s0| j& dk7 s@| | j) | « | | < X || j+ | |« } | S | j, dk\ r#| j. sd| _ | j1 « | j2 J | j2 } | j | j4 z
|
| j6 z }|| j6 z }t9 ||« }|dk r|r| j; « t< | j4 | j6 z }| j> jA | jB |z « t9 || j | j4 z
|
« }t# jD | j> jG |« | |¬« }| xj4 |z c_ | j4 | j k( rd| _ d| _
|
| jH | jJ k7 r7|jM « jO |j$ jQ « « }|r| j; « tS |« dk( rt | j ¬« } n/t jT |« } tW | j « | _ |(tY | j4 |z
|
| j4 « | _- || j+ | |« } t] | | j^ « D ]7 \ } }t! |t` « s| | jc | jd « | | < 9 | jg | « } t | j « D
|
cg c]
|
\ }
|
}| |
|
}}
|
}t# j$ th « }|D ]e }| jj d d
|f j$ } | || j | fvs4| jm || jj d d
|f j) | « « g | jo | |« } |rct | jp « D ]K \ }
|
ts fdtt D « « s | jm |
|
tw | jj d d
|
|
f « « M |r7| j, dkD r(| jy | | jz | j| |« } |s^g }d }| D ]4 } | | j$ } | t# j$ t" j~ « t# j$ t" j « fv r&t# j$ t" j « } d}n| t# j$ t" j « t# j$ t" j « t# j$ t" j « fv r%t# j$ t" j « } d}|j | | | j) | « f« 7 |r t j t |« « } | | j | j |« « } | S c c}}
|
w )
|
Nr T)rö rs r; r© c 3 ó@ K | ] }j |« y wrZ )r )Ú.0Údate_fmtr s rW ú <genexpr>z#StataReader.read.<locals>.<genexpr> s øè ø ÒN°Hs~~ h×/ÑNùs r
F)Krþ rØ rÙ rÛ rÜ rÝ rÞ rÚ rN rç rê r$ rb r rö r_ rå r rv Úcharr Ú_do_select_columnsr ré rº rë rì r« rN r° Ú StopIterationrÕ r` rZ r r r! rï Úbyteswapr³ Ú newbyteorderr Ú from_recordsr% r& rK rP r^ r` r¶ ry Ú _insert_strlsr ÚilocÚisetitemÚ_do_convert_missingre r Ú _date_formatsr Ú_do_convert_categoricalsrª rg Úfloat16rë rÄ rß rá rã r r Ú from_dictrÆ Ú set_indexÚpop)r r½ rñ rò ró rô rõ rö r÷ rð r rõ Údtrv Ú max_read_lenÚread_lenr. Ú
|
read_linesÚraw_datars ÚdtypÚ valid_dtypesÚ object_typeÚidxÚ retyped_dataÚconvertr s @rW r zStataReader.read sù ø ð ×ÑÔð Ð Ø × /Ñ /MØ Ð 'Ø#'×#=Ñ#=Ð Ø Ð "Ø "× 3Ñ 3OØ Ð "Ø "× 3Ñ 3OØ ?ØmmGØ Ð %Ø!%×!9Ñ!9Ð Ø Ð Ø IØ =ØJJEð
|
JJ!O ¨!¢Ø*.DÔ 'Ø "DOÜ T§]¡]Ô3Dä# D§L¡LÓ1ò 93Ø^^ AÑ&Ü b¤"§(¡(Õ+Øww #~Ø$(¨¡I×$4Ñ$4°RÓ$8S ð 9ð
|
Ð"Ø×.Ñ.¨t°WÓ=ØKà × Ñ CÒ '°$×2IÒ2IØ*.DÔ 'Ø × Ñ Ô ð {{Ð&Ð&Ð&Ø Ø
|
|
T×%5Ñ%5Ñ5¸¿ ¹ ÑG Ø5>>Ñ)Üx Ó.Ø q=ñ $Ø×'Ñ'Ô)Ü Ð Ø×!Ñ! E§N¡NÑ2Ø ×Ñ× Ñ t× 2Ñ 2°VÑ ;Ô<Ü §
|
¡
|
¨T×-=Ñ-=Ñ =Ó>
|
Ü==Ø × Ñ × "Ñ " 8Ó ,°EÀô
|
ð ×ÒJÑ&ÕØ × Ñ tzzÒ )Ø*.DÔ 'Ø "DOà ??d× 4Ñ 4Ò 4Ø ×(Ñ(Ó*×/Ñ/°·±×0KÑ0KÓ0MÓNHá Ø × #Ñ #Ô %ä x=AÒ Ü T§]¡]Ô3Dä ×)Ñ)¨(Ó3DÜ § ¡ Ó/DLð Ð Ü#Ø× Ñ :Ñ-¨t×/?Ñ/?óDJð Ð Ø×*Ñ*¨4°Ó9Dô D $§-¡-Ó0ò :HCÜ#sÕ#Ø IOO¨D¯L©LÓ 9S ð :ð ×!Ñ! $Ó'ô *3°4·>±>Ó)B×Wga ÀdÑFVÐW ÑWÜhhvÓ& Ø ò DCØIIa fÑ%×+Ñ+EØ[¨$¯.©.¸Ñ*=Ð >Ò>Ø c 4§9¡9ªQ°¨VÑ#4×#;Ñ#;¸EÓ#BÕCð Dð
|
×'Ñ'¨¨oÓ>á Ü# D§M¡MÓ2ò 3ÜÓNÄ ÔNÕNØMMØÔ>¸t¿y¹yÊÈAȹÐPSÓTõð ñ D×$8Ñ$8¸3Ò$>Ø×0Ñ0Ød×,Ñ,¨d¯m©mÐ=OóDò Ø LØGØó DØ S ØRXX¤b§j¡jÓ 1´2·8±8¼B¿J¹JÓ3GÐ HÑHÜ HH¤R§Z¡ZÓ 0EØ "GØÜHHRWWÓ%ÜHHRXXÓ&ÜHHRXXÓ&ð ñ ô
|
HH¤R§X¡XÓ .EØ "GØ ×#Ñ# S¨$¨s©)×*:Ñ*:¸5Ó*AÐ$BÖCð Dñ Ü ×*Ñ*¬4° Ó+=Ó>à Ð Ø>> $§(¡(¨9Ó"5Ó6Dà ùóW Xs Ð&
|
[0Ð1[0c óð i }t t |j « « D ]¥ }| j | }|| j vr"t t |« }| j | \ }}|j d d
|f }|j } | |k | |kD z }
|
|
|
j « s|rt j t j |
|
« « d } t j ||
|
d¬« \ } } t |t ¬« }t! | « D ]' \ }}t# |« }| | |k( }||j |< ) n|j$ }|t j& t j( fvrt j( }t ||¬« }|j j* d s|j- « }t j. |j |
|
< |||< ¨ |r*|j1 « D ] \ }}|j3 ||« |S )Nr T)Úreturn_inverseru Ú WRITEABLE)r( r rö r^ rÍ r r rÎ r r r ÚnonzeroÚasarrayÚuniquer' r r rí rv rë rÄ Úflagsr¿ ÚnanrA rÏ )r rð rô Ú replacementsr r ÚnminÚnmaxÚseriesÚsvalsÚmissingÚ missing_locÚumissingÚ umissing_locÚ replacementÚjÚumrÈ rè rv rß ra s rW rÐ z StataReader._do_convert_missing# sÐ à Üs4<<Ó(Ó)ó % *AØ-- Ñ"CØ$×*Ñ*Ñ*ØäsC.CØ ×)Ñ)¨#Ñ.JD$ØYYq !t_Fð NNEØ t|¨°© Ñ5Gà;;=Øá Ü jj¬¯©°GÓ)<Ó =¸aÑ @ Ü)+¯©°6¸'±?ÐSWÔ)XÑ&,Ü $ V´6Ô : Ü & xÓ 0ò :EArÜ$5°bÓ$9Mà% l°aÑ&7Ñ8CØ,9K×$Ñ$ SÒ)ñ :ð ؤ§¡¬R¯Z©ZÐ 8Ñ8Ü JJEÜ $ V°5Ô 9 Ø"×*Ñ*×0Ñ0°Ò=ð #.×"2Ñ"2Ó"4Kô 02¯v©v ×#Ñ# GÑ,Ø )LOðK% *ñL Ø *× 0Ñ 0Ó 2ò *
|
UØ c 5Õ)ð *à r c ó0 t | d« rt | j « dk( r|S t | j « D ]R \ }}|dk7 r |j ||j d d
|f D cg c] }| j t |« c}« T |S c c}w )Nr´ r r )rü r r´ r r^ rÏ rÎ r )r rð r rs Úks rW rÍ zStataReader._insert_strlsQ s ÜtUÔ#¤s¨4¯8©8£}¸Ò'9ØKÜ § ¡ Ó.ò JFAsØczØà MM!¸¿ ¹ Â!ÀQÀ$¹Ö H°1dhh¤s¨1£vÓ .Ò HÕ Ið Jð
|
ùò Is Á) B c ó | j s7t |« }t |« t |« k7 r t d« |j |j
|
« }|r(dj t |« « }t d| « g }g }g }g } |D ] }
|
|j
|
j |
|
« } |j | j | « |j | j | « |j | j | « | j | j | « || _
|
|| _ || _ | | _ d| _ || S )Nz"columns contains duplicate entriesz, z<The following columns were not found in the Stata data set: T)rè Úsetr rf Ú
|
differencerö r rÉ Úget_locr r_ r^ re rg ) r rð rö Ú
|
column_setÚ unmatchedÚjoinedrq rp ÚfmtlistÚlbllistrõ r s rW rÈ z StataReader._do_select_columns[ s2 Ø×(Ó(Ü W JÜ:¤# g£,Ò.Ü Ð!EÓFÐFØ"×-Ñ-¨d¯l©lÓ;IÙØ ¤4¨ £?Ó3Ü ð4Ø4:°8ð=óð ð
|
HØGØGØGØ ò 1ØLL×(Ñ(¨Ó-Ø §¡¨qÑ 1Ô2Øt}}¨QÑ /Ô0Øt}}¨QÑ /Ô0Øt}}¨QÑ /Õ0ð 1ð &DNØ #DMØ #DMØ #DMØ(,DÔ %àG}Ð r c ó |s|S g }t ||« D ]c \ }}||v rB|| }t j t |j « « « } || }
|
|
|
j | « } | j r| j « r| } n6| j r(t j t t t « ¬« d} t |
|
| |¬« } | >g }| j D ], }||v r|j || « |j |« . nt |j! « « } | j# |« } t' | |j* d¬ « }|j ||f« N|j ||| f« f t/ t1 |« d¬« }|S # t$ $ rd}t' |d¬« j) « }t |j* |dkD « }ddj- |« z }d | d
|
| d}t% |« |d}~ww xY w) zC
|
Converts categorical columns to Categorical type.
|
rs N)r ÚorderedF)r¿ rB zQ--------------------------------------------------------------------------------
|
r4 z
|
Value labels for column a are not unique. These cannot be converted to
|
pandas categoricals.
|
|
Either read the file with `convert_categoricals` set to False or use the
|
low level interface in `StataReader` to separately read the values and the
|
value_labels.
|
|
The repeated labels are:
|
r )rP r r rÉ ÚkeysÚisinrã Úallr r rÎ r r r r r ri Úrename_categoriesrf r' Ú value_countsrK r r$ rÆ )r rð Úvalue_label_dictr r÷ Úcat_converted_datarõ Úlabelr r ÚcolumnÚ key_matchesÚinitial_categoriesÚcat_datar r rt ÚvcÚ repeated_catsÚrepeatsr¦ Ú
|
cat_seriess rW rÒ z$StataReader._do_convert_categoricals{ s ñ ØKØ ÐÜ d GÓ,ó = <JCØÐ(Ò(à% eÑ,Üxx¤ R§W¡W£Y£Ó0Ø cØ $kk¨$Ó / Ø×'Ò'¨K¯O©OÔ,=Ø<@Ñ&ð ×+Ò+ä Ü :Ü 8Ü'7Ó'9õð
|
*.Ð&Ü&ØÐ'9ÐCUô ð &Ð-à!#JØ$,×$7Ñ$7ò 8Ø# r>Ø &× -Ñ -¨b°©lÕ ;à &× -Ñ -¨hÕ 7ñ 8ô "& b§i¡i£kÓ!2Jð3ð (× 9Ñ 9¸*Ó EHô& $ H°D·J±JÀUÔ K
|
Ø"×)Ñ)¨3°
|
Ð*;Ö<à"×)Ñ)¨3°°S± Ð*:Ö;ð{= <ô| Ð 0Ó1¸Ô>Ø øô/ "ò 3Ü
|
°Ô7×DÑDÓFBÜ$(¨¯©°"°q±&Ñ)9Ó$:MØ -°· ± ¸-Ó0HÑ HGð Ø ð ð ð
|
ð
|
Cô % S/¨sÐ2ûð!3ús Ä#FÆ G?ÆA G:Ç:G?c ó: | j « | j S )a
|
Return data label of Stata file.
|
|
Examples
|
--------
|
>>> df = pd.DataFrame([(1,)], columns=["variable"])
|
>>> time_stamp = pd.Timestamp(2000, 2, 29, 14, 21)
|
>>> data_label = "This is a data file."
|
>>> path = "/My_path/filename.dta"
|
>>> df.to_stata(path, time_stamp=time_stamp, # doctest: +SKIP
|
... data_label=data_label, # doctest: +SKIP
|
... version=None) # doctest: +SKIP
|
>>> with pd.io.stata.StataReader(path) as reader: # doctest: +SKIP
|
... print(reader.data_label) # doctest: +SKIP
|
This is a data file.
|
)rþ rP rV s rW Ú
|
data_labelzStataReader.data_labelÉ s ð$ ×ÑÔØ× Ñ Ð r c ó: | j « | j S )z2
|
Return time stamp of Stata file.
|
)rþ rR rV s rW Ú
|
time_stampzStataReader.time_stampÞ s ð
|
×ÑÔØ× Ñ Ð r c ót | j « t t | j | j « « S )a
|
Return a dict associating each variable name with corresponding label.
|
|
Returns
|
-------
|
dict
|
|
Examples
|
--------
|
>>> df = pd.DataFrame([[1, 2], [3, 4]], columns=["col_1", "col_2"])
|
>>> time_stamp = pd.Timestamp(2000, 2, 29, 14, 21)
|
>>> path = "/My_path/filename.dta"
|
>>> variable_labels = {"col_1": "This is an example"}
|
>>> df.to_stata(path, time_stamp=time_stamp, # doctest: +SKIP
|
... variable_labels=variable_labels, version=None) # doctest: +SKIP
|
>>> with pd.io.stata.StataReader(path) as reader: # doctest: +SKIP
|
... print(reader.variable_labels()) # doctest: +SKIP
|
{'index': '', 'col_1': 'This is an example', 'col_2': ''}
|
>>> pd.read_stata(path) # doctest: +SKIP
|
index col_1 col_2
|
0 0 1 2
|
1 1 3 4
|
)rþ rÆ rP rb ri rV s rW Úvariable_labelszStataReader.variable_labelsæ s, ð0 ×ÑÔÜC t×'<Ñ'<Ó=Ó>Ð>r c óR | j s| j « | j S )aX
|
Return a nested dict associating each variable name to its value and label.
|
|
Returns
|
-------
|
dict
|
|
Examples
|
--------
|
>>> df = pd.DataFrame([[1, 2], [3, 4]], columns=["col_1", "col_2"])
|
>>> time_stamp = pd.Timestamp(2000, 2, 29, 14, 21)
|
>>> path = "/My_path/filename.dta"
|
>>> value_labels = {"col_1": {3: "x"}}
|
>>> df.to_stata(path, time_stamp=time_stamp, # doctest: +SKIP
|
... value_labels=value_labels, version=None) # doctest: +SKIP
|
>>> with pd.io.stata.StataReader(path) as reader: # doctest: +SKIP
|
... print(reader.value_labels()) # doctest: +SKIP
|
{'col_1': {3: 'x'}}
|
>>> pd.read_stata(path) # doctest: +SKIP
|
index col_1 col_2
|
0 0 1 2
|
1 1 x 4
|
)ré r° rª rV s rW r zStataReader.value_labels s% ð0 ×&Ò&Ø × #Ñ #Ô %à×%Ñ%Ð%r )
|
TTNFTNTNÚinferN)rð ú FilePath | ReadBuffer[bytes]rñ rà rò rà ró ú
|
str | Nonerô rà rõ rà rö úSequence[str] | Noner÷ rà rø ú
|
int | Nonerù r. r7 úStorageOptions | Noner r3 r4 )r r1 )r ztype[BaseException] | Noner zBaseException | Noner zTracebackType | Noner r3 )r r` )r r5 )r2 r` r ztuple[int, ...])ro r` r z,tuple[list[int | str], list[str | np.dtype]])r z list[str]rf )r8 r5 r r3 )r rg )r r5 r r )r r$ rZ )rÀ r r r$ )NNNNNNNN)r½ r rñ ú bool | Nonerò r ró r rô r rõ r rö r r÷ r r r$ )rð r$ rô rà r r$ ©rð r$ r r$ )rð r$ rö ú Sequence[str]r r$ )
|
rð r$ r údict[str, dict[float, str]]r r" r÷ rà r r$ )r zdict[str, str])r r# )6r6 r7 r8 Ú_stata_reader_docr9 rh r rþ rý r r r r r r r" r& r( r* r, r. r0 r3 r r6 r] ra rd rf rh rM rO rQ rX r7 r ry r° rº r¾ rÁ r Ú_read_method_docr rÐ rÍ rÈ rÒ rm r r r r Ú __classcell__©rú s @rW rÔ rÔ ` s¾ ø
Ø GàÓð
|
#Ø%)Ø $Ø %Ø $Ø(,Ø#'Ø $Ø*1Ø15ð/@à1ð/@ð ð/@ð #ð /@ð
|
ð /@ð ð /@ð ð/@ð &ð/@ð !ð/@ð ð/@ð (ð/@ð /ð/@ð
|
õ/@ób ó ó>ð
|
à,ð ð (ð ð (ð ð
|
|
ó ó ó$%ó@ó@óRóRóRóRóRóRó@ó
|
ó .ó5<ðp!Ø ð!à 5ó!ó(Tó
|
TóTó ó 'ó
|
<ó
|
ó
|
óI7óVó 'ó*7'ór ,ó>0ô%ñ" Ð Ó ð !Ø%)Ø,0Ø $Ø'+Ø'+Ø(,Ø*.ðUàðUð #ðUð *ð Uð
|
ð Uð %ð Uð %ðUð &ðUð (ðUð
|
òUó ðUón,ó\ó ð@LàðLð 6ðLð ð Lð
|
!ð Lð
|
ó Lð\ ò ó ð ð( ò ó ð ó?÷6&r rÔ TFr ) rñ rò ró rô rõ rö r÷ rø Úiteratorrù r7 c ó t | ||||||||| |
|
¬« } | s|r| S | 5 | j « cd d d « S # 1 sw Y y xY w)N)
|
rñ rò ró rô rõ rö r÷ rø r7 rù )rÔ r ) r6 rñ rò ró rô rõ rö r÷ rø r( rù r7 Úreaders rW Ú
|
read_statar+ s\ ô ØØ#Ø 1ØØ'Ø'ØØ-ØØ'Ø ô Fñ 9Ø à ñ Ø{{}÷ ÷ ò ús 9¹Ac ól | j « dv ry| j « dv ryt d| d« )N)rA ÚlittlerA )r@ Úbigr@ z Endianness r )Úlowerrf )Ú
|
endiannesss rW rí rí D s> Ø×ÑÓ_Ñ,ØØ × Ñ Ó |Ñ +Øä; z l°/ÐBÓCÐCr c ór t | t « r| d|t | « z
|
z z S | d|t | « z
|
z z S )zQ
|
Take a char string and pads it with null bytes until it's length chars.
|
r ú )rå r5 r ©rï r· s rW r' r' M s@ ô $Ô Øg ¬#¨d«)Ñ!3Ñ4Ñ4Ð4Ø &F¤S¨£YÑ .Ñ/Ñ /Ð/r c ón | dv r#t j t j « S t d| d« )zK
|
Convert from one of the stata date formats to a type in TYPE_MAP.
|
)rp r8 rw r: ry r< r} r= r r> r r? r r@ r¾ z not implemented)r rv rÄ ÚNotImplementedError)r s rW Ú _convert_datetime_to_stata_typer6 V s; ð ð ñ ô xx
|
|
Ó#Ð#ä! G¨C¨5Ð0@Ð"AÓBÐBr c ó i }| D ]| }| | j d« s d| | z | |< ||v r&|j |j |« | | i« Lt |t « s t d« |j || | i« ~ |S )Nú%z0convert_dates key must be a column or an integer)r ÚupdaterK rå r` rf )rñ ÚvarlistÚnew_dictr? s rW Ú_maybe_convert_to_int_keysr< o s ØHØ ò 7Ø SÑ!×,Ñ,¨SÔ1Ø!$ }°SÑ'9Ñ!9M#Ñ Ø '>Ø OOW]]¨3Ó /° ¸sÑ1CÐ DÕ Eä c¤3Ô'Ü Ð!SÓTÐTØ OOS -°Ñ"4Ð 5Õ 6ð7ð Or c óÎ | j t j u r*t t |j
|
« « }t |d« S | j t j u ry| j t j u ry| j t j u ry| j t j u ry| j t j u ryt d| d« ) aõ
|
Convert dtype types to stata types. Returns the byte of the given ordinal.
|
See TYPE_MAP and comments for an explanation. This is also explained in
|
the dta spec.
|
1 - 244 are strings of this length
|
Pandas Stata
|
251 - for int8 byte
|
252 - for int16 int
|
253 - for int32 long
|
254 - for float32 float
|
255 - for double double
|
|
If there are dates to convert, then dtype will already have the correct
|
type inserted.
|
rB rx rw rv ru rt ú
|
Data type ú not supported.© r^ r Úobject_r r r rM rÄ rë rã rá rß r5 )rv r r« s rW Ú_dtype_to_stata_typerB } s© ð" zzRZZÑ ô (¬ °f·n±nÓ(EÓFÜ8QÓ Ð Ø rzzÑ !ØØ rzzÑ !ØØ rxxÑ ØØ rxxÑ ØØ rwwÑ Øä! J¨u¨g°_Ð"EÓFÐFr c ó |dk rd}nd}|ry| j t j u rlt t |j
|
« « }||kD r.|dk\ ryt t j |j « « dt t |d« « z dz S | t j k( ry| t j k( ry | t j k( ry
|
| t j t j fv ry t# d | d « )a¢
|
Map numpy dtype to stata's default format for this type. Not terribly
|
important since users can change this in Stata. Semantics are
|
|
object -> "%DDs" where DD is the length of the string. If not a string,
|
raise ValueError
|
float64 -> "%10.0g"
|
float32 -> "%9.0g"
|
int64 -> "%9.0g"
|
int32 -> "%12.0g"
|
int16 -> "%8.0g"
|
int8 -> "%8.0g"
|
strl -> "%9s"
|
r; éô rk z%9sr8 rB r z%10.0gz%9.0gz%12.0gz%8.0gr> r? )r^ r rA r r r rf rÊ rJ rï r rM rÄ rë rã rß rá r5 )rv r Ú dta_versionÚ
|
force_strlÚ max_str_lenr« s rW Ú_dtype_to_default_stata_fmtrH ¡ sâ ð& SÒØ à Ù ØØ zzRZZÑ Ü'¬ °f·n±nÓ(EÓFØ kÒ !ØcÒ!Ø ä Ô!>×!EÑ!EÀfÇkÁkÓ!RÓSÐSØSX qÓ)Ó*Ñ*¨SÑ0Ð0Ø "**Ò ØØ "**Ò ØØ "((Ò ØØ 277BHHÐ%Ñ %Øä! J¨u¨g°_Ð"EÓFÐFr Úcompression_optionsÚfname)r7 rI c ó e Zd ZU dZdZdZded< d(dd d) fdZd*d Zd+d
|
Z d,d Z
|
d-d Z d-d Z d.dZ d/dZd-dZd0dZd1dZd.dZd.dZd.dZd.dZd.dZd.dZd.dZd.dZd.dZ d2 d3d Zd.d Z d.d Z d.d Z d.d Z d.d!Z d.d"Z!d-d#Z"d4d$Z#d5d%Z$e%d6d&« Z&d7d'Z' xZ(S )8Ú StataWriterar
|
A class for writing Stata binary dta files
|
|
Parameters
|
----------
|
fname : path (string), buffer or path object
|
string, path object (pathlib.Path or py._path.local.LocalPath) or
|
object implementing a binary write() functions. If using a buffer
|
then the buffer will not be automatically closed after the file
|
is written.
|
data : DataFrame
|
Input to save
|
convert_dates : dict
|
Dictionary mapping columns containing datetime types to stata internal
|
format to use when writing the dates. Options are 'tc', 'td', 'tm',
|
'tw', 'th', 'tq', 'ty'. Column can be either an integer or a name.
|
Datetime columns that do not have a conversion type specified will be
|
converted to 'tc'. Raises NotImplementedError if a datetime column has
|
timezone information
|
write_index : bool
|
Write the index to Stata dataset.
|
byteorder : str
|
Can be ">", "<", "little", or "big". default is `sys.byteorder`
|
time_stamp : datetime
|
A datetime to use as file creation date. Default is the current time
|
data_label : str
|
A label for the data set. Must be 80 characters or smaller.
|
variable_labels : dict
|
Dictionary containing columns as keys and variable labels as values.
|
Each label must be 80 characters or smaller.
|
{compression_options}
|
|
.. versionchanged:: 1.4.0 Zstandard support.
|
|
{storage_options}
|
|
value_labels : dict of dicts
|
Dictionary containing columns as keys and dictionaries of column value
|
to labels as values. The combined length of all labels for a single
|
variable must be 32,000 characters or smaller.
|
|
.. versionadded:: 1.4.0
|
|
Returns
|
-------
|
writer : StataWriter instance
|
The StataWriter instance has a write_file method, which will
|
write the file to the given `fname`.
|
|
Raises
|
------
|
NotImplementedError
|
* If datetimes contain timezone information
|
ValueError
|
* Columns listed in convert_dates are neither datetime64[ns]
|
or datetime
|
* Column dtype is not representable in Stata
|
* Column listed in convert_dates is not in DataFrame
|
* Categorical label contains more than 32,000 characters
|
|
Examples
|
--------
|
>>> data = pd.DataFrame([[1.0, 1]], columns=['a', 'b'])
|
>>> writer = StataWriter('./data_file.dta', data)
|
>>> writer.write_file()
|
|
Directly write a zip file
|
>>> compression = {{"method": "zip", "archive_name": "data_file.dta"}}
|
>>> writer = StataWriter('./data_file.zip', data, compression=compression)
|
>>> writer.write_file()
|
|
Save a DataFrame with dates
|
>>> from datetime import datetime
|
>>> data = pd.DataFrame([[datetime(2000,1,1)]], columns=['date'])
|
>>> writer = StataWriter('./date_data_file.dta', data, {{'date' : 'tw'}})
|
>>> writer.write_file()
|
rD r r2 r N©r c óð t | « || _ |i n|| _ || _ || _ || _ || _ | | _ g | _ t j g t ¬« | _ | | _ d | _ i | _ | j# |« |
|
| _ |t& j( }t+ |« | _ || _ t j0 t j2 t j4 d| _ y )Nru )rv ru rt ) r× r rð rØ Ú _write_indexrR rP ri Ú_non_cat_value_labelsÚ _value_labelsr r rà Ú_has_value_labelsrà Ú _output_fileÚ_converted_namesÚ_prepare_pandasr7 rî r* rí r! Ú_fnamerã rá rß Útype_converters) r rJ rð rñ Ú write_indexr* r r r rù r7 r rú s rW r zStataWriter.__init__$ sÔ ø ô ÑÔØ Ø$1Ð$9b¸}ÔØ 'ÔØ%ÔØ%ÔØ /Ô Ø%1Ô"Ø46ÔÜ!#§¡¨"´DÔ!9Ô Ø 'ÔØ.2ÔØ57Ô à × Ñ TÔ"Ø .Ô à Ð Ü IÜ)¨)Ó4Ø Ü%'§X¡X´B·H±HÄ2Ç7Á7Ñ KÕ r c ó | j j j |j | j « « y)zS
|
Helper to call encode before writing to file for Python 3 compat.
|
N)r r r% r r )r Úto_writes rW Ú_writezStataWriter._writeJ s) ð ×Ñ×!Ñ! (§/¡/°$·.±.Ó"AÕBr c óN | j j j |« y)z?
|
Helper to assert file is open before writing.
|
N)r r r% rT s rW Ú _write_byteszStataWriter._write_bytesP s ð ×Ñ×!Ñ! %Õ(r c ó g }| j |S | j j « D ] \ }}|| j v r| j | }n)||j v r t |« }nt d| d« t || j « st d| d« t ||| j « }|j |« |S )zc
|
Check for value labels provided for non-categorical columns. Value
|
labels
|
z Can't create value labels for z!, it wasn't found in the dataset.z6, value labels can only be applied to numeric columns.) rP rA rT rö r rn r rv rf r< r r )r rð Únon_cat_value_labelsr ÚlabelsÚcolnameÚsvls rW Ú _prepare_non_cat_value_labelsz)StataWriter._prepare_non_cat_value_labelsV sí ð =?Ð Ø × %Ñ %Ð -Ø'Ð 'à #× 9Ñ 9× ?Ñ ?Ó Aò -OGVØ$×/Ñ/Ñ/Ø ×/Ñ/°Ñ8ØDLLÑ(Ü g,ä Ø4°W°Ið >,ð ,óð ô
|
$ D¨¡M×$7Ñ$7Ô8ô !Ø4°W°Ið >>ð >óð ô (¨°¸¿ ¹ ÓHCØ × 'Ñ '¨Õ ,ð' -ð( $Ð#r c ó |j D cg c] }t |t « }}t |« s|S | xj t j |« z c_ t j }g }t ||« D ]ª \ }}|rt || | j ¬« }| j j |« || j j j }|t
|
j" k( r t% d« || j j j& j) « } | j+ « ||« k\ r¨|t
|
j, k( r$t j t
|
j. « }nZ|t
|
j. k( r$t j t
|
j0 « }n#t j t
|
j2 « }t j | |¬« } ||« | | dk( < |j || f« |j ||| f« t5 j6 t9 |« « S c c}w )z
|
Check for categorical columns, retain categorical information for
|
Stata file and convert categorical data to int
|
)r zCIt is not possible to export int64-based categorical data to Stata.ru rJ ) r¡ rå r r rR r r rí re rP rþ r rQ r r Úcodesrv r rf r r¿ rM rß rá rã rÄ r$ rÔ rÆ )
|
r rð rv Úis_catre Údata_formattedrõ Ú
|
col_is_catrb ri s
|
rW Ú_prepare_categoricalsz!StataWriter._prepare_categoricalsw sÎ ð
|
DHÇ;Á;ÖO¸%*UÔ$4Õ5ÐOÐOÜ6{ØKà × Ò ¤"§(¡(¨6Ó"2Ñ2Õ ä!2×!IÑ!IÐ ØÜ " 4¨Ó 0ó 8OCÚÜ% d¨3¡i¸$¿.¹.ÔIØ×"Ñ"×)Ñ)¨#Ô.Ø S ×+Ñ+×1Ñ1ØBHHÒ$Ü$ðAóð ð c ×,Ñ,×4Ñ4×9Ñ9Ó;ð ::<Ñ#9¸%Ó#@Ò@Ø ¤§¡Ò'Ü "§¡¬¯©Ó 2Ø ¤"§(¡(Ò*Ü "§¡¬¯©Ó 2ä "§¡¬¯©Ó 4Ü XX f°EÔ :Fñ (>¸eÓ'Dv |Ñ$Ø ×%Ñ% s¨F mÖ4à ×%Ñ% s¨D°©IÐ&6Ö7ð5 8ô6 ×"Ñ"¤4¨Ó#7Ó8Ð8ùòG Ps Ic ó
|
|D ]} }|| j }|t j t j fv s5|t j k( r| j d }n| j d }|| j |« ||< |S )z
|
Checks floating point data columns for nans, and replaces these with
|
the generic Stata for missing value (.)
|
rª r[ )rv r rë rÄ rD rç )r rð r$ rv ró s rW Ú _replace_nanszStataWriter._replace_nans¡ s~ ð ò 6AØGMMEؤR§Z¡ZÐ0Ò0ØBJJÒ&Ø"&×"5Ñ"5°cÑ":Kà"&×"5Ñ"5°cÑ":KØ q'..¨Ó5Qð 6ð r c ó y)z No-op, forward compatibilityNr: rV s rW Ú_update_strl_namesz StataWriter._update_strl_names² ó r c ó |D ]; }|dk s|dkD s|dk s|dkD s|dk s|dkD s$|dk7 s*|j |d« }= |S )a
|
Validate variable names for Stata export.
|
|
Parameters
|
----------
|
name : str
|
Variable name
|
|
Returns
|
-------
|
str
|
The validated name with invalid characters replaced with
|
underscores.
|
|
Notes
|
-----
|
Stata 114 and 117 support ascii characters in a-z, A-Z, 0-9
|
and _.
|
ÚAÚZÚaÚzr² Ú9rr )Úreplace©r rï r$ s rW Ú_validate_variable_namez#StataWriter._validate_variable_nameµ sX ð( ò ,AàSA GØW C£ØW C£ØHà|| A sÓ+ð ,ð r c óö i }t |j « }|dd }d}t |« D ]Ú \ }}|}t |t « s t |« }| j |« }|| j v rd|z }d|d cxk rdk rn nd|z }|dt t |« d« }||k( s\|j |« dkD rCdt |« z |z }|dt t |« d« }|dz }|j |« dkD rC|||< |||< Ü t |« |_ | j rCt ||« D ]4 \ } }
|
| |
|
k7 s | j |
|
| j | < | j |
|
= 6 |rzg } |j « D ] \ }}| d| } | j | « t j! d j# | « « } t% j& | t( t+ « ¬
|
« || _ | j/ « |S ) aÌ
|
Checks column names to ensure that they are valid Stata column names.
|
This includes checks for:
|
* Non-string names
|
* Stata keywords
|
* Variables that start with numbers
|
* Variables with names that are too long
|
|
When an illegal variable name is detected, it is converted, and if
|
dates are exported, the variable name is propagated to the date
|
conversion dictionary
|
Nr rr r² rt r! rB z -> z
|
rs )rÉ rö r rå r rw rÐ rN r r2 r% rØ rP rA r rÍ rJ r r r r r rT rm )r rð Úconverted_namesrö Úoriginal_columnsÚduplicate_var_idrô rï Ú orig_namer$ ÚoÚconversion_warningr¦ rñ s rW Ú_check_column_namesz StataWriter._check_column_namesÓ s$ ð 02Üt||Ó$Ø"¡1:Ðà ÐÜ Ó)ò GAtØ IÜ d¤CÔ(Ü4yà×/Ñ/°Ó5Dð t×*Ñ*Ñ*ØTzð d1gÔ$ Õ$ØTzàÐ,#c $i¨Ó,Ð-Dà9Ò$à mm DÓ)¨AÒ-à ¤Ð%5Ó!6Ñ6¸Ñ=DØ Ð 4¤#¤c¨$£i°Ó"4Ð5DØ$¨Ñ)Ð$ð mm DÓ)¨AÓ-ð
|
.2 Ñ*à GAJð5 ô8 W~ ð × Ò ÜGÐ%5Ó6ò /1Ø6Ø-1×-@Ñ-@ÀÑ-CD×'Ñ'¨Ñ*Ø ×+Ñ+¨AÑ.ð /ñ
|
Ø!#Ð Ø#2×#8Ñ#8Ó#:ò / 4Ø" 8¨D¨6Ð2Ø"×)Ñ)¨#Õ.ð /ô "×(Ñ(¨¯ © Ð7IÓ)JÓKBÜ MMØÜ!Ü+Ó-õ ð !0Ô Ø × Ñ Ô!à r c ó g | _ g | _ |j « D ]i \ }}| j j t || j
|
| « « | j j t || j
|
| « « k y rZ )rÿ rp rA r rH rð rB )r r¡ rõ rv s rW Ú_set_formats_and_typesz"StataWriter._set_formats_and_types
|
so Ø"$ Ø"$ Ø ,,.ò MJCØ LL× Ñ Ô ;¸EÀ4Ç9Á9ÈSÁ>Ó RÔ SØ LL× Ñ Ô 4°U¸D¿I¹IÀc¹NÓ KÕ Lñ Mr c ó |j « }| j r"|j « }t |t « r|}| j |« }t |« }| j |« }t j d|j d « | _ | j |« }|D cg c] }|j }}|j j |« }| xj |z c_ | j j# |« | j% |« }|j \ | _ | _ || _ |j j- « | _ |j0 }|D ]D }|| j2 v rt5 j6 || j8 d« s6d| j2 |< F t; | j2 | j. « | _ | j2 D ]< } t= | j2 | « }
|
t j8 |
|
« |j> | < > | jA « | jC |« | j2 ?| j2 D ]/ } t | tD « s| j2 | | jF | < 1 y y c c}w )NFrB r¡ rp )$r¿ rO Ú reset_indexrå r$ r rü rk r Úrepeatré rR rc r rö r rQ Úextendri ÚnobsÚnvarrð Útolistr: r¡ rØ r r± rv r< r6 rÎ Ú_encode_stringsr r` rÿ ) r rð Útempr_ rb Únon_cat_columnsÚhas_non_cat_val_labelsr¡ rõ r? Únew_types rW rU zStataWriter._prepare_pandas#
|
sI ð yy{à × Ò Ø×#Ñ#Ó%DÜ$¤ Ô*Øð ×'Ñ'¨Ó-ô $ DÓ)ð ×!Ñ! $Ó'ô "$§¡¨5°$·*±*¸Q±-Ó!@Ô ð $× AÑ AÀ$Ó GÐ à2FÖG¨33;;ÐGÐGØ!%§ ¡ ×!2Ñ!2°?Ó!CÐ Ø × Ò Ð"8Ñ8Õ Ø ×Ñ×!Ñ!Ð"6Ô7ð ×)Ñ)¨$Ó/à #zzÑ 49Ø Ø||×*Ñ*Ó, àð ò 0CØd×)Ñ)Ñ)ØÜt Cy°Õ4Ø+/×#Ñ# CÒ(ð 0ô 9Ø × Ñ § ¡ ó
|
Ôð ×&Ñ&ò 2CÜ6°t×7JÑ7JÈ3Ñ7OÓPHÜ !xx¨Ó 1FKKÒ ð 2ð
|
× Ñ Ô à ×#Ñ# FÔ+ð × Ñ Ð *Ø×*Ñ*ò AÜ c¤3Õ'Ø(,×(;Ñ(;¸CÑ(@DLL Ò%ñ Að +ùòE Hs Â)J c óB | j }t | dg « }t | j « D ]î \ }}||v s||v r| j | }|j }|j
|
t j u sGt |d¬« }|dk( s)t |« dk( s|j }t d| d« | j | j j | j « }t t! |j" « « | j$ k sà|| j |< ð y) zõ
|
Encode strings in dta-specific encoding
|
|
Do not encode columns marked for date conversion or for strL
|
conversion. The strL converter independently handles conversion and
|
also accepts empty string arrays.
|
Ú _convert_strlTr¤ rW r zColumn `a ` cannot be exported.
|
|
Only string-like object arrays
|
containing all strings or a mix of strings and None can be exported.
|
Object arrays containing only null values are prohibited. Other object
|
types cannot be exported and must first be converted to one of the
|
supported types.N)rØ rO r rð rv r^ r rA r r rï rf r r r r r r Ú_max_string_length) r rñ Ú convert_strlr rõ r rv Úinferred_dtypeÚencodeds rW r zStataWriter._encode_stringse
|
s ð ×+Ñ+ ä t _°bÓ9 Ü § ¡ Ó*ò -FAsàMÑ! S¨LÑ%8ØØYYs^FØLLEàzzRZZÒ'Ü!,¨V¸DÔ!AØ'¨8Ò3¼¸F» ÀqÒ8HØ ++CÜ$ð Ø ð ðóð ð )) C.×,Ñ,×3Ñ3°D·N±NÓCô )¬ °w·±Ó)GÓHØ×.Ñ.ó/ð &-DIIcNñ3 -r c ó¾ t | j d| j d| j ¬« 5 | _ | j j
|
d n| j j t « c| _ | j _ | j j j | j j « | j | j | j ¬« | j « | j « | j! « | j# « | j% « | j' « | j) « | j+ « | j- « | j/ « }| j1 |« | j3 « | j5 « | j7 « | j « | j9 « ddd« y# t: $ rØ}| j j= « t? | j t@ tB jD f« rtB jF jI | j « rd tC jJ | j « |# tL $ r6 tO jP d| j dtR tU « ¬ « Y |w xY w|d}~ww xY w# 1 sw Y yxY w)
|
a
|
Export DataFrame object to Stata dta format.
|
|
Examples
|
--------
|
>>> df = pd.DataFrame({"fully_labelled": [1, 2, 3, 3, 1],
|
... "partially_labelled": [1.0, 2.0, np.nan, 9.0, np.nan],
|
... "Y": [7, 7, 9, 8, 10],
|
... "Z": pd.Categorical(["j", "k", "l", "k", "j"]),
|
... })
|
>>> path = "/My_path/filename.dta"
|
>>> labels = {"fully_labelled": {1: "one", 2: "two", 3: "three"},
|
... "partially_labelled": {1.0: "one", 2.0: "two"},
|
... }
|
>>> writer = pd.io.stata.StataWriter(path,
|
... df,
|
... value_labels=labels) # doctest: +SKIP
|
>>> writer.write_file() # doctest: +SKIP
|
>>> df = pd.read_stata(path) # doctest: +SKIP
|
>>> df # doctest: +SKIP
|
index fully_labelled partially_labeled Y Z
|
0 0 one one 7 j
|
1 1 two two 7 k
|
2 2 three NaN 9 l
|
3 3 three 9.0 8 k
|
4 4 one NaN 10 j
|
ÚwbF)rù r r7 ÚmethodN)r r z!This save was not successful but z. could not be deleted. This file is not valid.rs )+r) rV rà r7 r rù r r rS Úcreated_handlesr Ú _write_headerrP rR Ú
|
_write_mapÚ_write_variable_typesÚ_write_varnamesÚ_write_sortlistÚ_write_formatsÚ_write_value_label_namesÚ_write_variable_labelsÚ_write_expansion_fieldsÚ_write_characteristicsÚ _prepare_dataÚ _write_dataÚ _write_strlsÚ_write_value_labelsÚ_write_file_close_tagÚ_closeÚ Exceptionr rå r ÚosÚPathLikeÚpathÚisfileÚunlinkÚOSErrorr r r r )r ÚrecordsÚexcs rW Ú
|
write_filezStataWriter.write_file
|
sJ ô8 Ø KKØ Ø ×)Ñ)ØØ × 0Ñ 0ô
|
ð / ð \Ø||×'Ñ'¨Ñ1Ð=ð :>¿ ¹ ×9LÑ9LÌgËiÐ6Ô! 4§<¡<Ô#6Ø ×,Ñ,×3Ñ3°D·L±L×4GÑ4GÔHð" Ø×"Ñ"Ø #× /Ñ /¸D×<LÑ<Lð #ô ð Ô!Ø×*Ñ*Ô,Ø×$Ñ$Ô&Ø×$Ñ$Ô&Ø×#Ñ#Ô%Ø×-Ñ-Ô/Ø×+Ñ+Ô-Ø×,Ñ,Ô.Ø×+Ñ+Ô-Ø ×,Ñ,Ó.Ø× Ñ Ô)Ø×!Ñ!Ô#Ø×(Ñ(Ô*Ø×*Ñ*Ô,ØÔ!Ø ÷A/ ð / øôB ò Ø ×"Ñ"Ô$Ü dkk¬C´·±Ð+=Ô>Ä2Ç7Á7Ç>Á>ØKKôDðÜ $§+¡+Ô.ð øô #ò Ü Ø ?ÀÇ Á ¸}ð MBð Bä +Ü'7Ó'9ö ð ðúð ûð ú÷C/ ð / úsP ¯B KÂ=D(G/Ç/ KÇ8A-K É& JÊK Ê;KËK ËKËK Ë KËKËK c ó4 | j t | j j t « sJ | j j | j c}| j _ | j j j |j « « yy)zÌ
|
Close the file if it was created by the writer.
|
|
If a buffer or file-like object was passed in, for example a GzipFile,
|
then leave this file open for the caller to close.
|
N)rS rå r r r r% r) )r r+ s rW r§ zStataWriter._closeØ
|
sp ð × Ñ Ð (Ü dll× 1Ñ 1´7Ô;Ð ;Ð;Ø'+§|¡|×':Ñ':¸D×<MÑ<MÐ $C Ô$Ø LL× Ñ × %Ñ % c§l¡l£nÕ 5ð )r c ó y©úNo-op, future compatibilityNr: rV s rW r zStataWriter._write_mapå
|
rn r c ó yr´ r: rV s rW r¦ z!StataWriter._write_file_close_tagè
|
rn r c ó yr´ r: rV s rW r¡ z"StataWriter._write_characteristicsë
|
rn r c ó yr´ r: rV s rW r¤ zStataWriter._write_strlsî
|
rn r c ó: | j t dd« « y)z"Write 5 zeros for expansion fieldsrÐ r¨ N)r[ r' rV s rW r z#StataWriter._write_expansion_fieldsñ
|
s à Jr 1Ó%Õ&r c óz | j D ], }| j |j | j « « . y rZ )rQ r] r0 r! )r r s rW r¥ z StataWriter._write_value_labelsõ
|
s6 Ø×$Ñ$ò HBØ × Ñ b× 5Ñ 5°d·o±oÓ FÕ Gñ Hr c óÊ | j }| j t j dd« « | j |dk( xr dxs d« | j d« | j d« | j t j |dz | j
|
« d d « | j t j |d z | j « d d
|
« |+| j | j t d d « « « n-| j | j t |d d d « « « |t j « }nt |t « s t d « g d¢}t |« D ci c] \ }}|dz | }}}|j d« ||j z |j d« z }| j | j |« « y c c}}w )Nri r r@ úúr2 r r
r r rÐ éP ú"time_stamp should be datetime type© ÚJanÚFebÚMarÚAprÚMayÚJunÚJulÚAugÚSepÚOctÚNovÚDecrB ú%d ú %Y %H:%M)r! r] rÅ r& r[ r r Ú_null_terminate_bytesr' r Únowrå rf r ÚstrftimerR ) r r r r* Úmonthsr rR Ú month_lookupÚtss rW r zStataWriter._write_headerù
|
s¨ ð
|
OO à ×Ñ&++ c¨3Ó/Ô0à I Ñ$Ò/¨Ò9°6Ô:à FÔà FÔà ×Ñ&++ i°#¡o°t·y±yÓAÀ"À1ÐEÔFà ×Ñ&++ i°#¡o°t·y±yÓAÀ"À1ÐEÔFà Ð Ø × Ñ d× 8Ñ 8¼ÀBÈÓ9KÓ LÕ Mà × Ñ Ø×*Ñ*¬:°jÀÀ"°oÀrÓ+JÓKô ð
|
Ð Ü! JÜJ¬Ô1Ü Ð AÓBÐ Bò
|
ô 6?¸vÓ5F×G©¨¨EAu ÐG ÑGà × Ñ Ó &Ø:×+Ñ+Ñ,ñ -à×!Ñ! +Ó.ñ /ð ð
|
×Ñ$×4Ñ4°RÓ8Õ9ùó Hs Å8G c óp | j D ]' }| j t j d|« « ) y )Nr )rp r] rÅ r& )r rs s rW r z!StataWriter._write_variable_types0 s. Ø<<ò 5CØ × Ñ fkk¨#¨sÓ 3Õ 4ñ 5r c ó | j D ]3 }| j |« }t |d d d« }| j |« 5 y )Nr! rv )r: Ú_null_terminate_strr' r[ )r rï s rW r zStataWriter._write_varnames4 sE ð LLò DØ×+Ñ+¨DÓ1DÜ d 3 Bi¨Ó,DØ KKÕ ñ r c ó^ t dd| j dz z « }| j |« y )NrÐ r
rB )r' r r[ )r Úsrtlists rW r zStataWriter._write_sortlist< s' ä R d§i¡i°!¡mÑ!4Ó5Ø GÕ r c ó\ | j D ] }| j t |d« « y )Nr~ )rÿ r[ r' )r r s rW r zStataWriter._write_formatsA s( à<<ò -CØ KK
|
3¨Ó+Õ ,ñ -r c ó t | j « D ]m }| j | rA| j | }| j |« }t |d d d« }| j |« S| j t dd« « o y )Nr! rv rÐ )r( r rR r: r× r' r[ )r r rï s rW r z$StataWriter._write_value_label_namesF sv ätyyÓ!ò 0Aà×%Ñ% aÒ(Ø|| AØ×/Ñ/°Ó5Ü! $ s¨ )¨RÓ0Ø DÕ!à J r¨2Ó .Õ/ñ 0r c ó² t dd« }| j ,t | j « D ] }| j |« y | j
|
D ] }|| j v rc| j | }t |« dkD r t d« t d |D « « }|s t d« | j t |d« « t| j |« y )NrÐ r r¾ ú.Variable labels must be 80 characters or fewerc 3 ó8 K | ] }t |« d k yw)é N)Úord)rÄ r$ s rW rÆ z5StataWriter._write_variable_labels.<locals>.<genexpr>` s è ø Ò <°¤ A£¨¥ Ñ <ùs zKVariable labels must contain only characters that can be encoded in Latin-1) r' ri r( r r[ rð r rf r )r Úblankr rõ r
|
Ú is_latin1s rW r z"StataWriter._write_variable_labelsR sÏ ä2rÓ"à × Ñ Ð (Ü499Ó%ò #Ø EÕ"ð #à à99ò #CØd×+Ñ+Ñ+Ø ×-Ñ-¨cÑ2Üu: ?Ü$Ð%UÓVÐVÜ Ñ <°eÔ <Ó < Ù Ü$ð4óð ð J u¨bÓ 1Õ2à EÕ"ñ #r c ó |S )rµ r: )r rð s rW Ú_convert_strlszStataWriter._convert_strlsj s à r c óD | j }| j }| j }| j 7t |« D ]) \ }}||v s t || | j
|
| « ||< + | j |« }i }| j t t j « k( }t |« D ]Ô \ }}|| }|| j k rt j « 5 t j ddt ¬« || j! d« } d d d « j# t$ |f¬« ||< d| }
|
|
|
||< || j' |
|
« ||< ¤|| j( } |s| j+ | j « } | ||< Ö |j- d|¬« S # 1 sw Y xY w) NÚignorez Downcasting object dtype arrays)r rÐ )Úargsrs F)rK Ú column_dtypes)rð rp rØ r rÉ rÿ rä r! rí rî r* r r Úcatch_warningsÚfilterwarningsr rç r¶ r' r rv rË Ú
|
to_records) r rð rp rñ r rõ r¡ Únative_byteorderrs ÚdcÚstyperv s rW r¢ zStataWriter._prepare_datan s ØyyØ,,Ø ×+Ñ+ à × Ñ Ð *Ü# D/ò 3Ø Ò%Ü >Ø S 4§<¡<°¡?ó!DIð ð ×"Ñ" 4Ó(ð Ø ??¬o¼c¿m¹mÓ.LÑLÐÜ oò $FAsØ!*CØd×-Ñ-Ò-Ü ×,Ñ,Ó.ñ .Ü ×+Ñ+Ø Ø9Ü!.õð
|
c×)Ñ)¨"Ó-B÷ .ð HH¤Z°s°fHÓ =S ØC5 Ø #s Ø I× ,Ñ ,¨UÓ 3S à S Ù'Ø !× .Ñ .¨t¯©Ó ?EØ #s ð% $ð( U¸&ÓAÐA÷#.ð .ús Ã1FÆF c óB | j |j « « y rZ )r] Útobytes©r r¯ s rW r£ zStataWriter._write_data s Ø ×Ñ'//Ó+Õ,r c ó | dz } | S )Nr2 r: )r s rW r× z StataWriter._null_terminate_str s à V Ør c óV | j |« j | j « S rZ )r× r r )r r s rW rÏ z!StataWriter._null_terminate_bytes s" Ø×'Ñ'¨Ó*×1Ñ1°$·.±.ÓAÐAr )NTNNNNr N)rJ ú FilePath | WriteBuffer[bytes]rð r$ rñ údict[Hashable, str] | NonerX rà r* r r údatetime | Noner r r rõ rù r. r7 r r ú'dict[Hashable, dict[float, str]] | Noner r3 )rZ r r r3 )ra r5 r r3 )rð r$ r zlist[StataNonCatValueLabel]r! r4 ©rï r r r ©r¡ r' r r3 )rð r$ r r3 ©NN©r r r rö r r3 )r únp.rec.recarray)r¯ rü r r3 )r r r r )r r r r5 ))r6 r7 r8 r9 r r rh r r[ r] rc ri rk rm rw r r rU r r± r§ r r¦ r¡ r¤ r r¥ r r r r r r r rä r¢ r£ Ú staticmethodr× rÏ r& r' s @rW rL rL Î s¼ ø
ñ
|
Lð\ ÐØ-6IÐ*Ó6ð 59Ø Ø $Ø&*Ø!%Ø6:Ø*1Ø15ð$Lð AEñ$Là,ð$Lð ð$Lð 2ð $Lð
|
ð $Lð ð $Lð $ð$Lð ð$Lð 4ð$Lð (ð$Lð /ð$Lð >ð$Lð
|
õ $LóLCó )ð $Ø ð $à $ó $óB(9óTó"+ó ó<GóRMó@AóD$-óLKóZ 6ó*ó*ó*ó*ó'óHð "&Ø&*ð5:à ð5:ð $ð5:ð
|
ó 5:ón5ó ó ó
|
-ó
|
|
0ó#ó0ó%BóN-ð òó ð÷Br rL c óä |ry| j t j u r2t t |j
|
« « }t |d« }|dk r|S y| j t j u ry| j t j u ry| j t j u ry| j t j u ry| j t j u ryt d | d
|
« ) a
|
Converts dtype types to stata types. Returns the byte of the given ordinal.
|
See TYPE_MAP and comments for an explanation. This is also explained in
|
the dta spec.
|
1 - 2045 are strings of this length
|
Pandas Stata
|
32768 - for object strL
|
65526 - for int8 byte
|
65527 - for int16 int
|
65528 - for int32 long
|
65529 - for float32 float
|
65530 - for double double
|
|
If there are dates to convert, then dtype will already have the correct
|
type inserted.
|
ry rB rk rz r{ r| r} r~ r> r? r@ )rv r rF r« s rW Ú_dtype_to_stata_type_117rÿ ¡ s¾ ñ$ ØØ zzRZZÑ ô (¬ °f·n±nÓ(EÓFÜx Ó#Ø tÒ ØOØØ rzzÑ !ØØ rzzÑ !ØØ rxxÑ ØØ rxxÑ ØØ rwwÑ Øä! J¨u¨g°_Ð"EÓFÐFr c ób t | t « r t | d« } | d|t | « z
|
z z S )zU
|
Takes a bytes instance and pads it with null bytes until it's length chars.
|
r r )rå r r5 r r3 s rW Ú_pad_bytes_newr Ë s3 ô $Ô ÜT7Ó#Ø 'V¤c¨$£iÑ /Ñ0Ñ 0Ð0r c óH e Zd ZdZ d ddZd dZd
|
dZd dZy) ÚStataStrLWriteraÑ
|
Converter for Stata StrLs
|
|
Stata StrLs map 8 byte values to strings which are stored using a
|
dictionary-like format where strings are keyed to two values.
|
|
Parameters
|
----------
|
df : DataFrame
|
DataFrame to convert
|
columns : Sequence[str]
|
List of columns names to convert to StrL
|
version : int, optional
|
dta version. Currently supports 117, 118 and 119
|
byteorder : str, optional
|
Can be ">", "<", "little", or "big". default is `sys.byteorder`
|
|
Notes
|
-----
|
Supports creation of the StrL block of a dta file for dta versions
|
117, 118 and 119. These differ in how the GSO is stored. 118 and
|
119 store the GSO lookup value as a uint32 and a uint64, while 117
|
uses two uint32s. 118 and 119 also encode all strings as unicode
|
which is required by the format. 117 uses 'latin-1' a fixed width
|
encoding that extends the 7-bit ascii table with an additional 128
|
characters.
|
Nc ó* |dvr t d« || _ || _ || _ ddi| _ |t
|
j }t |« | _ d}d}d| _ |dk( r d }d}d
|
| _ n
|
|d k( rd }nd }ddd|z
|
z z | _
|
|| _ || _ y )Nr: z,Only dta versions 117, 118 and 119 supportedrÐ ©r r r% r r r; r r r r r¨ r
r ) rf Ú_dta_verÚdfrö Ú
|
_gso_tablerî r* rí r! r Ú_o_offetÚ _gso_o_typeÚ _gso_v_type)r r rö r> r* Ú
|
gso_v_typeÚ
|
gso_o_typeÚo_sizes rW r zStataStrLWriter.__init__ñ s² ð /Ñ )Ü Ð KÓLÐ LØ àØ Ø v,Ø Ð Ü IÜ)¨)Ó4à
|
Ø
|
Ø Ø c>ØFØ JØ &DNØ ^ØFàFØa 1 v¡:Ñ .Ñ/ Ø%ÔØ%Õr c ó0 |\ }}|| j |z z S rZ )r )r r? rº r} s rW Ú _convert_keyz StataStrLWriter._convert_key s Ø1Ø4== 1Ñ$Ñ$Ð$r c ó | j }| j }t |j « }|| j }| j D cg c] }||j |« f }}t j |j t
|
j ¬« }t |j « « D ]b \ }\ } }
|
t |« D ]L \ } \ }} |
|
| } | dn| } |j | d« }|| dz |dz f}||| < | j |« ||| f< N d t | j « D ] \ }}|dd
|f ||< ||fS c c}w )aø
|
Generates the GSO lookup table for the DataFrame
|
|
Returns
|
-------
|
gso_table : dict
|
Ordered dictionary using the string found as keys
|
and their lookup position (v,o) as values
|
gso_df : DataFrame
|
DataFrame where strl columns have been converted to
|
(v,o) values
|
|
Notes
|
-----
|
Modifies the DataFrame in-place.
|
|
The DataFrame returned encodes the (v,o) values as uint64s. The
|
encoding depends on the dta version, and can be expressed as
|
|
enc = v + o * 2 ** (o_size * 8)
|
|
so that v is stored in the lower bits and o is in the upper
|
bits. o_size is
|
|
* 117: 4
|
* 118: 6
|
* 119: 5
|
ru NrÐ rB ) r r rÉ rö rK r Úemptyré r× r ÚiterrowsÚgetr )r Ú gso_tableÚgso_dfrö Úselectedrõ Ú col_indexr r} rß Úrowrô rº r r? r s rW Úgenerate_tablez StataStrLWriter.generate_table sM ð: OO ØÜv~~Ó&Ø$,,Ñ'Ø:>¿,¹,ÖG°3c7==¨Ó-Ò.ÐG ÐGÜxx¬b¯i©iÔ8Ü & x×'8Ñ'8Ó':Ó ;ò
|
4MAzSÜ (¨Ó 3ò 4 8CØ#hà Kb¨SØ mm C¨Ó.Ø;à q5 ! a¡%.CØ%(IcNØ !× .Ñ .¨sÓ 3QT
|
ñ 4ð
|
4ô § ¡ Ó-ò %FAsØ q !t*F3Kð %ð &Ð Ð ùò! Hs Á Ec ó8 t « }t dd« }t j | j dz d« }t j | j dz d« }| j | j
|
z }| j | j z }| j dz }|j « D ]Û \ } }
|
|
|
dk( r |
|
\ } } |j |« |j t j || « « |j t j || « « |j |« t | d« } |j t j |t | « d z « « |j | « |j |« Ý |j « S )
|
aç
|
Generates the binary blob of GSOs that is written to the dta file.
|
|
Parameters
|
----------
|
gso_table : dict
|
Ordered dictionary (str, vo)
|
|
Returns
|
-------
|
gso : bytes
|
Binary content of dta file to be placed between strl tags
|
|
Notes
|
-----
|
Output format depends on dta version. 117 uses two uint32s to
|
express v and o while 118+ uses a uint32 for v and a uint64 for o.
|
r´ Úasciir r³ r r% r r rB ) r r5 rÅ r& r! r r
|
rA r% r r) )r r r+ ÚgsoÚgso_typeÚnullÚv_typeÚo_typeÚlen_typeÚstrlÚvorº r} Ú utf8_strings rW Ú generate_blobz StataStrLWriter.generate_blobI sO ô: iÜE7Ó#Ü;;t°Ñ 4°cÓ:Ü{{4??¨SÑ0°!Ó4Ø 4×#3Ñ#3Ñ3Ø 4×#3Ñ#3Ñ3Ø?? SÑ(Ø!Ó)ò HD"ØV|ØØDAqð IIcNð IIfkk &¨!Ó,Ô -ð IIfkk &¨!Ó,Ô -ð IIhÔ ô gÓ.KØ IIfkk (¬C° Ó,<¸qÑ,@ÓAÔ Bð IIkÔ "Ø IIdOð/ ð2 ||~Ð r )r; N)
|
r r$ rö r" r> r` r* r r r3 )r? ztuple[int, int]r r` )r z,tuple[dict[str, tuple[int, int]], DataFrame])r zdict[str, tuple[int, int]]r r5 )r6 r7 r8 r9 r r r r& r: r rW r r Ô sV ñð@ Ø $ð &à ð &ð ð &ð ð &ð
|
ð &ð
|
ó &óB%ó1!ôf= r r c ó* e Zd ZdZdZdZ ddd d fdZed d« Zd dZ d d d Z
|
d d
|
Z d d Z d d Z d d Zd dZd dZd dZd dZd dZd dZd dZd dZd dZd dZd!dZd"dZ xZS )#ÚStataWriter117a
|
A class for writing Stata binary dta files in Stata 13 format (117)
|
|
Parameters
|
----------
|
fname : path (string), buffer or path object
|
string, path object (pathlib.Path or py._path.local.LocalPath) or
|
object implementing a binary write() functions. If using a buffer
|
then the buffer will not be automatically closed after the file
|
is written.
|
data : DataFrame
|
Input to save
|
convert_dates : dict
|
Dictionary mapping columns containing datetime types to stata internal
|
format to use when writing the dates. Options are 'tc', 'td', 'tm',
|
'tw', 'th', 'tq', 'ty'. Column can be either an integer or a name.
|
Datetime columns that do not have a conversion type specified will be
|
converted to 'tc'. Raises NotImplementedError if a datetime column has
|
timezone information
|
write_index : bool
|
Write the index to Stata dataset.
|
byteorder : str
|
Can be ">", "<", "little", or "big". default is `sys.byteorder`
|
time_stamp : datetime
|
A datetime to use as file creation date. Default is the current time
|
data_label : str
|
A label for the data set. Must be 80 characters or smaller.
|
variable_labels : dict
|
Dictionary containing columns as keys and variable labels as values.
|
Each label must be 80 characters or smaller.
|
convert_strl : list
|
List of columns names to convert to Stata StrL format. Columns with
|
more than 2045 characters are automatically written as StrL.
|
Smaller columns can be converted by including the column name. Using
|
StrLs can reduce output file size when strings are longer than 8
|
characters, and either frequently repeated or sparse.
|
{compression_options}
|
|
.. versionchanged:: 1.4.0 Zstandard support.
|
|
value_labels : dict of dicts
|
Dictionary containing columns as keys and dictionaries of column value
|
to labels as values. The combined length of all labels for a single
|
variable must be 32,000 characters or smaller.
|
|
.. versionadded:: 1.4.0
|
|
Returns
|
-------
|
writer : StataWriter117 instance
|
The StataWriter117 instance has a write_file method, which will
|
write the file to the given `fname`.
|
|
Raises
|
------
|
NotImplementedError
|
* If datetimes contain timezone information
|
ValueError
|
* Columns listed in convert_dates are neither datetime64[ns]
|
or datetime
|
* Column dtype is not representable in Stata
|
* Column listed in convert_dates is not in DataFrame
|
* Categorical label contains more than 32,000 characters
|
|
Examples
|
--------
|
>>> data = pd.DataFrame([[1.0, 1, 'a']], columns=['a', 'b', 'c'])
|
>>> writer = pd.io.stata.StataWriter117('./data_file.dta', data)
|
>>> writer.write_file()
|
|
Directly write a zip file
|
>>> compression = {"method": "zip", "archive_name": "data_file.dta"}
|
>>> writer = pd.io.stata.StataWriter117(
|
... './data_file.zip', data, compression=compression
|
... )
|
>>> writer.write_file()
|
|
Or with long strings stored in strl format
|
>>> data = pd.DataFrame([['A relatively long string'], [''], ['']],
|
... columns=['strls'])
|
>>> writer = pd.io.stata.StataWriter117(
|
... './data_file_with_long_strings.dta', data, convert_strl=['strls'])
|
>>> writer.write_file()
|
rk r; NrM c ó g | _ | | j j | « t | ||||||||| |
|
| ¬« i | _ d| _ y )N)r* r r r r rù r7 r )r r
r× r Ú_mapÚ
|
_strl_blob)r rJ rð rñ rX r* r r r r rù r7 r rú s rW r zStataWriter117.__init__â sj ø ð" .0ÔØ Ð #Ø × Ñ × %Ñ % lÔ 3ä ÑØ Ø Ø Ø Ø Ø!Ø!Ø +Ø%Ø#Ø +ð ô
|
ð %' Ø r c ó t | t « r t | d« } t d|z dz d« | z t d|z dz d« z S )z Surround val with <tag></tag>r rA r@ z</)rå r r5 )r Útags rW Ú_tagzStataWriter117._tag sI ô c3Ô ÜWÓ%CÜS3Y _ gÓ.°Ñ4´u¸TÀC¹ZÈ#Ñ=MÈwÓ7WÑWÐWr c ó | j j J | j j j « | j |< y)z.Update map location for tag with file positionN)r r r r* )r r- s rW Ú _update_mapzStataWriter117._update_map s8 à||×"Ñ"Ð.Ð.Ð.Ø ×,Ñ,×1Ñ1Ó3 #r c ój | j }| j t dd« « t « }|j | j t t | j « d« d« « |j | j |dk( xr dxs dd« « | j dk rd nd
|
}|j | j t j ||z | j « d « « | j d k( rd
|
nd }|j | j t j ||z | j « d« « ||dd nd}|j | j « }| j d k( rdnd } t j || z t |« « }
|
|
|
|z }|j | j |d« « |t j « }nt# |t « s t% d« g d¢} t' | « D ci c] \ } } | dz | }} } |j) d« ||j* z |j) d« z }dt |d« z }|j | j |d« « | j | j |j- « d« « yc c} } w ) zWrite the file headerz <stata_dta>r Úreleaser@ ÚMSFÚLSFr* r r r% ÚKr; r ÚNNr¾ rÐ r r
|
r¿ rÀ rB rÍ rÎ ó Ú timestampÚheader)r! r] r5 r r% r. r Ú _dta_versionrÅ r& r r r r r r rÐ rå rf r rÑ rR r) )r r r r* r+ Ú nvar_typeÚ nobs_sizer
|
Ú encoded_labelÚ
|
label_sizeÚ label_lenrÒ r rR rÓ rÔ Ústata_tss rW r z StataWriter117._write_header sG ð OO Ø ×Ñ% ¨wÓ7Ô8Üià $))E¤# d×&7Ñ&7Ó"8¸'Ó BÀIÓNÔOà $))I¨Ñ ,Ò 6°Ò ?¸%ÀÓMÔNà ×,Ñ,°Ò3C¸ Ø $))FKK¨ °IÑ(=¸t¿y¹yÓ IÈ3ÓOÔPà ×,Ñ,°Ò3C¸ Ø $))FKK¨ °IÑ(=¸t¿y¹yÓ IÈ3ÓOÔPà#-Ð#9
|
3B¸rØ T§^¡^Ó4 Ø × -Ñ -°Ò 4S¸#
|
ÜKK ¨JÑ 6¼¸MÓ8JÓK Ø! MÑ1 Ø $))M¨7Ó3Ô4ð Ð Ü! JÜJ¬Ô1Ü Ð AÓBÐ Bò
|
ô 6?¸vÓ5F×G©¨¨EAu ÐG ÑGà × Ñ Ó &Ø:×+Ñ+Ñ,ñ -à×!Ñ! +Ó.ñ /ð ð U 2 wÓ /Ñ/Ø $))H kÓ2Ô3Ø ×Ñ$)) C§L¡L£N°HÓ=Õ>ùó Hs È J/c ó | j s8d| j j j « ddddddddddddd| _ | j j j | j d « t « }| j j « D ]4 }|j t j | j dz |« « 6 | j | j |j « d« « y)zÇ
|
Called twice during file write. The first populates the values in
|
the map with 0s. The second call writes the final map locations when
|
all blocks have been written.
|
r )Ú
|
stata_dataÚmapÚvariable_typesÚvarnamesÚsortlistÚformatsÚvalue_label_namesr Úcharacteristicsrð Ústrlsr Ústata_data_closeú end-of-filerC r N)r* r r r r` r ri r% rÅ r& r! r] r. r) )r r+ r s rW r zStataWriter117._write_mapM sÖ ð yyà Ø||×*Ñ*×/Ñ/Ó1Ø"#Ø Ø Ø Ø%&Ø#$Ø#$ØØØ !Ø$%Ø ñ DIð" ×Ñ× Ñ §¡¨5Ñ!1Ô2ÜiØ99×#Ñ#Ó%ò ?CØ IIfkk $§/¡/°CÑ"7¸Ó=Õ >ð ?à ×Ñ$)) C§L¡L£N°EÓ:Õ;r c ó | j d« t « }| j D ]4 }|j t j
|
| j dz |« « 6 | j | j |j « d« « y )NrD r )
|
r0 r rp r% rÅ r& r! r] r. r) )r r+ rs s rW r z$StataWriter117._write_variable_typesk sk Ø ×ÑÐ)Ô*ÜiØ<<ò ?CØ IIfkk $§/¡/°CÑ"7¸Ó=Õ >ð ?à ×Ñ$)) C§L¡L£NÐ4DÓEÕFr c óz | j d« t « }| j dk( rdnd}| j D ]O }| j |« }t |d d j | j « |dz « }|j |« Q | j | j |j « d« « y )NrE r; r! r# rB ) r0 r r: r: r× r r r r% r] r. r) )r r+ Úvn_lenrï s rW r z StataWriter117._write_varnamesr s Ø ×ÑÔ$Üià×(Ñ(¨CÒ/°SØLLò DØ×+Ñ+¨DÓ1DÜ! $ s¨ )×"2Ñ"2°4·>±>Ó"BÀFÈQÁJÓODØ IIdOð ð ×Ñ$)) C§L¡L£N°JÓ?Õ@r c ó´ | j d« | j dk rdnd}| j | j d|z | j dz z d« « y )NrF r< r
r r rB )r0 r: r] r. r )r Ú sort_sizes rW r z StataWriter117._write_sortlist} sO Ø ×ÑÔ$Ø ×*Ñ*¨SÒ0A°a Ø ×Ñ$)) G¨iÑ$7¸4¿9¹9Àq¹=Ñ$IÈ:ÓVÕWr c óH | j d« t « }| j dk( rdnd}| j D ]6 }|j t |j | j « |« « 8 | j | j |j « d« « y )NrG r; r~ r| ) r0 r r: rÿ r% r r r r] r. r) )r r+ Úfmt_lenr s rW r z StataWriter117._write_formats s Ø ×ÑÔ#ÜiØ ×)Ñ)¨SÒ0"°bØ<<ò KCØ IIn S§Z¡Z°·±Ó%?ÀÓIÕ Jð Kà ×Ñ$)) C§L¡L£N°IÓ>Õ?r c óÌ | j d« t « }| j dk( rdnd}t | j « D ]o }d}| j
|
| r| j | }| j |« }t |d d j | j « |dz « }|j |« q | j | j |j « d« « y )NrH r; r! r# rÐ rB )r0 r r: r( r rR r: r× r r r r% r] r. r) )r r+ Úvl_lenr rï Ú encoded_names rW r z'StataWriter117._write_value_label_names sÈ Ø ×ÑÐ,Ô-Üià×(Ñ(¨CÒ/°SÜtyyÓ!ò $AàDØ×%Ñ% aÒ(Ø|| AØ×+Ñ+¨DÓ1DÜ)¨$¨s°¨)×*:Ñ*:¸4¿>¹>Ó*JÈFÐUVÉJÓWLØ IIlÕ #ð $ð ×Ñ$)) C§L¡L£NÐ4GÓHÕIr c ó$ | j d« t « }| j dk( rdnd}t d|dz « }| j [t | j « D ] }|j |« | j | j |j « d« « y | j D ] }|| j v rc| j | }t |« dkD r t d« |j | j « }|j t ||dz « « t|j |« | j | j |j « d« « y # t $ r }t d| j « |d }~ww xY w) Nr r; r¾ i@ rÐ rB rÝ zDVariable labels must contain only characters that can be encoded in )r0 r r: r ri r( r r% r] r. r) rð r rf r r ÚUnicodeEncodeError) r r+ rU rá rr rõ r
|
r rt s rW r z%StataWriter117._write_variable_labels sm à ×ÑÐ*Ô+Üià×(Ñ(¨CÒ/°SÜ r 6¨A¡:Ó.à × Ñ Ð (Ü499Ó%ò !Ø %Õ ð !à × Ñ dii¨¯ © «Ð8IÓ JÔ KØ à99ò !CØd×+Ñ+Ñ+Ø ×-Ñ-¨cÑ2Üu: ?Ü$Ð%UÓVÐVð Ø #ll¨4¯>©>Ó :Gð .¨°&¸1±*Ó=Õ>à %Õ ð !ð ×Ñ$)) C§L¡L£NÐ4EÓFÕGøô *ò Ü$ð-Ø-1¯^©^Ð,<ð>óð ð ûð ús Ã+E(Å( FÅ1F
|
Æ
|
Fc óh | j d« | j | j dd« « y )NrI r )r0 r] r. rV s rW r¡ z%StataWriter117._write_characteristics¹ s+ Ø ×ÑÐ*Ô+Ø ×Ñ$)) CÐ):Ó;Õ<r c ó¨ | j d« | j d« | j |j « « | j d« y )Nrð s <data>s </data>)r0 r] rð rñ s rW r£ zStataWriter117._write_data½ sA Ø ×ÑÔ Ø ×Ñ)Ô$Ø ×Ñ'//Ó+Ô,Ø ×Ñ*Õ%r c ó| | j d« | j | j | j d« « y )NrJ )r0 r] r. r+ rV s rW r¤ zStataWriter117._write_strlsà s- Ø ×ÑÔ!Ø ×Ñ$)) D§O¡O°WÓ=Õ>r c ó y)zNo-op in dta 117+Nr: rV s rW r z&StataWriter117._write_expansion_fieldsÇ rn r c ó6 | j d« t « }| j D ]@ }|j | j « }| j |d« }|j |« B | j | j |j « d« « y )Nr Úlbl) r0 r rQ r0 r! r. r% r] r) )r r+ r Úlabs rW r¥ z"StataWriter117._write_value_labelsÊ s| Ø ×Ñ Ô(ÜiØ×$Ñ$ò BØ×)Ñ)¨$¯/©/Ó:CØ))C Ó'CØ IIcNð ð ×Ñ$)) C§L¡L£N°NÓCÕDr c ó~ | j d« | j t dd« « | j d« y )NrK z </stata_dta>r rL )r0 r] r5 rV s rW r¦ z$StataWriter117._write_file_close_tagÓ s4 Ø ×ÑÐ+Ô,Ø ×Ñ% °Ó8Ô9Ø ×Ñ Õ'r c óº | j j « D ]> \ }}|| j v s| j j |« }|| j |< @ y)z
|
Update column names for conversion to strl if they might have been
|
changed to comply with Stata naming rules
|
N)rT rA r rK )r ÚorigÚnewrß s rW rm z!StataWriter117._update_strl_namesØ sZ ð ×.Ñ.×4Ñ4Ó6ò .ID#Øt×)Ñ)Ò)Ø×(Ñ(×.Ñ.¨tÓ4Ø*-×"Ñ" 3Ò'ñ .r c ó t |« D cg c]' \ }}| j | dk( s|| j v r|) }}}|rCt ||| j ¬« }|j « \ }}|}|j |« | _ |S c c}}w )zg
|
Convert columns to StrLs if either very large or in the
|
convert_strl variable
|
ry r= )r rp r r r: r r& r+ )r rð r rõ Ú convert_colsÚsswÚtabÚnew_datas rW rä z StataWriter117._convert_strlsã s ô $ D/÷
|
á3Ø||A %Ò'¨3°$×2DÑ2DÑ+Dò ð
|
ñ
|
ñ Ü! $¨ ¸d×>OÑ>OÔPCØ × .Ñ .Ó 0MCØDØ !× /Ñ /°Ó 4DOØ ùó
|
s ,Bc óT g | _ g | _ |j « D ] \ }}|| j v }t || j
|
| | j |¬« }| j j |« | j j t || j
|
| |« « y )N)rE rF ) rp rÿ rA r rH rð r: r rÿ )r r¡ rõ rv rF r s rW r z%StataWriter117._set_formats_and_typesõ s Ø Ø Ø ,,.ò JCØ × 2Ñ 2Ð2JÜ-ØØ #Ø × -Ñ -Ø%ô Cð LL× Ñ Ô $Ø LL× Ñ Ü(¨°· ± ¸#±À
|
ÓKõ ñ r ) NTNNNNNr N)rJ rô rð r$ rñ rõ rX rà r* r r rö r r r rõ r úSequence[Hashable] | Nonerù r. r7 r r r÷ r r3 )r ú str | bytesr- r r r5 )r- r r r3 rú rû r4 r! rù ) r6 r7 r8 r9 r r: r rý r. r0 r r r r r r r r r¡ r£ r¤ r r¥ r¦ rm rä r r& r' s @rW r( r( sc ø ñSðj ÐØLð 59Ø Ø $Ø&*Ø!%Ø6:Ø26Ø*1Ø15ð# ð AEñ # à,ð# ð ð# ð 2ð # ð
|
ð # ð ð # ð $ð# ð ð# ð 4ð# ð 0ð# ð (ð# ð /ð# ð >ð # ð
|
õ # ðJ òXó ðXó 4ð "&Ø&*ð8?à ð8?ð $ð8?ð
|
ó 8?ót <ó<Gó AóXó
|
@ó Jó Hó@=ó&ó ?ó óEó(ó
|
.ó÷$r r( c ó e Zd ZU dZdZded< d dd d
|
fdZd dZ xZS ) ÚStataWriterUTF8uð
|
Stata binary dta file writing in Stata 15 (118) and 16 (119) formats
|
|
DTA 118 and 119 format files support unicode string data (both fixed
|
and strL) format. Unicode is also supported in value labels, variable
|
labels and the dataset label. Format 119 is automatically used if the
|
file contains more than 32,767 variables.
|
|
Parameters
|
----------
|
fname : path (string), buffer or path object
|
string, path object (pathlib.Path or py._path.local.LocalPath) or
|
object implementing a binary write() functions. If using a buffer
|
then the buffer will not be automatically closed after the file
|
is written.
|
data : DataFrame
|
Input to save
|
convert_dates : dict, default None
|
Dictionary mapping columns containing datetime types to stata internal
|
format to use when writing the dates. Options are 'tc', 'td', 'tm',
|
'tw', 'th', 'tq', 'ty'. Column can be either an integer or a name.
|
Datetime columns that do not have a conversion type specified will be
|
converted to 'tc'. Raises NotImplementedError if a datetime column has
|
timezone information
|
write_index : bool, default True
|
Write the index to Stata dataset.
|
byteorder : str, default None
|
Can be ">", "<", "little", or "big". default is `sys.byteorder`
|
time_stamp : datetime, default None
|
A datetime to use as file creation date. Default is the current time
|
data_label : str, default None
|
A label for the data set. Must be 80 characters or smaller.
|
variable_labels : dict, default None
|
Dictionary containing columns as keys and variable labels as values.
|
Each label must be 80 characters or smaller.
|
convert_strl : list, default None
|
List of columns names to convert to Stata StrL format. Columns with
|
more than 2045 characters are automatically written as StrL.
|
Smaller columns can be converted by including the column name. Using
|
StrLs can reduce output file size when strings are longer than 8
|
characters, and either frequently repeated or sparse.
|
version : int, default None
|
The dta version to use. By default, uses the size of data to determine
|
the version. 118 is used if data.shape[1] <= 32767, and 119 is used
|
for storing larger DataFrames.
|
{compression_options}
|
|
.. versionchanged:: 1.4.0 Zstandard support.
|
|
value_labels : dict of dicts
|
Dictionary containing columns as keys and dictionaries of column value
|
to labels as values. The combined length of all labels for a single
|
variable must be 32,000 characters or smaller.
|
|
.. versionadded:: 1.4.0
|
|
Returns
|
-------
|
StataWriterUTF8
|
The instance has a write_file method, which will write the file to the
|
given `fname`.
|
|
Raises
|
------
|
NotImplementedError
|
* If datetimes contain timezone information
|
ValueError
|
* Columns listed in convert_dates are neither datetime64[ns]
|
or datetime
|
* Column dtype is not representable in Stata
|
* Column listed in convert_dates is not in DataFrame
|
* Categorical label contains more than 32,000 characters
|
|
Examples
|
--------
|
Using Unicode data and column names
|
|
>>> from pandas.io.stata import StataWriterUTF8
|
>>> data = pd.DataFrame([[1.0, 1, 'á´¬']], columns=['a', 'β', 'Ä'])
|
>>> writer = StataWriterUTF8('./data_file.dta', data)
|
>>> writer.write_file()
|
|
Directly write a zip file
|
>>> compression = {"method": "zip", "archive_name": "data_file.dta"}
|
>>> writer = StataWriterUTF8('./data_file.zip', data, compression=compression)
|
>>> writer.write_file()
|
|
Or with long strings stored in strl format
|
|
>>> data = pd.DataFrame([['á´ relatively long Åtring'], [''], ['']],
|
... columns=['strls'])
|
>>> writer = StataWriterUTF8('./data_file_with_long_strings.dta', data,
|
... convert_strl=['strls'])
|
>>> writer.write_file()
|
r zLiteral['utf-8']r NrM c óÞ |
|
|j d dk rdnd}
|
n1|
|
dvr t d« |
|
dk( r |j d dkD r t d« t | ||||||||| | | | ¬« |
|
| _ y ) NrB iÿ r r< )r r< z"version must be either 118 or 119.zKYou must use version 119 for data sets containing more than32,767 variables)
|
rñ rX r* r r r r r rù r7 )ré rf r× r r: )r rJ rð rñ rX r* r r r r r> rù r7 r rú s rW r zStataWriterUTF8.__init__i s ø ð" ?Ø !ZZ¨]¨eÒ 3c¸GØ JÑ &Ü Ð AÓBÐ BØ ^ §
|
¡
|
¨1¡ °Ò 5Ü ð#óð ô
|
ÑØ Ø Ø'Ø#Ø Ø!Ø!Ø +Ø%Ø%Ø#Ø +ð ô
|
ð $Õr c óÐ |D ]` }t |« dk r#|dk s|dkD r|dk s|dkD r|dk s|dkD r|dk7 sdt |« cxk rd k sn |d
|
v sO|j |d« }b |S ) aÕ
|
Validate variable names for Stata export.
|
|
Parameters
|
----------
|
name : str
|
Variable name
|
|
Returns
|
-------
|
str
|
The validated name with invalid characters replaced with
|
underscores.
|
|
Notes
|
-----
|
Stata 118+ support most unicode characters. The only limitation is in
|
the ascii range where the characters supported are a-z, A-Z, 0-9 and _.
|
r# rp rq rr rs r² rt rr éÀ > õ Ãõ ÷)rà ru rv s rW rw z'StataWriterUTF8._validate_variable_name s~ ð* ò ,Aô FSLØS A¨¢GØS A¨¢GØS A¨¢GØSà#a&Ô& 3Ô&Ø Ò$à|| A sÓ+ð ,ð r )
|
NTNNNNNNr N) rJ rô rð r$ rñ rõ rX rà r* r r rö r r r rõ r rj r> r rù r. r7 r r r÷ r r3 rø ) r6 r7 r8 r9 r rh r rw r& r' s @rW rm rm sØ ø
ñ^ð@ #*IÐ Ó)ð 59Ø Ø $Ø&*Ø!%Ø6:Ø26Ø "Ø*1Ø15ð*$ð AEñ *$à,ð*$ð ð*$ð 2ð *$ð
|
ð *$ð ð *$ð $ð*$ð ð*$ð 4ð*$ð 0ð*$ð ð*$ð (ð*$ð /ð*$ð >ð *$ð
|
õ!*$÷X#r rm )r r' r r r r' r! )r6 r rñ rà rò rà ró r rô rà rõ rà rö r r÷ rà rø r r( rà rù r. r7 r r zDataFrame | StataReader)r0 r r r )rï r
|
r· r` r r
|
)r r r rg )rñ rÆ r: zlist[Hashable]r rÆ )rv rg r r' r r` )r F)r r' rE r` rF rà r r )rv rg r r' rF rà r r` )rï rk r· r` r r5 )vr9 Ú
|
__future__r Ú collectionsr r r Úior r© rÅ rî Útypingr r r
|
r r r r Únumpyr Ú pandas._libsr Úpandas._libs.libr Úpandas._libs.writersr Ú pandas.errorsr r r r Úpandas.util._decoratorsr r Úpandas.util._exceptionsr Úpandas.core.dtypes.baser Úpandas.core.dtypes.commonr r r Úpandas.core.dtypes.dtypesr Úpandasr r r r r! r" r# Úpandas.core.framer$ Úpandas.core.indexes.baser% Úpandas.core.indexes.ranger& Úpandas.core.seriesr' Úpandas.core.shared_docsr( Úpandas.io.commonr) Úcollections.abcr* r+ Útypesr, r- Úpandas._typingr. r/ r0 r1 r2 r3 rK Ú _statafile_processing_params1Ú _statafile_processing_params2Ú_chunksize_paramsÚ_iterator_paramsÚ _reader_notesÚ_read_stata_docr% r$ rÑ rC rh r rÉ rÊ rË rÌ rÍ rÎ rü rþ r< rí rp ÚIteratorrÔ r+ rí r' r6 r< rB rH rL rÿ r r r( rm r: r rW ú<module>r s ðò
|
õ #å ÷õ Û Û Û
|
÷÷ ó ã å Ý (Ý 5÷ó ÷ õ 5å 2÷ñ õ
|
7÷÷ ñ õ (Ý *Ý 0Ý %Ý 0å 'á÷õ $Ý ÷÷ ð4ð ð!NÐ ð !GÐ ð$ Ð ð
|
"Ð ð( ðð Ð ð Ø Ð ð ØÐ ð ØÐ ð Ø Ð%Ñ&Ð)=Ñ=Ð >ð ?Ø Ð Ñ Ð !ð "ð ð ð?8ðtð Ð ð Ø Ð ð ð Ð ð ð Ð ð Ø Ð ð ØÐ ð Ø Ð%Ñ&Ð 'ð (Ø Ð Ñ Ð !ð "àð ð Ð ò$ O ñ d A qÓ) UÓ )ó]ó@h7ðV(Ð uó ð Ð Eó ð #Ð %ó ð Ð %ó ð)Ð ó ó}÷@v ñ v ôr %Oô %÷>Cñ C÷L\
|
ñ \
|
ô~|&+s||ô |&ñ~
|
/Óð Ø!%Ø Ø !Ø Ø$(Ø #Ø ØØ&-Ø-1ñ! Ø4ð! ð ð! ð ð ! ð
|
ð ! ð ð ! ð ð! ð "ð! ð ð! ð ð! ð ð! ð $ð! ð +ð! ð ò ! ó ð! óHDó0óCó2 ó !GðJ GLð*GØð*GØ(+ð*GØ?Cð*Gàó*GñZ Ø Ð!2Ñ3Ø$Ð%:Ñ;¸gÑEôôL B+ó L Bó ðL Bó^'GóT1÷r ñ r ôjz[ô zôz rnõ rr
|
