Ë
|
WñúhE ã ó d Z ddlZddlZddlZddlZddlZddlmZ ddlm Z m
|
Z
|
m Z m Z m Z mZmZmZ ddlZddlZddlmZ ddlmZ ddlmZ ddlm Z d Z d
|
Z d d d dddZ d Z dee! de!fdZ"edede e#e$e%e%f fd« Z& d1dede%de ddfdZ'de%fdZ(d2de
|
e%ge)f d e*de%fd Z+d e dee%e e f fd Z,dedejZ fd Z.ded!e%d"e%dejZ fd#Z/ded!e%d"e%de)fd$Z0ded!e%d"e%ddfd%Z1 d1ded!e%d"e%d&ejZ d'e e%e%f ddf d(Z2ded!e%d&ejZ dee%e%f fd)Z3d*e%de%fd+Z4dede%fd,Z5ded!e%d"e%de)fd-Z6 d3d.eeejZ ejn ejp f d/e%deejZ fd0Z9y)4a. General utilities for AI features in MySQL Connector/Python.
|
|
Includes helpers for:
|
- defensive dict copying
|
- temporary table lifecycle management
|
- SQL execution and result conversions
|
- DataFrame to/from SQL table utilities
|
- schema/table/column name validation
|
- array-like to DataFrame conversion
|
é N)Úcontextmanager)ÚAnyÚCallableÚDictÚIteratorÚListÚOptionalÚTupleÚUnion)Úatomic_transaction)ÚMySQLConnectionAbstract)ÚMySQLCursorAbstract)ÚParamsSequenceOrDictTypeÚmysql_aié ÚBIGINTÚDOUBLEÚLONGTEXTÚBOOLEANÚDATETIME)Úint64Úfloat64ÚobjectÚboolzdatetime64[ns]ÚoptionsÚreturnc ó4 | i S t j | « S )z
|
Make a defensive copy of a dictionary, or return an empty dict if None.
|
|
Args:
|
options: param dict or None
|
|
Returns:
|
dict
|
)ÚcopyÚdeepcopy)r s úGH:\Change_password\venv_build\Lib\site-packages\mysql/ai/utils/utils.pyÚ copy_dictr! I s ð Ø ä ==Ó !Ð!ó Ú db_connectionc # ó K g } | t | « 5 }|D ] \ }}t |||« ddd« y# 1 sw Y yxY w# t | « 5 }|D ] \ }}t |||« ddd« w # 1 sw Y w xY wxY ww)a
|
Context manager to track and automatically clean up temporary SQL tables.
|
|
Args:
|
db_connection: Database connection object used to create and delete tables.
|
|
Returns:
|
None
|
|
Raises:
|
DatabaseError:
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
|
Yields:
|
temporary_tables: List of (schema_name, table_name) tuples created during the
|
context. All tables in this list are deleted on context exit.
|
N)r Údelete_sql_table)r# Útemporary_tablesÚcursorÚ schema_nameÚ
|
table_names r Útemporary_sql_tablesr* Y s£ è ø ð, /1ÐðBØ Ò ä Ó .ð B°&Ø+;ò BÑ' ZÜ ¨°jÕAñ B÷ B÷ Bñ BûÔ Ó .ð B°&Ø+;ò BÑ' ZÜ ¨°jÕAñ B÷ B÷ Bñ BÿsF B A B 7® B ·A ¼B Á A=ÁA1Á( A=Á1A: Á6A=Á=B r' ÚqueryÚparamsc ó0 | j ||xs d« y)aB
|
Execute an SQL query with optional parameters using the given cursor.
|
|
Args:
|
cursor: MySQLCursorAbstract object to execute the query.
|
query: SQL query string to execute.
|
params: Optional sequence or dict providing parameters for the query.
|
|
Raises:
|
DatabaseError:
|
If the provided SQL query/params are invalid
|
If the query is valid but the sql raises as an exception
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
|
Returns:
|
None
|
© N)Úexecute)r' r+ r, s r Ú execute_sqlr0 x s ð* NN5&, BÕ'r" c óv t j } dj t j | t
|
¬« « S )z
|
Generate a random uppercase string of fixed length for table names.
|
|
Returns:
|
Random string of length RANDOM_TABLE_NAME_LENGTH.
|
Ú )Úk)ÚstringÚascii_uppercaseÚjoinÚrandomÚchoicesÚRANDOM_TABLE_NAME_LENGTH)Úchar_sets r Ú _get_namer; s* ô ×%Ñ%HØ 776>> (Ô.FÔGÓ HÐHr" Ú conditionÚ max_callsc ód t |« D ] } | t « x}« s|c S t d« )a¨
|
Generate a random string name that satisfies a given condition.
|
|
Args:
|
condition: Callable that takes a generated name and returns True if it is valid.
|
max_calls: Maximum number of attempts before giving up (default 100).
|
|
Returns:
|
A random string that fulfills the provided condition.
|
|
Raises:
|
RuntimeError: If the maximum number of attempts is reached without success.
|
z<Reached max tries without successfully finding a unique name)Úranger; Ú RuntimeError)r< r= Ú_Únames r Úget_random_namerC s: ô 9Ó ò Ù Y[Ð(TÕ )ØKðô ÐUÓ
|
VÐVr" Úvaluec ó t | t t f« r+t | « dk( rddgfS dt j
|
| « gfS d| gfS )a.
|
Convert a Python value into its SQL-compatible string representation and parameters.
|
|
Args:
|
value: The value to format.
|
|
Returns:
|
Tuple containing:
|
- A string for substitution into a SQL query.
|
- A list of parameters to be bound into the query.
|
r z%sNzCAST(%s as JSON))Ú
|
isinstanceÚdictÚlistÚlenÚjsonÚdumps)rD s r Úformat_value_sqlrL ³ sL ô %$¤ Ô&Ü u:?Ø$<Ð Ø!¤D§J¡J¨uÓ$5Ð#6Ð6Ð6Ø %=Ðr" c ó° dt t dt t fd}dt dt fd}i }t | j
|
« D ] \ }}|d dk( r|||< |||< | j « }g }|D ]? }t |« } t |« D ] \ }}
|
|| |
|
« | |< |j | « A t j || j ¬« S )a³
|
Convert the results of a cursor's last executed query to a pandas DataFrame.
|
|
Args:
|
cursor: MySQLCursorAbstract with a completed query.
|
|
Returns:
|
DataFrame with data from the cursor.
|
|
Raises:
|
DatabaseError:
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
If a compatible SELECT query wasn't the last statement ran
|
Úelemr c ó4 | t j | « S d S ©N)rJ Úloads©rN s r Ú_json_processorz+sql_response_to_df.<locals>._json_processor× s Ø#'Ð#3tzz$Ó Ð=¸Ð=r" c ó | S rP r. rR s r Ú_default_processorz.sql_response_to_df.<locals>._default_processorÚ s Ø r" é éõ )Úcolumns) r ÚstrrG r Ú enumerateÚ descriptionÚfetchallrH ÚappendÚpdÚ DataFrameÚ column_names) r' rS rU Úidx_to_processorÚidxÚcolÚrowsÚprocessed_rowsÚrowÚ processed_rowrN s r Úsql_response_to_dfrh Æ sû ð">h¤smð >´¼±ó >ð¤ð ¬ó ð ÐÜ f× 0Ñ 0Ó1ò 7SØ q6S=à$3Ð SÒ !à$6Ð SÒ !ð 7ð ??Ó Dð NØò -Ü S ä" 3 ò =ICØ!6Ð!1°#Ñ!6°tÓ!<M#Ò ð =ð × Ñ mÕ,ð -ô <<°×0CÑ0CÔ DÐDr" r( r) c óh t |« t |« t | d| d| « t | « S )aD
|
Load the entire contents of a SQL table into a pandas DataFrame.
|
|
Args:
|
cursor: MySQLCursorAbstract to execute the query.
|
schema_name: Name of the schema containing the table.
|
table_name: Name of the table to fetch.
|
|
Returns:
|
DataFrame containing all rows from the specified table.
|
|
Raises:
|
DatabaseError:
|
If the table does not exist
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
ValueError: If the schema or table name is not valid
|
zSELECT * FROM ú.)Ú validate_namer0 rh ©r' r( r) s r Úsql_table_to_dfrm ô s6 ô* +Ô Ü*Ô ä.¨¨ °Q°z°lÐCÔDÜ fÓ %Ð%r" c óz t |« t |« | j d||f« | j « duS )aó
|
Check whether a table exists in a specific schema.
|
|
Args:
|
cursor: MySQLCursorAbstract object to execute the query.
|
schema_name: Name of the database schema.
|
table_name: Name of the table.
|
|
Returns:
|
True if the table exists, False otherwise.
|
|
Raises:
|
DatabaseError:
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
ValueError: If the schema or table name is not valid
|
z
|
SELECT 1
|
FROM information_schema.tables
|
WHERE table_schema = %s AND table_name = %s
|
LIMIT 1
|
N©rk r/ Úfetchonerl s r Ú table_existsrq sC ô( +Ô Ü*Ô à
|
NNð ð
|
jÐ!ôð ??Ó DÐ (Ð(r" c óT t |« t |« t | d| d| « y)aÌ
|
Drop a table from the SQL database if it exists.
|
|
Args:
|
cursor: MySQLCursorAbstract to execute the drop command.
|
schema_name: Name of the schema.
|
table_name: Name of the table to delete.
|
|
Returns:
|
None
|
|
Raises:
|
DatabaseError:
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
ValueError: If the schema or table name is not valid
|
zDROP TABLE IF EXISTS rj N)rk r0 rl s r r% r% 6 s, ô( +Ô Ü*Ô äÐ/° ¨}¸A¸j¸\ÐJÕKr" ÚdfÚ col_name_to_placeholder_stringc ó |i }t |« t |« |j D ] }t t |« « | d| }|j D ]å }g g } }t ||j « D ]i \ }
|
}t |
|
d« r|
|
j « n|
|
}
|
||v r|| t |
|
« g} } nt |
|
« \ } } |j | « | j | « k dj |j D cg c] }t |« c}« } dj |« }d| d| d| d}t | || ¬ « ç yc c}w )
|
aõ
|
Insert all rows from a pandas DataFrame into an existing SQL table.
|
|
Args:
|
cursor: MySQLCursorAbstract for execution.
|
schema_name: Name of the database schema.
|
table_name: Table to insert new rows into.
|
df: DataFrame containing the rows to insert.
|
col_name_to_placeholder_string:
|
Optional mapping of column names to custom SQL value/placeholder
|
strings.
|
|
Returns:
|
None
|
|
Raises:
|
DatabaseError:
|
If the rows could not be inserted into the table, e.g., a type or shape issue
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
ValueError: If the schema or table name is not valid
|
Nrj Úitemú, z INSERT INTO ú (z
|
) VALUES (ú))r, ) rk rX rY ÚvaluesÚzipÚhasattrrv rL r] Úextendr6 r0 )r' r( r) rs rt rc Úqualified_table_namerf Ú placeholdersr, rN Úelem_placeholderÚ elem_paramsÚcols_sqlÚplaceholders_sqlÚ
|
insert_sqls r Úextend_sql_tabler
P sa ð: &Ð-Ø)+Ð&ä+Ô Ü*Ô Øzzò Üc#hÕ ð ð *]¨!¨J¨<Ð8Ðð yyò 7Ø ! 2f Ü S "§*¡*Ó-ò 'ID#Ü")¨$°Ô"7499;¸TDàÐ4Ñ4Ø0NÈsÑ0SÜIðV +Ñ ô 1AÀÓ0FÑ-Ð +à × Ñ Ð 0Ô 1Ø MM+Õ &ð 'ð 99°"·*±*Ö =¨3c #hÒ =Ó>Ø 99 \Ó2ÐàÐ/Ð0ð 1ØzÐ$4Ð#5°Qð 8ð ô FJ¨vÖ6ñ+7ùò >s Ã5D<
|
c óp t fd« } d| }t « t |« |j D ] }t t |« « g }|j j « D ]N \ }}t j t |« d« }t t |« « |j | d| « P dj |« } t d |j D « « }
|
|
|
r| dz } d| d | d
|
} t | « t ||« ||fS # t $ r t |« w xY w) a
|
Create a new SQL table with a random name, and populate it with data from a DataFrame.
|
|
If an 'id' column is defined in the dataframe, it will be used as the primary key.
|
|
Args:
|
cursor: MySQLCursorAbstract for executing SQL.
|
schema_name: Schema in which to create the table.
|
df: DataFrame containing the data to be inserted.
|
|
Returns:
|
Tuple (qualified_table_name, table_name): The schema-qualified and
|
unqualified table names.
|
|
Raises:
|
RuntimeError: If a random available table name could not be found.
|
ValueError: If any schema, table, or a column name is invalid.
|
DatabaseError:
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
c ó t | « S rP )rq )r) r' r( s r ú<lambda>z#sql_table_from_df.<locals>.<lambda>© s ø |¨F°KÀÓ LÐL r" rj r ú rw c 3 óB K | ] }|j « d k( yw)ÚidN)Úlower)Ú.0rc s r ú <genexpr>z$sql_table_from_df.<locals>.<genexpr>» s è ø Ò?¨SSYY[ DÕ(Ñ?ùs z, PRIMARY KEY (id)z CREATE TABLE rx ry )rC rk rX rY ÚdtypesÚitemsÚPD_TO_SQL_DTYPE_MAPPINGÚgetr] r6 Úanyr0 r
Ú Exceptionr% ) r' r( rs r) r~ rc Ú columns_sqlÚdtypeÚsql_typeÚ columns_strÚ
|
has_id_colÚcreate_table_sqls `` r Úsql_table_from_dfr sJ ù ô0 !ÜLóJð *]¨!¨J¨<Ð8Ðä+Ô Ü*Ô Øzzò Üc#hÕ ð ð KØiiooÓ'ò 0
|
Uä*×.Ñ.¬s°5«z¸:ÓFÜc#hÔ Ø×ÑcU ! H :Ð.Õ/ð 0ð ))KÓ(KäÑ?°B·J±JÔ?Ó?JÙØÐ+Ñ+ ð 'Ð';Ð&<¸B¸{¸mÈ1ÐMÐÜÐ(Ô)ðä ¨j¸"Ô=ð
|
Ð +Ð+øô ò ä ¨jÔ9Ø ðús Ä D Ä D5rB c ón t | t « rt j d| « st d| « | S )a
|
Validate that the string is a legal SQL identifier (letters, digits, underscores).
|
|
Args:
|
name: Name (schema, table, or column) to validate.
|
|
Returns:
|
The validated name.
|
|
Raises:
|
ValueError: If the name does not meet format requirements.
|
z^[A-Za-z0-9_]+$zUnsupported name format )rF rY ÚreÚmatchÚ
|
ValueError)rB s r rk rk Í s4 ô tSÔ !¤b§h¡hÐ/AÀ4Ô&HÜÐ3°D°6Ð:Ó;Ð;à Kr" c ó¦ | j }|+t }t | « 5 }d| }t ||« ddd« t |« |S # 1 sw Y xY w)aµ
|
Retrieve the name of the currently selected schema, or set and ensure the default schema.
|
|
Args:
|
db_connection: MySQL connector database connection object.
|
|
Returns:
|
Name of the schema (database in use).
|
|
Raises:
|
ValueError: If the schema name is not valid
|
DatabaseError:
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
Nz CREATE DATABASE IF NOT EXISTS )ÚdatabaseÚDEFAULT_SCHEMAr r0 rk )r# Úschemar' Úcreate_database_stmts r Ú source_schemar¥ á s_ ð × #Ñ #FØ ~Ü ä Ó .ð 6°&Ø%CÀFÀ8Ð#LÐ Ü Ð 4Ô 5÷ 6ô &Ôà M÷ 6ð 6ús AÁAc ó t |« t |« | j d| d| d« | j « du S )a+
|
Determine if a given SQL table is empty.
|
|
Args:
|
cursor: MySQLCursorAbstract with access to the database.
|
schema_name: Name of the schema containing the table.
|
table_name: Name of the table to check.
|
|
Returns:
|
True if the table has no rows, False otherwise.
|
|
Raises:
|
DatabaseError:
|
If the table does not exist
|
If a database connection issue occurs.
|
If an operational error occurs during execution.
|
ValueError: If the schema or table name is not valid
|
zSELECT 1 FROM rj z LIMIT 1Nro rl s r Úis_table_emptyr§ þ sA ô* +Ô Ü*Ô à
|
NN^ K =°°*° ¸XÐFÔGØ ??Ó Ð $Ð$r" ÚarrÚ
|
col_prefixc ó | yt | t j « rt j | « S t | t j « r| j « S | j
|
dk( r| j dd« } t | j d « D cg c] }| d| }}t j | |d¬« S c c}w )a$
|
Convert input data to a pandas DataFrame if necessary.
|
|
Args:
|
arr: Input data as a pandas DataFrame, NumPy ndarray, pandas Series, or None.
|
|
Returns:
|
If the input is None, returns None.
|
Otherwise, returns a DataFrame backed by the same underlying data whenever
|
possible (except in cases where pandas or NumPy must copy, such as for
|
certain views or non-contiguous arrays).
|
|
Notes:
|
- If an ndarray is passed, column names will be integer indices (0, 1, ...).
|
- If a DataFrame is passed, column names and indices are preserved.
|
- The returned DataFrame is a shallow copy and shares data with the original
|
input when possible; however, copies may still occur for certain input
|
types or memory layouts.
|
NrV éÿÿÿÿrA F)rX r ) rF r^ r_ ÚSeriesÚto_frameÚndimÚreshaper? Úshape)r¨ r© rb Ú col_namess r Ú convert_to_dfr² s¢ ð. {Øä#r||Ô$Ü||CÓ Ð Ü#ryyÔ!Ø||~Ð à
|
xx1}Økk"aÓ Ü27¸¿ ¹ À!¹ Ó2EÖF¨3J<q Ò&ÐFIÐFä << Y°UÔ ;Ð;ùò Gs ÂC rP )éd )Úfeature):Ú__doc__r rJ r7 r r4 Ú
|
contextlibr Útypingr r r r r r r
|
r ÚnumpyÚnpÚpandasr^ Ú mysql.ai.utils.atomic_cursorr Úmysql.connector.abstractsr Úmysql.connector.cursorr Úmysql.connector.typesr ÚVAR_NAME_SPACEr9 r r¢ rG r! rH ÚtuplerY r* r0 r; r ÚintrC rL r_ rh rm rq r% r
r rk r¥ r§ r¬ Úndarrayr² r. r" r ú<module>rà sä ðñ8 ó Û Û Û Û å %ß N× NÓ Nã Û å ;å =Ý 6Ý :àØ Ð ð ØØØ Ø ñ Ð ð ð
|
"x ~ð "¨$ó "ð ðBØ*ðBà d5c?Ñ#Ñ$òBó ðBð> QUñ(Ø ð(Ø(+ð(Ø5Mð(à ó(ð0I3ó IñWx¨¨¨t¨ Ñ 4ð WÀð WÈsó Wð0Cð E¨#¨t°C©y¨.Ñ$9ó ð&+EÐ 2ð +E°r·|±|ó +Eð\&Ø ð&Ø.1ð&Ø?Bð&à\\ó&ð> )Ø ð )Ø.1ð )Ø?Bð )à ó )ðFLØ ðLØ.1ðLØ?BðLà óLð> 6:ñ =7Ø ð=7àð=7ð ð=7ð ð =7ð
|
%)¨¨c¨¡Nð =7ð
|
ó =7ð@:,Ø ð:,Ø.1ð:,Ø79·|±|ð:,à
|
38_ó:,ðzð ó ð(Ð!8ð ¸Só ð:%Ø ð%Ø.1ð%Ø?Bð%à ó%ð< ñ#<Ø % b§i¡i°·±Ð;Ñ<Ñ =ð#<àð#<ð bllÑô#<r"
|
