jghdZddlZddlmZddlmZddlmZmZddl m Z GddZ d d Z dS) z SQL LexerN)Lock) TextIOBase)tokenskeywords)consumecfeZdZdZdZeZedZdZ dZ dZ dZ dZ d d ZdS) LexerzrThe Lexer supports configurable syntax. To add support for additional keywords, use the `add_keywords` method.Nc|j5|j(||_|jdddn #1swxYwY|jS)zRReturns the lexer instance used internally by the sqlparse core functions.N)_lock_default_instancedefault_initialization)clss ]/var/www/finuniver-perm.ru/html/portfolio/venv/lib/python3.11/site-packages/sqlparse/lexer.pyget_default_instancezLexer.get_default_instance0sY ? ?$,(+%%<<>>> ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?$$s0AA Ac||tj|tj|tj|tj|tj|tj |tj |tj |tj |tj dS)zlInitialize the lexer with default dictionaries. Useful if you need to revert custom syntax settings.N)clear set_SQL_REGEXr SQL_REGEX add_keywordsKEYWORDS_COMMONKEYWORDS_ORACLEKEYWORDS_MYSQLKEYWORDS_PLPGSQL KEYWORDS_HQLKEYWORDS_MSACCESSKEYWORDS_SNOWFLAKEKEYWORDS_BIGQUERYKEYWORDSselfs rr zLexer.default_initialization:s  8-... (2333 (2333 (1222 (3444 (/000 (4555 (5666 (4555 (+,,,,,c"g|_g|_dS)zClear all syntax configurations. Useful if you want to load a reduced set of syntax configurations. After this call, regexps and keyword dictionaries need to be loaded to make the lexer functional again.N) _SQL_REGEX _keywordsrs rrz Lexer.clearIs r!c`tjtjzfd|D|_dS)z.Set the list of regex that will parse the SQL.cNg|]!\}}tj|j|f"S)recompilematch).0rxttFLAGSs r z'Lexer.set_SQL_REGEX..TsA   BZE " " (" -   r!N)r( IGNORECASEUNICODEr#)r rr.s @rrzLexer.set_SQL_REGEXQs?  *    #   r!c:|j|dS)zhAdd keyword dictionaries. Keywords are looked up in the same order that dictionaries were added.N)r$append)r rs rrzLexer.add_keywordsYs  h'''''r!cz|}|jD]}||vr |||fcStj|fS)zChecks for a keyword. If the given value is in one of the KEYWORDS_* dictionary it's considered a keyword. Otherwise, tokens.Name is returned. )upperr$rName)r valuevalkwdicts r is_keywordzLexer.is_keyword^sT kkmmn & &Ff}}c{E))));% %r!c#dKt|tr|}t|trnt|trT|r||}nk |d}nT#t $r|d}Yn3wxYwtdt|t|}|D]\}}|j D]\}}|||}|st|tj r||fVn7|tjur)||Vt%|||z dz ntj|fVdS)a Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. Split ``text`` into (tokentype, text) pairs. ``stack`` is the initial stack (default: ``['root']``) zutf-8zunicode-escapez+Expected text or file-like object, got {!r}N) isinstancerreadstrbytesdecodeUnicodeDecodeError TypeErrorformattype enumerater#r _TokenTypegrouprPROCESS_AS_KEYWORDr:rendError) r textencodingiterableposcharrexmatchactionms r get_tokenszLexer.get_tokensks dJ ' ' 99;;D dC 0  e $ $ 0 9{{8,,9;;w//DD)999;;'788DDD9I"F4::..00 0T??! ) )IC$(O ) ) &HT3''5(9::5 !''))+++++x::://!''))44444!%%''C-!"3444lD(((( ) )s0BB('B(N)__name__ __module__ __qualname____doc__r rr classmethodrr rrrr:rTr'r!rr r sNN DFFE(%%[% - - -   ((( & & &-)-)-)-)-)-)r!r c\t||S)zTokenize sql. Tokenize *sql* using the :class:`Lexer` and return a 2-tuple stream of ``(token type, value)`` items. )r rrT)sqlrMs rtokenizer]s&  % % ' ' 2 23 A AAr!rU) rYr( threadingriorsqlparserrsqlparse.utilsrr r]r'r!rrbs %%%%%%%%""""""A)A)A)A)A)A)A)A)HBBBBBBr!