{hġddlmZddlZddlZddlZddlZddlZddlmZm Z m Z ddl m Z m Z mZmZmZmZmZmZddlmZddlmZmZmZddlmZmZmZe rddlm Z!dd l"m#Z#dd l$m%Z%ejLd Z'ed d Z(eddZ)GddeZ*Gdde#Z+d0dZ,ejZdej\Z/ejZdZ0d1dZ1 d2dZ2 d3dZ3 d4dZ4d5dZ5d6dZ6d7dZ7Gdd ee(Z8d8d!Z9 d9d"Z:d:d#Z;d;d$Z< dd'Z?Gd(d)ed*+Z@ d>d,ZAd?d-ZB d@d.ZC dAd/ZDy)B) annotationsN)AsyncGenerator GeneratorIterable) TYPE_CHECKINGAnyCallableGenericProtocol TypedDictTypeVarUnion)CompletionUsage)ChatCompletionChatCompletionMessageChatCompletionMessageParam)PDFAudioImageUsage)Enum) BaseModel instructorR_coT) covariantT_ModelResponse)boundceZdZUded<y)rOpenAIUsage | AnthropicUsageusageN__name__ __module__ __qualname____annotations__Q/var/www/html/hubwallet-dev/venv/lib/python3.12/site-packages/instructor/utils.pyrr)s ''r)c\eZdZdZdZdZdZdZdZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZdZdZy)Provideropenaivertexai anthropicanyscaletogethergroqmistralcoheregeminigenai databrickscerebrasdeepseek fireworkswriterxaiunknownbedrock perplexity openrouterN)r$r%r&OPENAIVERTEXAI ANTHROPICANYSCALETOGETHERGROQMISTRALCOHEREGEMINIGENAI DATABRICKSCEREBRASDEEPSEEK FIREWORKSWRITERXAIUNKNOWNBEDROCK PERPLEXITY OPENROUTERr(r)r*r,r,-sf FHIHH DG F F EJHHI F CGGJJr)r,cdt|vrtjSdt|vrtjSdt|vrtjSdt|vrtj Sdt|vrtj Sdt|vrtjSdt|vrtjSdt|vrtjSd t|vrtjSd t|vrtjSd t|vrtjSd t|vrtjSd t|vrtjSdt|vrtjSdt|vrtj Sdt|vs dt|vrtj"Sdt|vrtj$Stj&S)Nr0r1r/r8r:r2r-r3r4r5r7r9r.r;r?zx.air<r@)strr,rDrErCrLrNrFrArGrHrIrKrMrBrOrSrPrTrQ)base_urls r* get_providerrXDsS]"   s8} $   H %!!! s8} $   H %!!! 3x= }} S] " c(m # S] " S] " X &""" s8} $   s8} $   S] " X &""" 3x= ES]$:|| X &"""   r)z```(?:json)?\s*(.*?)\s*```z ({[\s\S]*})c:tj|}|r!|jdj}|Stj|}|r|jd}|S|j d}|j d}|dk7r|dk7r |||dz}|S|}|S)a Extract JSON from a string that may contain markdown code blocks or plain JSON. This optimized version uses regex patterns to extract JSON more efficiently. Args: content: The string that may contain JSON Returns: The extracted JSON string {})_JSON_CODEBLOCK_PATTERNsearchgroupstrip _JSON_PATTERNfindrfind)contentmatch json_content first_paren last_parens r*extract_json_from_codeblockrjos $ * *7 3E {{1~++-  $$W-  ;;q>L ",,s+K s+Jb Z2%5&{Z!^D   ' r)c#nKd}d}d}d}d}g}g}g}|D]} | D]} |s+| dk(r&|j| t|dk(rd}d}g}1t|dkDr| dk7rg}|rG|sE| dk(r|dz }|dk(rd}d}^|dkDrd}| dk(r$d}|jd|j| |r| dk(r|s| }n| d k(r|rd}|j| d}|r,|s*| dk(r|dz }|dk(rd}|D]} | g}d}|dkDrd}|sS| dk(r|jdn<| d k(r7|r5|j|s#|j| |D]} | g}d}B|j| O|rS|rW| dk(s^d}|jd|j| |r|r |D]} | y y y w) aJ Extract JSON from a stream of chunks, handling JSON in code blocks. This optimized version extracts JSON from markdown code blocks or plain JSON by implementing a state machine approach. The state machine tracks several states: - Whether we're inside a code block (```json ... ```) - Whether we've started tracking a JSON object - Whether we're inside a string literal - The stack of open braces to properly identify the JSON structure Args: chunks: An iterable of string chunks Yields: Characters within the JSON object Fr`TrZr["\r\Nappendlenpop chunks in_codeblockcodeblock_delimiter_count json_started in_string escape_next brace_stackbuffercodeblock_bufferchunkcharcs r*extract_json_from_streamrs`,L !LIKK FX$W $DDCK ''-'(A-#'L01-')$%&*ts{#% L3;-2-0A5', 451.2. 3;#'L&&s+MM$'3;{$- IT\i"&KMM$'"'K s{1Q6149+0L%+(&'(%'F+0L! 2Q6451!s{#**3/#)*"MM$/%+(&'(%'F+0L! d# # ""3' d#oW $X$v AG |sE*F5.F52F59L)  ! ! -  N#i.#.$& #&y> <ot4#2#6#6v#>L#v-'6':':62'F (L8(%2*9*=*=i*L(O;( <.C N I$**W%7%7%9/%JKK Jr)ctj|}t|dr2|j}|xstj|}t|dr2|S)zGReturns true if the callable is async, accounting for wrapped callables __wrapped__)inspectiscoroutinefunctionrr)func is_coroutines r*is_asyncrsP..t4L $ &#Hw'B'B4'H  $ & r)c`|sgSt|}g}d}t|dtd|D])\}}t|j ddt r'd}n|r|dkDrt d|ddD}|D]}|j dd }|j dd}|st|t rd |d g}|ra||d dk(rV|r|d dxxd |z cc<bt|tr|d dj||d dj||j||d|S)a Merge consecutive messages from the same role into a single message. This optimized version pre-allocates the result list and minimizes operations. Args: messages: List of message dictionaries to merge Returns: List of merged message dictionaries TN rerFc3\K|]$}t|jddt&yw)rerN)rrrV.0ms r* z-merge_consecutive_messages..s"WA*QUU9b%93?Ws*,ruserrrrr] r) rr enumerateminrrrValllistextendrq) messages message_count new_messages flat_string_irrr new_contents r*merge_consecutive_messagesrsi  MML K8$A!%% 2.4K  }r)WRTRUWW H{{66*kk)R0 z+s;$*K@AK DL$4V$<<R +k]/CC+k40 $Y/66{C!$Y/66{C   + F G-H0 r)c eZdZdZddZddZy) classpropertyaDescriptor for class-level properties. Examples: >>> from instructor.utils import classproperty >>> class MyClass: ... @classproperty ... def my_property(cls): ... return cls >>> assert MyClass.my_property c||_yN cproperty)selfmethods r*__init__zclassproperty.__init__?s r)c$|j|Srr)rinstanceclss r*__get__zclassproperty.__get__Bs~~c""r)N)rzCallable[[Any], R_co]returnNone)robjectrz type[Any]rr)r$r%r&__doc__rrr(r)r*rr1s  #r)rcn|sdgS|jdd}t|tr|r|SdgS||gSdgS)a Extract content from a message and ensure it's returned as a list. This optimized version handles different message formats more efficiently. Args: message: A message in ChatCompletionMessageParam format Returns: The message content as a list rre)rrr)rres r*get_message_contentrFsS t kk)R(G'4 !w+t+*G 33 33r)c>|sgSg}|D]=}|jddk(s|jdd}|s-|j|?d}|rdjtd|}t d|D}g}dd d }|D];}|jdd}||vs||} |j| t |d =|rZ|r?|d } t | jd tr| d jd d|d|S|jdd|dgd |S)a Transform messages from OpenAI format to Gemini format. This optimized version reduces redundant processing and improves handling of system messages. Args: messages_chatgpt: Messages in OpenAI format Returns: Messages in Gemini format rsystemrerrNc3JK|]}|jddk7sdywrrrZNrrs r*rz-transform_to_gemini_prompt..sQaquuV}7PQ##rmodel)r assistantrpartsrr*) rrqjoinfiltersumrrrinsert) messages_chatgptsystem_promptsrre system_promptrmessages_geminirole_mapr gemini_role first_messages r*transform_to_gemini_promptras]  N#/ ;;v ( *kk)R0G%%g. /M F4$@A Q#3QQMOH ${{62& 8 "4.K  " "$/B7/KL   +A.M-++G4d;g&--a1]O11EF   " "F-PQ>R=S#T U r)c@|djD]}d|vrp|d}t|trt|dk7ryg}|D],}t|tsd|vs|j |d.d|vrdt |ddhk(ruyd|vs|t|ryy ) z Verify that the object does not contain any Union types (except Optional and Decimal). Optional[T] is allowed as it becomes Union[T, None]. Decimal types are allowed as Union[str, float] or Union[float, str]. propertiesanyOfFrnullstringnumberT)valuesrrrrrrqsetverify_no_unions)obj prop_value any_of_listtypes_in_unionitems r*rrs ,'..0 j $W-Kk40C 4D4I N# 8dD)fn"))$v,7 8 '>"x&:: : %.>z.J58 r)cddl}Gddt}|j|d}|jddd fd |}t |s t d |d i|j d d S)am Map OpenAPI schema to Gemini function call schema. Transforms a standard JSON schema to Gemini's expected format: - Adds 'format': 'enum' for enum fields - Converts Optional[T] (anyOf with null) to nullable fields - Rejects true Union types (non-Optional anyOf) Ref: https://ai.google.dev/api/python/google/generativeai/protos/Schema rNceZdZUdZded<dZded<dZded<dZded<dZd ed <dZ d ed <dZ ded <dZ ded<dZ ded<dZ ded<y)5map_to_gemini_function_schema..FunctionSchemaNz str | None descriptionzlist[str] | Noneenumz Any | Noneexampleformatz bool | NonenullablezFunctionSchema | Noneitemsrequiredrzlist[dict[str, Any]] | Nonerz dict[str, FunctionSchema] | Noner)r$r%r&rr'rrrrrrrrrr(r)r*FunctionSchemarsk"& Z&!%%""! ! $+$'+$+%)")j-1*17; 4;r)rF) lazy_loadz$defsct|tr|Dcgc] }| c}St|ts|Si}|jD]\}}|dk(r |||<d|d<|dk(rt|trt |dk(r|Dcgc](}t|tr|j ddk(s|*}}t |dk(r"|d}|j |d |d <g}|D],}t|tsd|vs|j|d.t|d d hk(r |||<|||<|||<|Scc}wcc}w) z+Transform a single schema node recursively.rrrrrrrZrTrrr) rrrrrrrupdaterqr) noder  transformedkeyvaluenon_null_items actual_typer transform_schema_nodes r*r"z.transform_schema_nodes dD !<@AD)$/A A$%K **, @JCf}#( C (. H%Jud$;E a!&"&tT2txx7G67Q"" ~&!+"7q8I"JK&&{3.2K +&(N %@%dD1fn*11$v,?@>*x.BB+@+G C(,A+G C(#8#? C A @DSB"s E -EzYGemini does not support Union types (except Optional). Please change your function schemaT) exclude_none exclude_unset)rrrrr()jsonrefr replace_refsrsr ValueErrorr)r r%rschemar"s @r*map_to_gemini_function_schemar)s < <%11#1GF JJw,\#6 *F F # g    #F # . .DPT . UUr)c ,ddlm}m}|j}ddddddd d d }|j d i}|j D]#\}}||vs |j |} | | ||<%|j di} g|d<|D cgc].} | |j k7r| jjds| 0} } | D]5} | j| |j}|dj| |d7|j dd }|||d<|Scc} w)zO Update keyword arguments for google.genai package from OpenAI format. rHarmBlockThreshold HarmCategorymax_output_tokens temperaturecandidate_counttop_pstop_sequencesseedpresence_penaltyfrequency_penalty) max_tokensr/nr1stopr3r4r5generation_configNsafety_settingsHARM_CATEGORY_IMAGE_)category thresholdthinking_config) google.genai.typesr,r-copyrsrHARM_CATEGORY_UNSPECIFIEDname startswithrOFFrq)kwargs base_configr,r- new_kwargsOPENAI_TO_GEMINI_MAPr9 openai_key gemini_keyvalr:rsupported_categoriesr<r=r>s r*update_genai_kwargsrMse DJ*$  .0 #':B?"6"<"<">. J * *#'' 3C*- J' . !nn%6;O%'K!"  66 6!!"89 ) #''2D2H2HI %&--$&   !nn%6=O")8 %& +s3DcX|j}dddddd}d|vr;|d}|jD]#\}}||vs |j|}||||<%d|vrt|jd|d < d d lm}m}|jd i} | |d <|j|j|j|j|j|ji} | jD]#\} } | j| } | | | kDs| | | <%|S#t$r d d lm}m}YwxYw) a. Update keyword arguments for Gemini API from OpenAI format. This optimized version reduces redundant operations and uses efficient data transformations. Args: kwargs: Dictionary of keyword arguments to update Returns: Updated dictionary of keyword arguments r.r/r0r1r2)r6r/r7r1r8r9rcontentsrr+r:)r@rrsrr?r,r-rgoogle.generativeai.typesrHARM_CATEGORY_HATE_SPEECHBLOCK_ONLY_HIGHHARM_CATEGORY_HARASSMENTHARM_CATEGORY_DANGEROUS_CONTENT)rEresultrH gen_configrIrJrKr,r-r:DEFAULT_SAFETY_THRESHOLDSr<r=currents r*update_gemini_kwargsrYYsr[[]F *$  f$/0 ';&@&@&B 1 "J Z' nnZ0?-0Jz*  1V7 :8NOz Gjj!2B7O /F  ..0B0R0R--/A/Q/Q446H6X6X! 9>>@2)!%%h/ ?g 1(1OH % 2 M9     s:DD)(D)c*dtjd<y)N0PYDANTIC_ERRORS_INCLUDE_URL)osenvironr(r)r*disable_pydantic_error_urlr_s03BJJ,-r)c,eZdZUded<ded<ded<y) SystemMessagerVrrzdict[str, str] cache_controlNr#r(r)r*raras I I!!r)raF)totalc||St|ttfrt|ttfs#tdt |dt |t|trt|tr|d|St|tr.t|trt|}|j ||St|tr1t|tr!t d|g}|j ||St|tr;t|tr+t d|}t|}|j||S|S)a) Combine existing and new system messages. This optimized version uses a more direct approach with fewer branches. Args: existing_system: Existing system message(s) or None new_system: New system message(s) to add Returns: Combined system message(s) z.System messages must be strings or lists, got z and rrr)rrVrr'rrrarq)existing_system new_systemrU new_messages r*combine_system_messagesrhs0" oT{ 3:S$K<|sgStd|D}|dk(rgSdd}g}|D]t}|jddk(s|jd}|s,t|tr"|D]}|s|j ||^|j ||v|S)a Extract system messages from a list of messages. This optimized version pre-allocates the result list and reduces function call overhead. Args: messages: List of messages to extract system messages from Returns: List of system messages c3JK|]}|jddk(sdywrrrs r*rz*extract_system_messages..sHQaeeFmx.GqHrrrect|tr td|St|tr tdi|St dt |)NrrzUnsupported content type: r()rrVrarr'r)res r*convert_messagez0extract_system_messages..convert_messagesH gs # f7; ;  & +7+ +9$w-IJ Jr)rr)rerrra)rrrrrq)r system_countrlrUrrer s r*extract_system_messagesrns  H(HHLq K#%F8 ;;v ( *kk),G'4(#=D od&;<=  og67!8$ Mr)cd}|D]}t|trt|ts%|jddk(s:t|jdtr||jdddzz }rt|jdts|jdgD]}t|ts||dzz }|rt |dk(r t dtjd|r t d |S) zx Extract system messages from a list of messages. We expect an explicit system messsage for this provider. rrrrerrZzUAt least one user message must be included. A system message alone is not sufficient.z{{.*?}}|{%.*?%}z[Jinja templating is not supported in system messages with Google GenAI, only user messages.) rrVrrrrrr'rer_)rsystem_messagesrr s r*extract_genai_system_messagerr!sO = gs #   &{{6"h.gkk)4c:#w{{9b'AF'JJO I 6= ' Ir :=%dC0+tf}|j |j d|j j|gRt||j r|j |zt||jr|j |t|trZd|vsJd|vsJ|ddk(r|dd vrtd |dt|dtrE|j |j |d|j j|dg8t|dtsMg}|dD]}t|tr,|j |j j|?t|tttfr |j |jztd t!||j |j |d| td t!||S) z Convert a list of messages to a list of dictionaries in the format expected by the Gemini API. This optimized version pre-allocates the result list and reduces function call overhead. r)typesr)rrrrer>rrzUnsupported role: zUnsupported content item type: zUnsupported message type: ) google.genairtrrVrqContentPart from_textFilerr'rrrrto_genair)rrtrUr content_parts content_items r*convert_to_genai_messagesr}Ds##57F3K gs # MM  :://W/=>   / MM' "  , MM' "  &W$ $$' ''v(*v&77 #5gfo5F!GHH'),c2 MM$V_$zz339K3LM"GI.5 " $+I$6L!,4%,,UZZ-A-A|-A-TU#L5%2EF%,,\-B-B-DE(=d<>P=QR  MM$V_+"9$w-IJ Jg3Kj Mr))rWrVrr,)rerVrrV)ruz Iterable[str]rzGenerator[str, None, None])ruAsyncGenerator[str, None]rr~)rzT_Model | Nonerr!rzT_Model | ChatCompletion | None)rrrr)rzCallable[..., Any]rbool)rlist[dict[str, Any]]rr)rrr list[Any])rz list[ChatCompletionMessageParam]rr)r dict[str, Any]rr)r rrr)rErrFrrr)rErrr)rez%Union[str, list[SystemMessage], None]rfUnion[str, list[SystemMessage]]rr)rrrzlist[SystemMessage])rrrrV)rz6list[Union[str, dict[str, Any], list[dict[str, Any]]]]rr)E __future__rrrloggingr]rpcollections.abcrrrtypingrrr r r r r r openai.typesrropenai.types.chatrrrinstructor.multimodalrrrrrrrrpydanticr getLoggerrrrrr,rXcompileDOTALLr^rbrjrrrrrrrrrrr)rMrYr_rarhrnrrr}r(r)r*rs"  ??   8 437   < (v& ): .(x(t.#N%"**%BBIIN >* B~ ~~B~ %~~B66-6%6rB9x#GDM#*46@6@@F"JSVl7 7)777tIX4"IU" 6:6/6%6r6r "  FBDBBr)