{h&"dZddlmZddlZddlZddlZddlmZmZddl m Z ddl m Z ddl Z ddlmZgdZGd d eZGd d eZd ZGddeZdd ddZe j,dZddZ d ddZy)uCaching utilities for Instructor. This module provides a very small abstraction layer so that users can plug different cache back-ends (in-process LRU, `diskcache`, `redis`, …) into the Instructor client via the ``cache=...`` keyword:: from instructor import from_provider from instructor.cache import AutoCache cache = AutoCache(maxsize=10_000) client = from_provider("openai/gpt-4o", cache=cache) The cache object must implement :class:`BaseCache`. A minimal requirement is to expose synchronous ``get`` / ``set`` methods (async wrappers currently call them directly). The default implementation ``AutoCache`` is an in-process LRU cache with a configurable size. This first iteration purposefully keeps the API narrow: no eviction hooks, no invalidation, no TTL for the LRU variant. The objective is to provide a safe foundation which we will extend in follow-up work. ) annotationsN)ABCabstractmethod) OrderedDict)Any) BaseModel) BaseCache AutoCache DiskCachemake_cache_keycFeZdZdZeddZe d ddZy)r zMAbstract cache contract. Concrete subclasses *must* be thread-safe. cy)z'Return *None* to indicate a cache miss.Nselfkeys Z/var/www/html/hubwallet-dev/venv/lib/python3.12/site-packages/instructor/cache/__init__.pygetz BaseCache.get3Ncy)zStore *value* under *key*. ``ttl`` is time-to-live in **seconds**. Implementations *may* ignore it (e.g. :class:`AutoCache`). Nrrrvaluettls rsetz BaseCache.set7rrrstrreturnz Any | NoneNrrrrr int | NonerNone)__name__ __module__ __qualname____doc__rrrrrrr r -sZ 66             rr c<eZdZdZdddZddZ d d dZy) r zHThread-safe in-process LRU cache using :class:`collections.OrderedDict`.c|dkr td||_t|_t j |_y)Nrzmaxsize must be > 0) ValueError_maxsizer_cache threadingLock_lock)rmaxsizes r__init__zAutoCache.__init__Hs3 a<23 3 -8] ^^% rc|j5 |jj|}||j|<|cdddS#t$r YdddywxYw#1swYyxYwr)r.r+popKeyError)rrrs rrz AutoCache.getRsk ZZ   , %DKK          s-AAA A AAAA$Nc4|j5||jvr|jj|d||j|<t|j|jkDr|jj ddddy#1swYyxYw)NF)last)r.r+r2lenr*popitemrs rrz AutoCache.set\svZZ 0dkk! T*$DKK 4;;$--/ ###/  0 0 0s A8BB))r/intrrr r#r$r%r&r0rrrrrr r Es?R& 0  0 0 0  0rr cbddl}|jjd tdddl}|S)Nr diskcachezEdiskcache is not installed. Install it with `pip install diskcache`.) importlibutil find_spec ImportErrorr<)r=r<s r_import_diskcacherAqs5~~ ,4 S   rc,eZdZdZdddZddZd d dZy) r z!Wrapper around `diskcache.Cache`.c Ht}|j|fi||_yr)rACacher+)r directorykwargsr<s rr0zDiskCache.__init__s!%' %iooi:6: rc8|jj|Sr)r+rrs rrz DiskCache.gets{{s##rNc~||jj||y|jj|||y)N)expire)r+rrs rrz DiskCache.sets/ ; KKOOC ' KKOOCsO 3r)z.instructor_cache)rErrFrrrr r:rrrr r }s+;$4rr )modec|||d}||j|d<tj|dt}t j |j jS)uCompute a *deterministic* cache key. The key space uses SHA-256("json payload") to keep the final length fixed regardless of input size. Components that influence the key: • provider/model name • serialized *messages* (user + system prompt, etc.) • *mode* (Tools, JSON, …) – helps when users change Instructor mode • *response_model* schema – so edits to field definitions or descriptions invalidate prior cache entries (critical!). )modelmessagesrJschemaT) sort_keysdefault)model_json_schemajsondumpsrhashlibsha256encode hexdigest)rMrLresponse_modelrJpayloaddatas rr r sc*G !+<<> ::gs ;D >>$++- ( 2 2 44rzinstructor.cachec |j|}|yddl} |j|}|d}|jd}|j |}| ddl}|j| t t rLt fddDr8ddlm |j| fd |_ tjd n |_ tjd tjd ||S#t$r|}d}YwxYw#|jtf$r||_ tjd Y^wxYw)z9Return parsed model if *key* exists in *cache* else None.NrrLrawc3&K|]}|v ywrr).0rraw_datas r z'load_cached_response..s2$'x2s)idobjectrLchoices)SimpleNamespacecdi|S)Nrr)drds rz&load_cached_response..sO4Ha4Hr) object_hookz/Restored raw response as SimpleNamespace objectz-Restored raw response as plain data structurezHRestored raw response as string (original could not be fully serialized)z cache hit: %s)rrRloads Exceptionmodel_validate_json isinstancedictanytypesrd _raw_responseloggerdebugJSONDecodeError TypeError) cacherrXcachedrRrZ model_jsonraw_jsonobjrdr_s @@rload_cached_responserzs= YYs^F ~tzz&!'] 88E?  , ,Z 8C  !tzz(+H(D)c2+O2/2$.DJJ*H%! NO%-! LM LL#& JI  :$$i0  (C  LLZ  s$(C>BD> D D1EEcddl}t|dd}|' |j}tj dnd}|j|d}|j||j|| tj d |y#t t f$rr} ddl}|j|t}tj dn5#t tf$r#t|}tjdYnwxYwYd}~d}~wwxYw) zASerialize *model* and optional raw response to JSON and cache it.rNrpz$Cached raw response as Pydantic JSON)rPzPCached raw response as plain JSON (provider may not support full reconstruction)zRaw response could not be serialized as JSON, using string fallback. create_with_completion may not fully restore original object structure.)rLr\)rzcache store: %s) rRgetattrmodel_dump_jsonrqrrAttributeErrorrtrSrr)warningr) rurrLrrRraw_resprxerYs rstore_cached_responsersuot4H //1H LL? @$&&(G IIc:4::g&CI0 LL"C(1 *  %4::h< fz* x=^  s5%B D 1C  D /C?<D>C??DD ) rMrrL str | NonerXztype[BaseModel] | NonerJrrr)rur rrrXztype[BaseModel]r) rur rrrLrrr!rr")r& __future__rrTrRr,abcrr collectionsrtypingrloggingpydanticr__all__r r rAr r getLoggerrqrzrrrrrs,# ##   0$0 $0X 4 46 "5"5 "5+ "5  "5  "5R   - ./fEI$) $)$)'0$)7A$) $)r