{h(dZddlmZddlmZmZddlZddlZddlm Z m Z m Z m Z m Z ddlmZddlmZGd d ee Zy) z Batch processor for unified batch processing across providers. This module contains the BatchProcessor class that provides a unified interface for batch processing across different LLM providers. ) annotations)AnyGenericN) BatchResult BatchSuccess BatchError BatchJobInfoT) BatchRequest) get_providerceZdZdZddZ d ddZ d ddZddZddZdddZ d dd Z dd Z dd Z dd Z dd Zy)BatchProcessorz7Unified batch processor that works across all providersc||_||_ |jdd\|_|_t |j|_y#t $r}t d|d}~wwxYw)N/rziModel string must be in format "provider/model-name" (e.g. "openai/gpt-4" or "anthropic/claude-3-sonnet"))modelresponse_modelsplit provider_name model_name ValueErrorr provider)selfrrerrs [/var/www/html/hubwallet-dev/venv/lib/python3.12/site-packages/instructor/batch/processor.py__init__zBatchProcessor.__init__sn , 27++c12E /D %T%7%78  G  sA A$ AA$c tjj|rtj|g}t |D]g\}}t |j d|||j |j||}|j||j|j|itd|dt|d|S)aCreate batch file from list of message conversations Args: messages_list: List of message conversations, each as a list of message dicts file_path: Path to save the batch request file max_tokens: Maximum tokens per request temperature: Temperature for generation Returns: The file path where the batch was saved zrequest-) custom_idmessagesrr max_tokens temperaturezCreated batch file z with z requests) ospathexistsremove enumerater rr save_to_filerappendprintlen) r messages_list file_pathr r!batch_requestsir batch_requests rcreate_batch_from_messagesz)BatchProcessor.create_batch_from_messages$s& 77>>) $ IIi $]3 1KAx()<)<=$QC.!#22oo%' M  & &y$2D2D E  ! !- 0 1 #I;fS5H4ISTNc L|ddi}|jj|fd|i|S)aSubmit batch job to the provider and return job ID Args: file_path: Path to the batch request file metadata: Optional metadata to attach to the batch job **kwargs: Additional provider-specific arguments descriptionzInstructor batch jobmetadata)r submit_batch)rr,r4kwargss rr5zBatchProcessor.submit_batchJs6  %'=>H)t}})))QhQ&QQr1c8|jj|S)z&Get batch job status from the provider)r get_statusrbatch_ids rget_batch_statuszBatchProcessor.get_batch_statusYs}}''11r1cZ|jj|}|j|S)z2Retrieve and parse batch results from the provider)rretrieve_results parse_results)rr:results_contents rr=zBatchProcessor.retrieve_results]s'--88B!!/22r1c8|jj|S)zList batch jobs for the current provider Args: limit: Maximum number of batch jobs to return Returns: List of BatchJobInfo objects with normalized batch information )r list_batches)rlimits rrAzBatchProcessor.list_batchesbs}}))%00r1cd|j|}||jj|||S)aGet batch results, optionally saving raw results to a file Args: batch_id: The batch job ID file_path: Optional file path to save raw results. If provided, raw results will be saved to this file. If not provided, results are only kept in memory. Returns: List of BatchResult objects (BatchSuccess[T] or BatchError) )r=rdownload_results)rr:r,r?s r get_resultszBatchProcessor.get_resultsms6//9  MM * *8Y ?r1c8|jj|S)zCancel a batch job Args: batch_id: The batch job ID to cancel Returns: Dict containing the cancelled batch information )r cancel_batchr9s rrGzBatchProcessor.cancel_batch}}))(33r1c8|jj|S)zDelete a batch job (only available for completed batches) Args: batch_id: The batch job ID to delete Returns: Dict containing the deletion confirmation )r delete_batchr9s rrJzBatchProcessor.delete_batchrHr1c g}|jjd}|D]5}|js tj|}|j dd}|j |}|r9 |j di|}tt||} |j| nd } d } |jd k(rzd |vrv|d }|j ddk(r]|j di}t|tr.d|vr*|d}|j dd} |j dd} n t!|} d} t|| | |} |j| 8|S#t$rD} t|dd|j jd| |} |j| Yd } ~ Md } ~ wwxYw#t$r0} tddd| d|i} |j| Yd } ~ d } ~ wwxYw)zWParse batch results from content string into Maybe-like results with custom_id tracking runknown)rresult parsing_errorzFailed to parse into z: )r error_type error_messageraw_dataNz Unknown errorextraction_error anthropicrNtypeerrormessagezUnknown Anthropic erroranthropic_errorjson_parse_errorzFailed to parse JSON: raw_line)striprjsonloadsget_extract_from_responserrr r( Exceptionr __name__r isinstancedictstr)rr?resultslineslinedatarextracted_datarN batch_resulte error_resultrQrP error_info error_detailss rr>zBatchProcessor.parse_resultss%'%%'--d3= -D::<9 -zz$' HH[)< !%!->$*,=." 14J -> #-"+#-&3!% $L NN<0i= -~]%5'1&/'6,A$BUBUB^B^A__abcad*e%3 (  |445J -)'1$:1#">($/   |,, -sB:F/57E,B.F/ F,(:F'"F/'F,,F// G(8%G##G(c |jdk(r)|dddddd}tj|S|jdk(rd |vry |d }|jd d k(ry |jd d k(rd|vr|dd}t |t rt |dkDrt|D]*}|jd dk(s|jdicS|D]@}|jd dk(s|jdd} tj|cSy y #tj$rY[wxYw#t$rYy wxYw)z>Extract structured data from provider-specific response formatopenairesponsebodychoicesrrWcontentrTrNNrUrV succeededtool_useinputtext) rr]r^r_rclistr*JSONDecodeErrorra)rrirurNitemrys rr`z%BatchProcessor._extract_from_responsesq' !!X-z*629=a@KIVzz'**##{24'h::f%0::f%4f9L$Y/ :G!'40S\A5E$+=D#xx/:='+xx'< <= %,-D#xx/69'+xx';!-+/::d+;$; -=3F(,';';!-$,!-   s_7D6D6D6(AD6D6D6/D6DD6D6D30D62D33D66 EE)rrerztype[T])ig?) r+zlist[list[dict[str, Any]]]r,rer z int | Noner!z float | Nonereturnre)N)r,rer4dict[str, Any] | Noner~re)r:rer~dict[str, Any])r:rer~list[BatchResult]) )rBintr~zlist[BatchJobInfo])r:rer,z str | Noner~r)r?rer~r)rirr~r)rb __module__ __qualname____doc__rr0r5r;r=rArErGrJr>r`r[r1rrrsA9("&$' $1$$ $ " $ $NAE R R(= R  R23 16:(2 . 4 4DL+r1r)r __future__rtypingrrr]r"modelsrrr r r requestr providersr rr[r1rrs6# JJ!#zWQZzr1