{hJddlZddlmZddlmZddlmZddlZddlZddl Z ddl Z ddl m Z m Z ddlmZejZeZdee defd ZdLd eded ee fdZej/ddej0d dej0d dej0ddej0ddej0d dej0ddfd edededededef dZej/dej0d ej0d!d"ej0d#d$ej0d%d&ej0ddfd'ed(ed)ed*edef d+Zej/d,ej0d-ej0d dej0dd.fd/ededefd0Zej/d1ej0d2ej0d dfd/edefd3Zej/d4ej0d5ej0d6ej0d dfd/ed7edefd8Zej/d9ej0d:ej0d;ej0d!d"fd/edej0d?ej0d!d"ej0d@ej0dAdBej0dCdDej0dEdFfdGed(edHed>+,K8 9E ZuDI X, Yer: Yer: Zu:8 gC 7a@ 'Q? [  gC GqA w!DJ       #i$$g . \N!I,<,<,B,B+C2l^STU ##..  + + 4 4] C ##..  + + 4 4] C     * *y/C/C/P/P$$11I4H4H4S4SS %224r9Mr!"%m"4!5Q7 %*"'A  ! ! , ,1A1A1G1G<1W 3||HLL1I4H4H4S4SSH$224r9Mr!"%m"4!5Q7 %*"'A y||,  2 %/4u<  x  MM I,,66;!<I,,338q9I,,227a8  $ MMILL!I,,66;!<I,,449:I,,77<1= CJX Lrrlimitreturncddd}||vrtd|ddlm}Gdd|} t|||}|j | S#t $r(}t jd |d |d gcYd }~Sd }~wwxYw)z>Get batch jobs for the specified provider using BatchProcessoropenai/gpt-4o-minianthropic/claude-3-sonnetrr!zUnsupported provider: r BaseModelceZdZUdZeed<y)get_jobs..DummyModeldummyN__name__ __module__ __qualname__rgrG__annotations__r\rZ DummyModelrfs sr\rn)r]z[red]Error listing z batch jobs: [/red]N) ValueErrorpydanticrdr list_batches Exceptionconsoleprint)r]r model_maprdrn processores rZget_jobsryus '0I y 1(<==#Y"9X#6 C %%E%22  +H:]1#VLM s A A<A71A<7A<listzSee all existing batch jobs)namehelpz"Total number of batch jobs to show)r|z5Time in seconds to wait for the batch job to completeFzEnable or disable screen outputz4Enable live polling to continuously update the tablez-Provider to use (e.g., 'openai', 'anthropic')zE[DEPRECATED] Use --model instead. Use Anthropic API instead of OpenAIpollscreenlive use_anthropicc| tjdtd|rd}ddd}||vr8tj||s t j d ||d |d yt||}t||}|st j |yt|d| 5} t||}t||}| j|tj|?#1swYyxYw) z: Monitor the status of the most recent batch jobs NB--use-anthropic is deprecated. Use --provider 'anthropic' instead. stacklevelr!ANTHROPIC_API_KEYOPENAI_API_KEY)r!rz [red]Error: z" environment variable not set for ro)refresh_per_secondr~) warningswarnDeprecationWarningosgetenvrtruryr[rupdatetimesleep) r]r}r~rr r required_keysr rO live_tables rZwatchrs0  P  "H)"M = =3J)K =233UV^U__e f  %*J :x 0E  e e& 9Z!%2J":x8E   e $ JJt  s "AC##C,zCreate a batch job from a filez&File containing the batch job requestsr`zYModel in format 'provider/model-name' (e.g., 'openai/gpt-4', 'anthropic/claude-3-sonnet')zInstructor batch jobz&Description/metadata for the batch job24hz1Completion window for the batch job (OpenAI only) file_pathmodel descriptioncompletion_windowc| tjdtd|rd} ddlm}Gdd |}t ||}d |i}t jd d 5|j|||} dddt jd d|jddd} tdddd| y#1swYHxYw#t$r#} t jd| dYd} ~ yd} ~ wwxYw)z?Create a batch job from a file using the unified BatchProcessorNzO--use-anthropic is deprecated. Use --model 'anthropic/claude-3-sonnet' instead.rrrarrcceZdZUdZeed<y)$create_from_file..DummyModelrgNrhrmr\rZrnr  E3 r\rnrz#[bold green]Submitting batch job...dotsspinner)metadatarz'[bold green]Batch job created with ID: [/bold green]/Fr]r}r~rr z$[bold red]Error creating batch job: [/bold red]) rrrrqrdrrtr< submit_batchrusplitrrs) rrrrrrdrnrwrbatch_id provider_namerxs rZcreate_from_filers 2  ]  /EM& ! !#5*5  ; ^^AF^ S  --H@Q.H   ?zWX C+A.  AAe%-P   M .DummyModelrgNrhrmr\rZrnr,rr\rnr`rarbed]Unsupported provider: roz[bold yellow]Cancelling batch job...rr[bold green]Batch z% cancelled successfully![/bold green]rFr[yellow]Note: [/yellow]z![bold red]Error cancelling batch : r) rrrrqrdrtrurr< cancel_batchrNotImplementedErrorrs)rr rrdrnrvrwrxs rZcancelrsG  P  "H#V& ! ! +4 9 $ MM7zH I #9X#6 C ^^&xj >  -  " "8 , -    *O P AAe%(K - - 5 qc344 V 9(2aS TUUVsA3C*CC1CC C D+C99 D+D&&D+zDelete a completed batch jobzBatch job ID to deletec ddlm}Gdd|}ddd}||vrtjd|d y t |||}tj d |d d 5|j |d d d tjd|dtdddd|y #1swY3xYw#t$r#}tjd|dYd }~y d }~wt$r&}tjd|d|dYd }~y d }~wwxYw)z3Delete a batch job using the unified BatchProcessorrrcceZdZUdZeed<y)delete..DummyModelrgNrhrmr\rZrnr[rr\rnr`rarbrroNz[bold yellow]Deleting rrrrz# deleted successfully![/bold green]rrFrrrz[bold red]Error deleting batch rr) rqrdrtrurr< delete_batchrrrs)rr rdrnrvrwrxs rZdeleterNs #T& ! ! +4 9 $ MM7zH I #9X#6 C ^^$XJm !'!8!8#++H5E&&'1 !HII++K !<==(#. G$"6??#:#:#B#B8#LMGFJJtzz&*;*;*=>EFG G G &XFNN++X+>E\\F$ !HII**G NCH:N N7"LL009M(#. /$ =--. / /9" >!'!5!5!=!= > G G$ / / M ;H:RsKLLMs~GFAG;A)G%G.BG2GG)GGGGG GGGGG H (HH z!Retrieve results from a batch jobz Batch job ID to get results fromzFile to save the results to output_filec|jdd\}} |dk(rddlm}|}|jj |}|j dk7r$t jd|j d y |j}|st jd y |jj|} t|d 5} | j| jd d d t jd |dy |dk(r ddlm} | }|j j"jj |}|j$dk7r$t jd|j$dy |j j"jj'|} t|d 5} | D]7} | jt)j*| j-dz9 d d d t jd |dy t jd|dy #1swYNxYw#1swYJxYw#t.$r%}t j1d|d|Yd }~y d }~wwxYw)z#Retrieve and save batch job resultsrrrrrrr,z[yellow]Batch status is 'z', not completed[/yellow]Nz#[red]No output file available[/red]rz[bold green]Results saved to: rr!rrz', not ended[/yellow]rrroz'[bold red]Error retrieving results for r)rrrrrr<rtrurrrrrrr!rrrrrrrrrsr)rrrr _rrrrrfr results_iterrrxs rZrrs0++c1%KHa/O x  %XFNN++X+>E||{* / ~=VW**G CD"LL009Mk3' ,1 **+ , MM:;-}U V  $ +[FKK((0099(CE&&'1 /0G0G/HH]^";;//77??ILk3' D1*DFGGDJJv'8'8':;dBCD D MM:;-}U V MM7zH I3 , ,& D D O =hZr!MNNOsgA I8#I'IH+!IA4I6;I1=H8/!II+H50I8I=I I2 I--I2z%Create batch job using BatchProcessorz%JSONL file with message conversationszrs  9ekkm )`tL1`S`FC4 ;M:&<=b'KL  H 5<<,MN J!ELL < '%,, T: : :  :  :::>:z ) "U\\'OP h$u|| 5*U\\ @ '%,, T:M:M :M  :M:M:M:Mz&' ELL&>? ELL < '%,, c:V:V:V:V(:Vz01 ELL&>? ELL <+T+T+T2+T\AB ELL&@A*ell0JK ELL <0M0M0M0MC0Mf56 ELL&HI#u||)FG h:O:O:O :O7:Oz9:%+RS h'%,, K$u||%E#ell4.JK%c0LM1<1< 1<  1<1<1<1<;1