Loading…
12
PSA: saw a demo at the AWS booth at re:Invent in Vegas and it cut my cloud bill by 40%
They showed how to route simple text tasks to a small open model instead of the big one, and I tried it on our support tickets and saved $800 in a month. Anyone else doing model routing, and what are you using to decide which requests go where?
0 comments
Log in to join the discussion
Log In0 Comments
No comments yet
Be the first to share your thoughts on this discussion.