A Survey of Hybrid Inference Systems for Large Language Models
Arkul Prathamesh Shenoy, Amogh Kulkarni, Atharv Rawal, Yatin Prabhakar, Bhaskarjyoti Das
Action editor: Maria Lomeli
@tmlr-pub.bsky.socialExplore
@tmlr-pub.bsky.social
@tmlr-pub.bsky.socialA Survey of Hybrid Inference Systems for Large Language Models
Arkul Prathamesh Shenoy, Amogh Kulkarni, Atharv Rawal, Yatin Prabhakar, Bhaskarjyoti Das
Action editor: Maria Lomeli