Presentation Information

[B-16-08]A Study on Demand-aware Resource Placement Schemes for Distributed Large Language Model Inference Services

〇Riku Okamoto1, Hidetaka Doen1, Hiroyuki Ohsaki1 (1. Kwansei Gakuin University)

Keywords:

large language model,distributed inference

Password required to view