Presentation Information
[B-16-08]A Study on Demand-aware Resource Placement Schemes for Distributed Large Language Model Inference Services
〇Riku Okamoto1, Hidetaka Doen1, Hiroyuki Ohsaki1 (1. Kwansei Gakuin University)
Keywords:
large language model,distributed inference
