[B-6] Network Systems

11:15 AM - 11:30 AM JST(2:15 AM - 2:30 AM UTC)Candidate for Academic Incentive AwardCareer Explorer

[B-6-54] Cost-Efficiency Evaluation of Node Configurations in Distributed LLM Inference Using Cloud GPUs

◎△Takeru Kono¹, Atuya Kanno², Nagisa Nasu², Kaichi Taguti², Takahiro Koita², Akihito Kohiga¹ (1. Doshisha Univ., 2. Graduate School of Doshisha Univ.)

Keywords:

Mesh-LLM,AmazonWebService,Large Language Model / LLM,Distributed Inference,EC2Instance

Password required to view