Large-scale LLM inference engine
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.