Synapse Open Synapse
Open source

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

Show HN · · 5 min read

Hi HN, Sanchit here from RunAnywhere (YC W26). We just open-sourced TrnRT: Trainium RunTime, our inference engine for AWS Trainium. We started 3 weeks back, and currently we’re able to serve and run GLM 5.3 flash (FP8) on AWS trn2.48xlarge, and will bring more models support soon.

Same story elsewhere

Latest from Show HN