TensorRT Edge-LLM Completes MLPerf Edge Agentic Benchmark 6.4x Faster on Jetson AGX Thor

TensorRT Edge-LLM is an inference optimization solution designed for edge AI agents running on NVIDIA Jetson AGX Thor. The technology achieves 6.4x faster performance on the MLPerf Edge Agentic benchmark compared to baseline implementations. This advancement enables complex AI agent tasks to run efficiently on resource-constrained edge devices such as vehicles and robots, reducing cloud dependency and improving real-time response capabilities.