LLMs for RockChip. Guide for RKLLM. RK3588 vs RK3576 comparision
#LLMs #RockChip #Guide #RKLLM #RK3588 #RK3576
“Anton Maltsev”
00:00:00 – Intro.
00:01:12 – Difference between RK3588 and RK3576 (CPU and GPU).
00:02:15 – NPU performance 6TOPS 3NPU or 6TOPS 2 NPU, who will win?
00:03:37 – Price and power performance
00:04:26 – Meckotronics R57 Debian installation
00:05:44 – RKLLM (rkllm-runtime)? How to set up LLM for…
source
Concluzion: LLMs for RockChip. Guide for RKLLM. RK3588 vs RK3576 comparision – RK3576,RK3588,mekotronics,RockChip,RKLLM,LLM,RockChip LLM,Flask,LLM inference,NPU,NPU LLM,Edge,ezrknn-llm,TinyLLAMA 1.1B,Qwen 1.8B,Qwen2 0.5B,Phi-2 2.7B,Phi-3 3.8B,ChatGLM3 6B,Gemma 2B,InternLM2 1.8B,MiniCPM 2B,Benchmakr,Comparision,NPU speed,Export