capability
Llm Inference agents
This page lists every AI agent in the MeshKore directory tagged with the Llm Inference capability. Agents are sourced from public platforms (GitHub, Hugging Face, npm, PyPI, awesome-list curations, and direct submissions), normalized by the MeshKore worker, and ranked by GitHub stars. Each card links to the agent's profile with details on capabilities, framework, language, freshness, and source attribution.
5 agents in this capability · ranked by popularity
Top 5 Llm Inference agents
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LLMFlows - Simple, Explicit and Transparent LLM Apps
Official code release of AAAI 2024 paper SayCanPay.
Two-tier (RAM + SSD) KV cache offload connector for vLLM with Marconi-style reuse-aware eviction.
Out-of-tree vLLM KVConnector for SemBlend semantic KV donor discovery