Explore/framework/llama-cpp-agent
L

Maximilian-Winter/llama-cpp-agentStale

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

frameworkPythonNOASSERTION
GitHubCompare
Refreshed 5h ago
OverviewActivity52wAlternativesDocs
Stars660
Forks74
HF Downloads30d
Last commit5mo ago
Refreshed5h ago
Project healthStaleNo commits in 175d.
Production readinessExperimentalGrowing but not yet battle-tested at scale.
Risk notesNOASSERTIONVerify license before production use.
AgentHub Score
55 / 100
Composite score from 6 signals. How we score →
Active project
55Score
Growth
91A
Activity
50C
Documentation
70C+
Maturity
77B
Community
90A
Production
58C
GitHub stars · 35 days observed660 +1.23% / 30d
snapshots
Repository activity · 35 days observedReal snapshots from pushed_at
inactivepushed
2026-07-262026-08-31
Practical assessment
Should you use it?

✓ Best for

  • Multi-agent orchestration
  • Production agentic workflows
  • Stateful long-running tasks

◎ Strengths

  • Stable API
  • Active release cadence
  • Strong GitHub community

✕ Not ideal for

  • Simple single-step automation
  • Teams without Python/ML expertise

⚠ Watch-outs

  • Breaking changes between minor versions
  • Ecosystem lock-in if tightly coupled
Technical details
What's inside
LanguagePython
LicenseNOASSERTION
Sourcegithub
Open source✗ No
Commercial use
Docs
Demo
Paper

AgentHub Score

55
Score 55/100
Below average

Alternatives

E
ECC
245.0k · framework
95
H
hermes-agent
238.8k · framework
95
L
langchain
145.3k · framework
95
C
cc-switch
130.4k · framework
95
Compare all →

Recent activity

Latest commit 5mo ago5mo ago
Indexed by AgentHub crawler5h ago
Monitor for new releasesongoing