Explore/framework/llama-cpp-agent
L

Maximilian-Winter/llama-cpp-agentAbandoned

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

frameworkPythonNOASSERTION
GitHubCompare
Refreshed just now
OverviewActivity52wAlternativesDocs
Stars659
Forks73
HF Downloads—30d
Last commit7mo ago
Refreshedjust now
Project healthAbandonedNo commits in 7 months.
Production readinessExperimentalGrowing but not yet battle-tested at scale.
Risk notesNOASSERTIONVerify license before production use.
AgentHub Score
55 / 100
Composite score from 6 signals. How we score →
Active project
55Score
Growth
91A
Activity
30C
Documentation
70C+
Maturity
77B
Community
90A
Production
58C
GitHub stars · 78 days observed659 -0.15% / 30d
snapshots
Repository activity · 78 days observedReal snapshots from pushed_at
inactivepushed
2026-07-262026-10-13
Practical assessment
Should you use it?

✓ Best for

  • Multi-agent orchestration
  • Production agentic workflows
  • Stateful long-running tasks

◎ Strengths

  • Stable API
  • Active release cadence
  • Strong GitHub community

✕ Not ideal for

  • Simple single-step automation
  • Teams without Python/ML expertise

⚠ Watch-outs

  • Breaking changes between minor versions
  • Ecosystem lock-in if tightly coupled
Technical details
What's inside
LanguagePython
LicenseNOASSERTION
Sourcegithub
Open source✗ No
Commercial use—
Docs—
Demo—
Paper—

AgentHub Score

55
Score 55/100
Below average

Alternatives

E
ECC
278.5k · framework
95
R
rea
209.7k · framework
95
P
ponytail
162.8k · framework
95
C
cc-switch
143.8k · framework
95
Compare all →

Recent activity

Latest commit 7mo ago7mo ago
Indexed by AgentHub crawlerjust now
Monitor for new releasesongoing