Explore/framework/llama-cpp-agent
L

Maximilian-Winter/llama-cpp-agentStale

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

frameworkPythonNOASSERTION
GitHubCompare
Refreshed 4d ago
OverviewActivity52wAlternativesDocs
Stars635
Forks70
HF Downloads—30d
Last commit2mo ago
Refreshed4d ago
Project healthStaleNo commits in 84d.
Production readinessExperimentalGrowing but not yet battle-tested at scale.
Risk notesNOASSERTIONVerify license before production use.
AgentHub Score
76 / 100
Composite score from 6 signals. How we score →
Active project
76Score
Growth
90A
Activity
68C+
Documentation
70C+
Maturity
77B
Community
90A
Production
58C
GitHub stars · 90 days635 +11.2%
30d90d1y
latest release
Commit activity · 52 weeksActive contributor activity
LowHigh
JunSepDecMarNow
Practical assessment
Should you use it?

✓ Best for

  • Multi-agent orchestration
  • Production agentic workflows
  • Stateful long-running tasks

◎ Strengths

  • Stable API
  • Active release cadence
  • Strong GitHub community

✕ Not ideal for

  • Simple single-step automation
  • Teams without Python/ML expertise

⚠ Watch-outs

  • Breaking changes between minor versions
  • Ecosystem lock-in if tightly coupled
Technical details
What's inside
LanguagePython
LicenseNOASSERTION
Sourcegithub
Open source✗ No
Commercial use—
Docs—
Demo—
Paper—

AgentHub Score

76
Score 76/100
Above average

Alternatives

C
crewai
26.1k · Multi-Agent
87
A
autogen
42.7k · Multi-Agent
71
S
smolagents
11.2k · Coding
84
O
openai-agents-python
9.4k · Multi-Agent
81
Compare all →

Recent activity

Latest commit 2mo ago2mo ago
Indexed by AgentHub crawler4d ago
Monitor for new releasesongoing