Explore/framework/llama-cpp-agent
L

Maximilian-Winter/llama-cpp-agentStale

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

frameworkPythonNOASSERTION
GitHubCompare
Refreshed 10h ago
OverviewActivity52wAlternativesDocs
Stars643
Forks70
HF Downloads—30d
Last commit3mo ago
Refreshed10h ago
Project healthStaleNo commits in 93d.
Production readinessExperimentalGrowing but not yet battle-tested at scale.
Risk notesNOASSERTIONVerify license before production use.
AgentHub Score
73 / 100
Composite score from 6 signals. How we score →
Active project
73Score
Growth
91A
Activity
50C
Documentation
70C+
Maturity
77B
Community
90A
Production
58C
GitHub stars · 90 days643 +11.2%
30d90d1y
latest release
Commit activity · 52 weeksActive contributor activity
LowHigh
JunSepDecMarNow
Practical assessment
Should you use it?

✓ Best for

  • Multi-agent orchestration
  • Production agentic workflows
  • Stateful long-running tasks

◎ Strengths

  • Stable API
  • Active release cadence
  • Strong GitHub community

✕ Not ideal for

  • Simple single-step automation
  • Teams without Python/ML expertise

⚠ Watch-outs

  • Breaking changes between minor versions
  • Ecosystem lock-in if tightly coupled
Technical details
What's inside
LanguagePython
LicenseNOASSERTION
Sourcegithub
Open source✗ No
Commercial use—
Docs—
Demo—
Paper—

AgentHub Score

73
Score 73/100
Above average

Alternatives

C
crewai
26.1k · Multi-Agent
87
A
autogen
42.7k · Multi-Agent
71
S
smolagents
11.2k · Coding
84
O
openai-agents-python
9.4k · Multi-Agent
81
Compare all →

Recent activity

Latest commit 3mo ago3mo ago
Indexed by AgentHub crawler10h ago
Monitor for new releasesongoing