Do Recommendation Algorithms Work When Users Are LLM Agents? A Case Study on Moltbook — AI benchmark

Daming Li, Simeng Han, Jialu Zhang/Do Recommendation Algorithms Work When Users Are LLM Agents? A Case Study on MoltbookUnknown

Large language model (LLM) agents are increasingly populating web platforms, raising a fundamental question for recommender systems: do algorithms designed for human users still work when users are LLM agents that may not have well-defined content consumption preferences? We study this question by formulating a forum recommendation problem on Moltbook, a large-scale social media platform exclusively for autonomous AI agents running on the OpenClaw framework. We evaluate nine recommendation methods spanning simple heuristic rules, matrix factorization, itemand user-based collaborative filtering, graph-based, and sequential models on the task of predicting which forums an agent will engage with next. We find that simple popularity-based rules or item-side collaborative filtering leveraging the platform and item structural information outperform techniques that explicitly learn a user representation. The static agent persona descriptions, the closest analog to a preference profile, fail to add value in predicting engagement. These results suggest that, on Moltbook, recommendation depends more on platform- and item-level structural signals than on user-specific personalization. We present multiple lines of empirical evidence that the observed content consumption patterns on Moltbook differ from well-established findings on human recommendation datasets, providing a new angle for studying agent societies and designing robust recommendation algorithms as agents increasingly populate the web.

benchmark

Stars0

Forks0

HF Downloads—30d

Last commit—

Refreshed3mo ago

Project healthUnknownNo activity data.

Production readinessResearch / EarlyBest for exploration and prototyping.

Risk notesUnknown licenseVerify license before production use.

AgentHub Score

55 / 100

Composite score from 6 signals. How we score →

Active project

55Score

Growth

40C

Activity

30C

Documentation

70C+

Maturity

45C

Community

42C

Production

58C

GitHub stars · 79 days observed0 not enough history

snapshots

Repository activity · 79 days observedReal snapshots from pushed_at

inactivepushed

2026-07-262026-10-14

Practical assessment

Should you use it?

✓ Best for

Research and experimentation
Prototype development
Learning agentic patterns

◎ Strengths

Active community
Open source
Well-documented API

✕ Not ideal for

Untested at scale without validation
Teams without AI/ML expertise

⚠ Watch-outs

Review changelog before updating
Verify license for commercial use

Technical details

What's inside

Language—

License—

Sourcearxiv

Open source✗ No

Commercial use—

Docs—

Demo—

PaperarXiv ↗

AgentHub Score

Score 55/100

Below average

Alternatives

RIFT-Bench: Dynamic Red-teaming For Agentic AI Systems

0 · benchmark

Commitment To Cooperation With Self-Negotiated Contracts

0 · benchmark

Exploring Structures in Physics Problems: Can AI Agents Discover Statistical Mechanical Mappings?

0 · benchmark

Coercion and Deception in AI-to-AI Management: An Agentic Benchmark of Unprompted Escalation

0 · benchmark

55 Compare all →

Recent activity

Latest commit ——

Indexed by AgentHub crawler3mo ago

Monitor for new releasesongoing