๐Ÿ“–
Beyond Behavioral Accuracy: Evaluating Individual-Level Fidelity in LLM Investor Simulation
Jiajie He, Yuanhong Jiang, Xintong Chen, Dongling Ni, Wenjin Liu

Beyond Behavioral Accuracy: Evaluating Individual-Level Fidelity in LLM Investor Simulation

Science & Mathematics Published 2026 Verification Pending

Overview & Synopsis

Large language models (LLMs) are increasingly used as user simulators, but can they faithfully reproduce an individual's behavior and decision logic over time? We investigate this question in a longitudinal paper-trading study with 80 participants. Using rolling next-day predictions, we evaluate trading activity, buy-sell structure, asset selection, and portfolio outcomes, complemented by controlled input ablations and participant-rated explanation alignment. No evaluated LLM reliably outperforms a simple recent-activity persistence baseline for predicting trade occurrence, while buy-sell structure and asset selection remain difficult to reproduce. Similar activity-level performance can also yield substantially different portfolio trajectories. Ablations show that activity predictions depend primarily on recent trades, whereas asset choices are sensitive to multiple evidence sources. Participants rate explanations as more aligned with their recurring strategies than with their decision-specific rationales. These findings reveal a gap between coarse behavioral agreement and individual-level fidelity, motivating separate evaluation of behavioral accuracy, explanation alignment, and evidence dependence in personalized user simulation.

Indexed from repository: arXiv (arxiv.org)
Loading document from verified source...
Keyboard Shortcuts: ← / → for pages • + / - for zoom • 0 to fit width Powered by Mozilla PDF.js v3.11

Document Information

Document Title Beyond Behavioral Accuracy: Evaluating Individual-Level Fidelity in LLM Investor Simulation
Author / Organization Jiajie He, Yuanhong Jiang, Xintong Chen, Dongling Ni, Wenjin Liu
Subject & Discipline cs.AI
Categories Science & Mathematics
Publication Year 2026
License / Rights arXiv Open Access / Creative Commons
Resource Verification Listed PDF (Verification Pending)
Original Host Website arXiv (arxiv.org)
File Format application/pdf (Portable Document Format)
Language EN
Catalog ID DOC-273029
Original Source Link Visit Source Page on arxiv.org »