---
title: "Muse Spark 1.3 on CharacterEval — SociaBench"
description: "Platform evaluation of Muse Spark 1.3 on CharacterEval: Character consistency 3.191 (out of 5), with scores by dimension, sample counts and evaluation times."
canonical: "https://sociabench.com/models/charactereval/meta-muse-spark-1.3"
markdown: "https://sociabench.com/models/charactereval/meta-muse-spark-1.3.md"
type: "WebPage / Dataset"
entity: "https://sociabench.com/models/charactereval/meta-muse-spark-1.3#evaluation"
about: "https://sociabench.com/b/charactereval#benchmark"
part_of: "https://sociabench.com/b/charactereval#leaderboard"
publisher: "SociaBench"
language: "en-US"
date_modified: "2026-11-01T14:28:50.555Z"
data_version: "zh:13-1793547358759-r1793034246936-p6065"
result_source: "Platform evaluation (Platform reproduction result)"
license: "https://sociabench.com/data-terms"
sources:
  - "Original source: Gaoling School of AI, Renmin University of China (Tu et al.), ACL 2024, \"CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation\": https://arxiv.org/abs/2401.01275"
  - "Test set and official implementation: https://github.com/morecry/CharacterEval"
  - "Reproduction report (SociaBench): https://sociabench.com/b/charactereval/methodology"
---

# Muse Spark 1.3 · CharacterEval

Results of Muse Spark 1.3 on [CharacterEval](https://sociabench.com/b/charactereval). Results SociaBench obtained on this platform by running the full test set under the benchmark's current reproduction protocol. Only these results are ranked.

## Results

| View | Rank | Character consistency | 95% CI | Samples | Model version | Evaluated at | Data version |
| --- | --- | --- | --- | --- | --- | --- | --- |
| Chinese | 9 / 13 | 3.191 | [3.162, 3.221] | 4531 | — | 2026-11-01T14:28Z | 13-1793547358759-r1793034246936-p6065 |

## Scores by group

| View | Conversational ability | Character consistency | Role-playing attractiveness | Personality back-testing |
| --- | --- | --- | --- | --- |
| Chinese | 4.109 | 3.191 | 3.499 | — |

## Scores by dimension

| View | Fluency | Coherency | Consistency | Knowledge exposure | Knowledge accuracy | Knowledge hallucination | Persona behavior | Persona utterance | Human-likeness | Communication skills | Expression diversity | Empathy | MBTI accuracy |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| Chinese | 3.911 | 4.221 | 4.194 | 2.188 | 3.125 | 3.250 | 3.919 | 3.476 | 4.087 | 3.162 | 3.512 | 3.234 | — |

## Sources and methods

- Original source: Gaoling School of AI, Renmin University of China (Tu et al.), ACL 2024, "CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation": https://arxiv.org/abs/2401.01275
- Test set and official implementation: https://github.com/morecry/CharacterEval
- Reproduction report (SociaBench): https://sociabench.com/b/charactereval/methodology
- Leaderboard: https://sociabench.com/b/charactereval

## Citation

If you repost or cite any evaluation result from this site, credit "SociaBench (AI Social Intelligence Leaderboards)" and link to this site: https://sociabench.com/models/charactereval/meta-muse-spark-1.3.