---
title: "GPT-6 Astra on CharacterEval — SociaBench"
description: "Platform evaluation of GPT-6 Astra on CharacterEval: Character consistency 3.251 (out of 5), with scores by dimension, sample counts and evaluation times."
canonical: "https://sociabench.com/models/charactereval/gpt-6-astra"
markdown: "https://sociabench.com/models/charactereval/gpt-6-astra.md"
type: "WebPage / Dataset"
entity: "https://sociabench.com/models/charactereval/gpt-6-astra#evaluation"
about: "https://sociabench.com/b/charactereval#benchmark"
part_of: "https://sociabench.com/b/charactereval#leaderboard"
publisher: "SociaBench"
language: "en-US"
date_modified: "2026-11-01T14:29:35.251Z"
data_version: "zh:13-1793547358759-r1793034246936-p6065"
result_source: "Platform evaluation (Platform reproduction result)"
license: "https://sociabench.com/data-terms"
sources:
  - "Original source: Gaoling School of AI, Renmin University of China (Tu et al.), ACL 2024, \"CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation\": https://arxiv.org/abs/2401.01275"
  - "Test set and official implementation: https://github.com/morecry/CharacterEval"
  - "Reproduction report (SociaBench): https://sociabench.com/b/charactereval/methodology"
---

# GPT-6 Astra · CharacterEval

Results of GPT-6 Astra on [CharacterEval](https://sociabench.com/b/charactereval). Results SociaBench obtained on this platform by running the full test set under the benchmark's current reproduction protocol. Only these results are ranked.

## Results

| View | Rank | Character consistency | 95% CI | Samples | Model version | Evaluated at | Data version |
| --- | --- | --- | --- | --- | --- | --- | --- |
| Chinese | 7 / 13 | 3.251 | [3.227, 3.272] | 4531 | — | 2026-11-01T14:29Z | 13-1793547358759-r1793034246936-p6065 |

## Scores by group

| View | Conversational ability | Character consistency | Role-playing attractiveness | Personality back-testing |
| --- | --- | --- | --- | --- |
| Chinese | 4.110 | 3.251 | 3.573 | — |

## Scores by dimension

| View | Fluency | Coherency | Consistency | Knowledge exposure | Knowledge accuracy | Knowledge hallucination | Persona behavior | Persona utterance | Human-likeness | Communication skills | Expression diversity | Empathy | MBTI accuracy |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| Chinese | 3.867 | 4.244 | 4.219 | 2.304 | 3.141 | 3.289 | 4.070 | 3.453 | 4.061 | 3.380 | 3.607 | 3.246 | — |

## Sources and methods

- Original source: Gaoling School of AI, Renmin University of China (Tu et al.), ACL 2024, "CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation": https://arxiv.org/abs/2401.01275
- Test set and official implementation: https://github.com/morecry/CharacterEval
- Reproduction report (SociaBench): https://sociabench.com/b/charactereval/methodology
- Leaderboard: https://sociabench.com/b/charactereval

## Citation

If you repost or cite any evaluation result from this site, credit "SociaBench (AI Social Intelligence Leaderboards)" and link to this site: https://sociabench.com/models/charactereval/gpt-6-astra.