TheAgentCompany

Source-method reading and retained catalogue information are distinguished. Publication does not establish independent evidence or bilingual editorial review.

Measurement construct

Can agents perform diverse digital work in a simulated software company?

Task population

A self-contained environment supplies internal sites, files, tools and coworkers; checkpoints award partial credit with a substantial full-completion bonus.

Scoring and failure modes

Checkpoint partial credit plus 50% credit awarded only for full completion.

System conditions

Self-contained simulated company; feasibility-tested but no representative human baseline.

Statistical meaning

Source-reported result statements; this does not establish trial counts, denominators or an estimator: The scoring adds 50% credit only when every checkpoint is completed (§4.1).

Validity and interpretation

Simulated coworkers and sites restrict workplace realism; task feasibility checks do not establish human–agent productivity comparisons.

Appropriate research use

Model recommendation: report complete-task rate alongside partial score and avoid unsupported labor-substitution estimates.

• TheAgentCompany · AbstractSelected original resource https://arxiv.org/html/2412.14161; sha256:b5a66c55f2181c8ab279c5bd6ceb0f92badc66ae8378c0dc12dcedee6204b876; archived source capture; exact capture time not independently established
• TheAgentCompany · §4.1 Evaluation MetricsSelected original resource https://arxiv.org/html/2412.14161; sha256:b5a66c55f2181c8ab279c5bd6ceb0f92badc66ae8378c0dc12dcedee6204b876; archived source capture; exact capture time not independently established
• TheAgentCompany · Appendix J LimitationSelected original resource https://arxiv.org/html/2412.14161; sha256:b5a66c55f2181c8ab279c5bd6ceb0f92badc66ae8378c0dc12dcedee6204b876; archived source capture; exact capture time not independently established