OpenHarmony, an emerging open-source mobile platform, is rapidly gaining attention in the mobile development community. Its fast-evolving Software Development Kit (SDK) introduces numerous Application Programming Interfaces (APIs) to boost developer productivity but inevitably introduces compatibility challenges, an is...
We present OPENHARMONY BENCH, an app-level coding benchmark for evaluating LLM-based coding agents on OpenHarmony ArkTS applications. Unlike function-level benchmarks, it evaluates complete app-level changes: each task requires an agent to modify a buildable ArkTS project so that a requested behavior works end to end,...
Li Li, Han Hu, Tian-Jian Zhang et al.· 0 citations
An enhanced approach based on ITeM is proposed, referred as ITeM-HM, which incorporates specific OpenHarmony system features and achieves a 214% success-rate relative improvement over the original ITeM, which is primarily hindered by OpenHarmony-specific characteristics.