PolyCodeEval: Benchmarking Multilingual Code Generation from Functions to Repositories
It is shown that existing approaches still struggle to correctly generate complete code fragments across granularities and languages, and method rankings also vary across task granularities and programming languages, highlighting the importance of multilingual, multi-granularity evaluation for comprehensively assessing...