{"id":46093,"date":"2025-11-17T11:34:54","date_gmt":"2025-11-17T03:34:54","guid":{"rendered":"https:\/\/www.1ai.net\/?p=46093"},"modified":"2025-11-17T11:34:54","modified_gmt":"2025-11-17T03:34:54","slug":"%e4%b8%9a%e7%95%8c%e9%a6%96%e4%b8%aa%ef%bc%8cjetbrains-%e5%8f%91%e5%b8%83-ai-%e7%bc%96%e7%a0%81%e6%99%ba%e8%83%bd%e4%bd%93%e5%9f%ba%e5%87%86%e6%b5%8b%e8%af%95%e5%b9%b3%e5%8f%b0-dpai-arena","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/46093.html","title":{"rendered":"First industry, Jetbrains release AI encoded smarts benchmarking platform DPAI Arena"},"content":{"rendered":"<p>MESSAGE NOVEMBER 17, PROGRAMMING IDE DEVELOPER <a href=\"https:\/\/www.1ai.net\/en\/tag\/jetbrains\" title=\"[See articles with [Jetbrains] label]\" target=\"_blank\" >JetBrains<\/a> Today, with the rise of AI, a key challenge now is to measure the efficiency gains that the AI support tool brings in the real world. To meet this challenge, Jet Brains decided to build\u00a0<strong>Developer Production AI Arena<\/strong>And finally dedicate it to Linux Foundation\u3002<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-46094\" title=\"489485e0j00t5upx2001kd000v9000cwp\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2025\/11\/489485e0j00t5upx2001kd000v900cwp.jpg\" alt=\"489485e0j00t5upx2001kd000v9000cwp\" width=\"1125\" height=\"464\" \/><\/p>\n<p><strong>DPAI Arena claims to be the first open, multilingual, multi-framework and multi-flow baseline testing platform in the industry<\/strong>, TO MEASURE AI ENCODING<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e6%99%ba%e8%83%bd%e4%bd%93\" title=\"[View articles tagged with [intelligent body]]\" target=\"_blank\" >Agent<\/a>Effectiveness in real-world software engineering missions. It is built around a flexible, path-based architecture that allows for fair and replicable comparisons of work streams (e.g. patches, bug amendments, PR reviews, test generation, static analysis, etc.)\u3002<\/p>\n<p>JetBrains states that the data sets on which the current baseline tests are based are outdated, cover a narrow range of technologies and focus too limited on the problem to the patchwork stream. With AI<a href=\"https:\/\/www.1ai.net\/en\/tag\/%e7%bc%96%e7%a0%81%e5%b7%a5%e5%85%b7\" title=\"_Other Organiser\" target=\"_blank\" >Coding Tools<\/a>As a result of rapid development, the industry still lacks a neutral and standard-based framework to measure their real impact on the efficiency of the developers ' work\u3002<\/p>\n<p>DPAI Arena brings measurable work efficiency into AI support software development\u3002<strong>Spring Benchmark<\/strong>\u00a0IT IS THE FIRST BENCHMARK OF THE PLATFORM, WHICH BRINGS WITH IT TECHNICAL STANDARDS FOR FUTURE CONTRIBUTIONS. FIRST, IT FULFILS THE DATA SET CREATION GUIDELINES AND DETAILS THE SUPPORTING EVALUATION FORMAT AND GENERAL RULES. SECOND, IT PROVIDES A BASIS FOR DECOMPOSING THE INFRASTRUCTURE, ENABLING ANYONE TO USE THEIR OWN DATA SETS (BYOD) AND RE-USE THE INFRASTRUCTURE FOR THEIR OWN ASSESSMENT\u3002<\/p>\n<p>Jetbrains is also following Spring AI Bench to expand the Java benchmark test stream in DPAI Arena and to work closely with the project ' s core team to promote more variable and multi-pathetic benchmarking in Java ecosystems\u3002<\/p>\n<p><strong>Jetbrains plans to dedicate this project to Linux Foundation<\/strong>To establish a pluralistic and inclusive technical steering committee to determine the future direction of the platform\u3002<\/p>\n<p>1AI with DPAI Arena<\/p>\n<p>https:\/\/dpaia.dev\/<\/p>","protected":false},"excerpt":{"rendered":"<p>On November 17th, the IDE developer Jetbrains wrote today that, with the rise of AI, a key challenge now is how to measure the efficiency gains in the real world brought about by AI support tools. In response to this challenge, Jetbrains decided to build the Development Agency AI Arena and eventually dedicate it to Linux Foundation. DPAI Arena claims to be the first open, multilingual, multi-framework and multi-flow benchmarking platform within the industry to measure the effectiveness of AI-coded smarts in real-world software engineering tasks. It revolves around a flexible, path-based architecture<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[146],"tags":[597,1355,4539],"collection":[],"class_list":["post-46093","post","type-post","status-publish","format-standard","hentry","category-news","tag-jetbrains","tag-1355","tag-4539"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/46093","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=46093"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/46093\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=46093"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=46093"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=46093"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=46093"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}