Nevertheless,
Ai developers: shock study upsets new: In addition,
Ai developers: shock study upsets:
According to social networks. However, many media, chatbots work like a magic wand that makes all the tasks simple. However, It is very notable among programmers. Consequently, who do not hesitate to consider all those who do not use artificial intelligence to generate code like has-been.
Advertisement
What if this craze for AI was ultimately counterproductive? Meanwhile, This is the question that METR (Model Evaluation & Threat Research) asked itself. For example, non -profit research organization which includes former employees of Openai, Anthropic and other IA companies. Furthermore, They conducted a study with 16 developers with at least five years of experience in open-source projects. Moreover, These participants had to complete 246 tasks. with ai developers: shock study upsets new or without the help of tools based on ai developers: shock study upsets artificial intelligence. They could use the tools they are used to, mainly Cursor Pro, based on Claude 3.5/3.7 Sonnet.
METR’s study: a realistic approach – Ai developers: shock study upsets – Ai developers: shock study upsets new
The tasks in question are not artificial. These are bug corrections or features requests for the projects on which they are already working. A notable difference with other studies of the same kind that create tasks from scratch that do not necessarily. represent real situations.
Before starting, volunteers believe that AI will allow them to reduce the time necessary to complete the 24 %tasks. When researchers ask them the question after finishing, they think that AI allowed them to save time around 20 %.
Advertisement
The reality is quite different. Not only does AI not save them time. but they give an average ai developers: shock study upsets of 19 % more time. This shows a huge difference between their perception and their real use.
Where did the time saved? Real causes of loss of efficiency
By analyzing the recordings of the screens. the researchers still discovered that the AI allows developers to spend less time writing. testing their code, as well as to do research. What makes them waste time is the writing of prompts. verification of the code generated, or the expectation of an AI response. In addition, they spend more time doing nothing (no activity on the screen), probably busy thinking. The developers were forced to modify more than 56 % of the code generated, which occupied 9 % of the total time.
However, researchers point out that ai developers: shock study upsets new this does not mean that IA tools are not useful in other contexts. The study included developers with some experience, and selection could ai developers: shock study upsets include biases. Additionally, The results could be different with less experienced programmers, or less complex tasks. But this tends to suggest that part of the buzz around these tools does not reflect real use.
Advertisement
Further reading: The RN publishes its report on deindustrialization with the benevolence of the central block – CFF: traffic is disturbed between Lausanne and Friborg – Profits and dollar: challenges of emerging markets – Google buys 3 gigawatts from Brookfield; The web giant signs an agreement never seen by a company – Byd could reimburse millions of dollars in grants following suspicious irregularities.
ai developers: shock study upsets new
Further reading: “We pay almost nothing for electricity”: the French village which challenges invoices thanks to photovoltaic solar surprises the whole world – “While France fears the supervision of the IMF, why have we put itself in such a kneader?” – France breaks its electricity record at negative prices and this is not good news – Loro Piana, a subsidiary of LVMH, placed under judicial administration – A big week for the financial markets.