Pengaturcara AI yang paling berkuasa di dunia: Dengan berkat GPT-4o, ia hanya mengambil masa 84 saat untuk menyelesaikan permintaan

Semua orang dalam senarai menunggu.

Model besar sedang pesat membangun di jalan "menggantikan pengaturcara manusia".

Pada Mac tahun ini, jurutera perisian kecerdasan buatan Devin meletupkan komuniti AI Produk ini dikuasakan oleh model bahasa besar (LLM) asas OpenAI-4 dan boleh menulis dan mengedit secara bebas selepas menerima arahan teks bahasa semula jadi. kod.

Tetapi dalam bidang AI generatif, pembangunan pesat adalah tema utama, dan kini teknologi itu berulang lagi.

Minggu ini, syarikat permulaan yang disokong Y Combinator yang dipanggil Cosine mengumumkan pelancaran jurutera AI autonomi baharunya, Genie. Syarikat itu berkata Genie mudah mengatasi Devin, menjaringkan 30% pada penanda aras pihak ketiga SWE-Bench, manakala Devin hanya memperoleh 13.8%.

Alat baharu ini malah mengatasi Q Amazon dan Kod Droid Kilang sebanyak 19% dan kini merupakan pengaturcara AI berprestasi terbaik di dunia. Prestasi W Genie pada penanda aras SWE-Bench, dan perbandingan dengan model kod AI yang lain.

^{"Model ini lebih daripada penanda aras: ia dilatih dari bawah dengan matlamat untuk berfikir dan bertindak seperti manusia SWE (Jurutera Perisian)," Pengasas Bersama dan Ketua Pegawai Eksekutif Cosine Alistair Pullen berkata.}

Jin yang boleh membetulkan pepijat dan menulis kod

Sebagai model kejuruteraan perisian AI lanjutan, Genie boleh mengendalikan pelbagai tugas pengekodan mengikut arahan jurutera manusia, termasuk pembetulan pepijat dan fungsi binaan pemfaktoran semula kod, ujian kod, dsb.

Genie boleh berjalan sepenuhnya secara autonomi atau bekerjasama dengan pengguna untuk menyelesaikan tugasan.

Ia menyokong berbilang bahasa pengaturcaraan, seperti yang ditunjukkan dalam laporan teknikal, termasuk JavaScript, Python, TypeScript, TSX, Java, C#, C++, C, Rust, Scala, Kotlin, Swift, Golang, PHP, Ruby.

Cosine mendakwa bahawa Jin boleh mensimulasikan proses kognitif jurutera manusia. "Biarkan ia memerhati bagaimana jurutera manusia bekerja dan meniru proses itu."

Isu keselamatan sentiasa menjadi kebimbangan semua orang Kod yang dijana oleh Genie disimpan dalam repositori GitHub pengguna, jadi Cosine tidak akan menyimpan salinan kod, sekali gus mengelakkan risiko keselamatan yang datang bersamanya.

Selain itu, platform perisian Cosine telah menyepadukan Slack dan pemberitahuan sistem, yang seperti rakan sekerja AI, mengingatkan pengguna tentang status atau isu pembenderaan.

Alistair Pullen menunjukkan cara menggunakan Genie untuk menyelesaikan masalah sebenar. Sasaran ialah isu pada GitHub Kami hanya perlu melepaskan pautan terus ke dalamnya, dan AI akan menganalisis masalah secara automatik dan mula memikirkan fail yang diperlukan untuk menyelesaikan masalah sehingga keperluan dipenuhi.

Kemudian, Genie akan mula cuba memecahkan masalah kepada banyak langkah penyelesaian, dan kemudian menjana kod. .

Keputusan output akhir: dua fail, 17 ujian, hanya 84 saat.

I don’t know how many times faster than human programmers.

Long context is powered by OpenAI models

Unlike many AI models that rely on base models supplemented by a handful of tools, Genie is developed through a proprietary process.

As far as models go, Genie is built on a (currently) non-universal variant of GPT-4o, which OpenAI allows Cosine to train as part of the Experimental Access Program.

We learned from the technical report that when researchers started building Genie, they could only fine-tune a relatively short context window model in the range of 16-32k.

In order to solve this problem, the team conducted a lot of early exploration of these models and trained them on a large data set of more than 100 million tokens. Although it was found that the architecture has certain advantages, it still faces A limit on the amount of information a model can process in a given amount of time.

After trying various compression/chunking methods, the team decided that the only solution was to use a larger context model, even though there was no model available at the time.

Fortunately, not long after, OpenAI models that ensured the training of long context appeared.

Cosine said in its blog post that they spent nearly a year organizing the data set. In the most recent training run, Genie was trained on billions of token data, and the selected data included The programming language that users are currently most concerned about. The following is the proportion of data in different programming languages ​​in the process of training Genie:

The following is the proportion of data for different functions such as bug repair and reconstruction:

In terms of price, according to Pullen, Genie Pricing will initially be divided into two tiers:

• Entry-level option priced around $20. This level will have some functions and usage restrictions, suitable for individuals and small teams;
• Enterprise-level options provide extended functions and almost unlimited use, just like having an AI colleague who is proficient in coding. But pricing at this tier will be higher.

The launch of Genie has profound implications for software development teams, especially those looking to increase productivity and reduce the time spent on daily tasks. With its ability to autonomously handle complex programming challenges, Genie may change how engineering resources are allocated, allowing teams to focus on more strategic initiatives.

Pullen said that having engineering resources no longer being a limitation was a huge motivator for him, especially since starting the company. He believes that the value of an AI colleague who can quickly enter unknown code bases and solve unseen problems is obvious and has a huge impact on the world.

In the future, the company intends to expand its model portfolio to include smaller models for simple tasks and larger models capable of handling more complex challenges. Additionally, Cosine plans to expand its work into the open source community.

Genie is now available to some users, but wider access is not yet fully available.

Application address: https://cosine.sh/register

Founding team: only five people

Proposed Genie startup Cosine by Pullen, Sam Stenner and Yang Li Founded in 2022, its mission is to push the boundaries of AI by applying human reasoning to solve complex problems. Clearly, their efforts begin with software engineering.

Among them, Yang Li is a Chinese who graduated from Oxford University with a master's degree and was selected to the Forbes 30 Under 30 European list in 2021.

Cosine has raised $2.5 million in seed funding from Uphonest and SOMA Capital, with Lakestar, Focal and others also participating.

The team may be small, but Cosine has already made significant progress in the field of AI, and Genie is just the beginning.

"We firmly believe that we can build human-level reasoning capabilities for any job and industry," Pullen said in the announcement article."Kejuruteraan perisian hanyalah titik permulaan yang paling intuitif, kami akan mendedahkan semua perkara lain yang sedang kami usahakan." -pertimbangan-untuk-membantu-organisasi-melaksanakan-kod-kelakuan-ai/

https://cosine.sh/blog/genie-technical-report

//cosine.sh/blog/state-of-the-art

Atas ialah kandungan terperinci Pengaturcara AI yang paling berkuasa di dunia: Dengan berkat GPT-4o, ia hanya mengambil masa 84 saat untuk menyelesaikan permintaan. Untuk maklumat lanjut, sila ikut artikel berkaitan lain di laman web China PHP!