Mefuta ea Supersized AI: Sistimi e kholo ea likhomphutha e se e fihlile pheletsong

• Author:
• Lebitso la sengoli

  Quantumrun Ponelopele
• June 2, 2023

Ho tloha ka 2012, tsoelo-pele e kholo ea bohlale ba maiketsetso (AI) e 'nile ea etsahala khafetsa, haholo-holo e khannoang ke ho eketseha ha matla a k'homphieutha ("compute" ka nako e khutšoanyane). E 'ngoe ea mehlala e kholo ka ho fetisisa, e qalileng ka 2020, e sebelisitsoe ka makhetlo a 600,000 ho feta mohlala oa pele ho tloha 2012. Bafuputsi ba OpenAI ba hlokometse mokhoa ona ka 2018 mme ba lemosa hore sekhahla sena sa kgolo se ke ke sa tšoarella nako e telele.

Boemo bo phahameng ba mefuta ea AI

Bahlahisi ba bangata ba ho ithuta ka mochini (ML) ba sebelisa mefuta ea li-transformer bakeng sa thuto e tebileng (DL) ka lebaka la bokhoni ba bona bo bonahalang bo se na moeli. Mehlala ea mefuta ena e kenyelletsa Generative Pre-trained Transformer 2 (GPT-2), GPT-3, Bidirectional Encoder Representations ho tloha Transformers (BERT), le Turing Natural Language Generation (NLG). Hangata li-algorithms tsena li na le ts'ebeliso ea lefats'e ea nnete joalo ka phetolelo ea mochini kapa ponelopele ea letoto la nako. 

Mekhoa ea bohlale ba maiketsetso e tlameha ho hola ho amohela lintlha tse ngata tsa koetliso le ho ba betere ho tse boletsoeng esale pele. Tlhokahalo ena e lebisitse ho phahama ha mefuta e phahameng ka ho fetesisa e nang le li-parameter tse libilione (liphetoho tse sebelisoang ke li-algorithms ho etsa likhakanyo). Mefuta ena e emeloa ke OpenAI's GPT-3 (le tšebelisano ea eona ea ChatGPT e phatlalalitsoeng ka Tšitoe 2022), PanGu-alpha e thehiloeng China, Nvidia's Megatron-Turing NLG, le DeepMind's Gopher. Ka 2020, koetliso ea GPT-3 e ne e hloka k'homphieutha e kholo e neng e le har'a tse hlano tse kholo ka ho fetisisa lefatšeng. 

Leha ho le joalo, mefuta ena e batla e hloka lintlha tse ngata tsa koetliso tse sebelisang matla. Ho ithuta ho tebileng ho itšetlehile ka bokhoni ba eona ba ho sebelisa matla a maholo a khomphutha, empa sena se tla fetoha haufinyane. Koetliso e theko e boima, ho na le meeli ho li-chip tsa AI, 'me ho koetlisa mefuta e meholo ho koala li-processor, ho etsa hore ho be thata ho li laola kaofela. Ha parameter e le kholoanyane, ho bitsa chelete e ngata ho koetlisa mefuta ena. Litsebi lia lumela hore ho tla fihla ntlha eo ho eona mefuta ea AI e phahameng haholo e ka bang theko e boima haholo 'me e hloka matla ho e koetlisa. 

Tšusumetso e senyang

Ka 2020, OpenAI e hakantse palo e tlase ea khomphutha e hlokahalang ho koetlisa mefuta e mengata, e ipapisitse le palo ea liparamente le boholo ba datha. Li-equation tsena li bontša hore na ML e hloka hore data e fete marang-rang ka makhetlo a mangata, hore na compute bakeng sa palo e 'ngoe le e' ngoe e phahama joang ha palo ea li-parameter e ntse e eketseha, le hore na ho hlokahala boitsebiso bo bokae ha palo ea li-parameter e ntse e hōla.

Ho ea ka likhakanyo tsa Open AI, ho nka hore bahlahisi ba ka finyella katleho e kholo, ho haha ​​​​GPT-4 (e kholo ka makhetlo a 100 ho feta GPT-3 (17.5 trillion parameters)) ho tla hloka 7,600 graphics processing units (GPUs) e sebetsang bonyane selemo se le seng 'me e bitsa chelete e ka bang 200. USD $ limilione tse 100. Mohlala oa 83,000-trillion parameter o tla hloka 2 GPUs ho o matlafatsa bakeng sa selemo, o bitsa chelete e fetang USD $XNUMX bilione.

Leha ho le joalo, lifeme tsa theknoloji li ntse li sebelisana 'me li tšela matsete mefuteng ea tsona e ntseng e hola ea AI ha tlhoko ea litharollo tsa ML e ntse e hola. Mohlala, Baidu e thehiloeng China le Peng Cheng Lab e lokolitse PCL-BAIDU Wenxin, e nang le li-parameter tse limilione tse likete tse 280. PCL-BAIDU e se e ntse e sebelisoa ke Baidu's news feeds, search engine, and digital assistant. 

Mofuta oa morao-rao oa lenaneo la Go-playing, o entsoeng ke DeepMind ka December 2021, o na le liparamente tse limilione tse likete tse 280. Mefuta ea Google Switch-Transformer-GLaM e na le liparamente tse makatsang tsa 1 trillion le 1.2 trillion ka ho latellana. Wu Dao 2.0 ho tsoa Beijing Academy of AI e kholo le ho feta mme ho tlalehiloe hore e na le li-parameter tse 1.75 trillion. Ha litoropo tse bohlale le li-automation li ntse li tsoela pele ho baka litšitiso, litsebi ha li na bonnete ba hore na AI compute e tla tšehetsa bokamoso bo joalo joang. 

Liphello tsa mefuta e phahameng ea AI

Litlamorao tse pharalletseng tsa mefuta e phahameng ea AI li ka kenyelletsa: 

• Keketseho ea matsete le menyetla ea ho nts'etsapele lisebelisoa tsa khomphutha tsa AI tse jang matla a fokolang. 
• Khatelo-pele ea AI e ile ea fokotseha ka lebaka la khaello ea matla a khomphutha, e leng se lebisang ho licheleteng tse ngata bakeng sa mahlale a baballang matla le tharollo.
• Bahlahisi ba ML ba theha mefuta e meng ntle le li-transformer, tse ka lebisang ho sibolloeng le ho nchafatsoa bakeng sa li-algorithms tse sebetsang hantle haholoanyane.
• Litharollo tsa AI tse shebaneng le mathata a bohareng ba ts'ebeliso, ho lokisa komporo ka nepo kapa ho fetola kamoo ho hlokahalang ho fapana le ho phahamisa maemo.
• Lintlha tse rarahaneng haholoanyane tse lumellang mananeo a AI ho etsa likhakanyo tse betere, ho kenyeletsoa bolepi ba leholimo, ho sibolloa ha sebaka, tlhahlobo ea bongaka, le khoebo ea machabeng.

Lipotso tseo u ka fanang ka maikutlo ho tsona

• Haeba u sebetsa lekaleng la AI, ke tsoelo-pele efe ea ho theha mefuta e metle ea ML?
• Ke melemo efe e meng e ka bang teng ea mehlala e nang le tlhaiso-leseling e batsi ea koetliso eo u ka ithutang ho eona?