Mitundu ya Supersized AI: Makina akuluakulu apakompyuta akufika pachimake

• Author:
• Dzina la wolemba

  Quantumrun Foresight
• June 2, 2023

Kuyambira 2012, kupita patsogolo kwakukulu kwanzeru zopangapanga (AI) kwachitika pafupipafupi, makamaka motsogozedwa ndi kuchuluka kwamagetsi apakompyuta ("compute" mwachidule). Mmodzi mwa zitsanzo zazikulu kwambiri, zomwe zinayambika mu 2020, zinagwiritsidwa ntchito nthawi 600,000 kuposa chitsanzo choyamba kuchokera ku 2012. Ofufuza a OpenAI adawona izi mu 2018 ndipo anachenjeza kuti kukula kumeneku sikungakhale kosatha kwa nthawi yaitali.

Nkhani zazikuluzikulu za AI

Opanga makina ambiri ophunzirira makina (ML) amagwiritsa ntchito mitundu yosinthira kuti aphunzire mozama (DL) chifukwa cha kuthekera kwawo kopanda malire. Zitsanzo za zitsanzozi zikuphatikizapo Generative Pre-trained Transformer 2 (GPT-2), GPT-3, Bidirectional Encoder Representations from Transformers (BERT), ndi Turing Natural Language Generation (NLG). Ma algorithms awa nthawi zambiri amakhala ndi zochitika zenizeni padziko lapansi monga kumasulira kwamakina kapena kulosera zam'ndandanda wanthawi. 

Njira zanzeru zopangira zimayenera kukulitsidwa kuti zigwirizane ndi zambiri zophunzitsira komanso kukhala bwino pakulosera. Kufunika kumeneku kwadzetsa kukwera kwamitundu yayikulu yokhala ndi mabiliyoni a magawo (zosinthika zomwe zimagwiritsidwa ntchito ndi ma aligorivimu kulosera). Mitundu iyi imayimiridwa ndi OpenAI's GPT-3 (ndi kulumikizana kwake kwa ChatGPT komwe kudakhazikitsidwa mu Disembala 2022), PanGu-alpha yochokera ku China, Nvidia's Megatron-Turing NLG, ndi DeepMind's Gopher. Mu 2020, kuphunzitsa GPT-3 kunafunikira makompyuta apamwamba kwambiri omwe anali m'gulu la asanu akuluakulu padziko lonse lapansi. 

Komabe, zitsanzozi zimafuna zambiri zophunzitsira zogwiritsa ntchito mphamvu zambiri. Kuphunzira mozama kwadalira luso lake logwiritsa ntchito mphamvu zochulukirapo, koma izi zisintha posachedwa. Maphunziro ndi okwera mtengo, pali malire ku tchipisi ta AI, ndipo kuphunzitsa mitundu yayikulu kumatsekereza mapurosesa, zomwe zimapangitsa kuti zikhale zovuta kuziwongolera zonse. Kukula kwa parameter, kumawononga ndalama zophunzitsira zitsanzozi. Akatswiri amavomereza kuti pafika nthawi yomwe mitundu yapamwamba ya AI ingakhale yodula kwambiri komanso yopatsa mphamvu kuti iphunzitse. 

Zosokoneza

Mu 2020, OpenAI idayerekeza kuchuluka kwa mawerengedwe ofunikira pophunzitsa mitundu ingapo, kutengera kuchuluka kwa magawo ndi kukula kwa dataset. Ma equation awa amawerengera momwe ML imafuna kuti deta idutse pa netiweki kangapo, momwe kuwerengera kwa chiphaso chilichonse kumakwera pamene chiwerengero cha magawo chikuwonjezeka, komanso kuchuluka kwa deta yomwe ikufunika pamene chiwerengero cha magawo chikukula.

Malinga ndi kuyerekezera kwa Open AI, poganiza kuti opanga atha kuchita bwino kwambiri, kumanga GPT-4 (yokulirapo nthawi 100 kuposa GPT-3 (magawo 17.5 thililiyoni) kungafune 7,600 graphics processing units (GPUs) yomwe ikuyenda kwa chaka chimodzi ndikuwononga pafupifupi chaka chimodzi. $200 miliyoni. Mtundu wa 100-trillion parameter ungafunike ma GPU 83,000 kuti uupangitse mphamvu kwa chaka chimodzi, zomwe zimawononga ndalama zoposa USD $2 biliyoni.

Komabe, makampani aukadaulo akhala akugwira ntchito limodzi ndikutsanulira ndalama mumitundu yawo yomwe ikukula kwambiri ya AI pomwe kufunikira kwa mayankho a ML kukukula. Mwachitsanzo, Baidu yochokera ku China ndi Peng Cheng Lab idatulutsa PCL-BAIDU Wenxin, yokhala ndi magawo 280 biliyoni. PCL-BAIDU ikugwiritsidwa kale ntchito ndi a Baidu atolankhani, makina osakira, ndi othandizira pakompyuta. 

Pulogalamu yaposachedwa ya Go-playing, yomwe DeepMind idapanga mu Disembala 2021, ili ndi magawo 280 biliyoni. Mitundu ya Google Switch-Transformer-GLaM ili ndi magawo odabwitsa a 1 thililiyoni ndi 1.2 thililiyoni motsatana. Wu Dao 2.0 wochokera ku Beijing Academy of AI ndi wamkulu kwambiri ndipo akuti ali ndi magawo 1.75 thililiyoni. Pamene mizinda yanzeru ndi makina akupitilira kusokoneza, akatswiri sakutsimikiza kuti AI compute ingathandizire bwanji tsogolo lotere. 

Zotsatira zamitundu yayikulu ya AI

Zotsatira zamitundu yayikulu ya AI zitha kuphatikiza: 

• Kuchulukitsa kwandalama ndi mwayi wopanga ma kompyuta a AI omwe amawononga mphamvu zochepa. 
• Kupita patsogolo kwa AI kunachedwetsedwa chifukwa cha kusowa kwa mphamvu zamakompyuta, zomwe zimapangitsa kuti pakhale ndalama zambiri zamaukadaulo ndi mayankho osunga mphamvu.
• Madivelopa a ML amapanga mitundu ina kusiyapo zosinthira, zomwe zitha kupangitsa kuti atulutsidwe ndikusintha ma algorithms abwino kwambiri.
• Mayankho a AI omwe amayang'ana kwambiri pazovuta zamagwiritsidwe ntchito, kusintha ma compute moyenerera kapena kusintha momwe kumafunikira m'malo mongokweza.
• Zolemba zovuta kwambiri zomwe zimalola mapulogalamu a AI kuchita zolosera bwino, kuphatikiza zolosera zanyengo, kupezeka kwa malo, matenda azachipatala, ndi malonda apadziko lonse lapansi.

Mafunso oti muyankhepo

• Ngati mumagwira ntchito mu gawo la AI, pali kupita patsogolo kotani pakupanga mitundu yabwino ya ML?
• Ndi maubwino ena ati omwe angakhalepo a zitsanzo zokhala ndi zambiri zophunzirira zomwe mungaphunzirepo?