Ukuthi ukuhlaziywa kwedatha okukhulu kangakanani kuzoshintsha umnotho wethu

Ezweni elisheshayo, eliqhutshwa ubuchwepheshe lapho abathengi bengakwazi uku-oda yonke into kusuka ku-pizza kuya ku-Porsches ku-inthanethi, kuyilapho ngesikhathi esifanayo bebuyekeza ama-akhawunti abo e-Twitter, Facebook, kanye ne-Instagram ngokuswayipha okukodwa komakhalekhukhwini babo abahlakaniphile, akumangazi ukuthi isamba sedatha engaba usizo umhlaba ukhula ngokugxumagxuma nemingcele.

Eqinisweni, ngokwe-IBM, usuku ngalunye abantu badala amabhayithi edatha angama-quintillion angu-2.5. Izibalo ezinkulu kangaka zedatha kunzima ukuzicubungula ngenxa yenani lazo elivelele nokuba yinkimbinkimbi, ngaleyo ndlela kwakheka lokho okwaziwa ngokuthi "idatha enkulu."

Ngo-2009, kwalinganiselwa ukuthi amabhizinisi kuyo yonke imikhakha yomnotho wase-US anabasebenzi abayi-1,000 noma ngaphezulu akhiqize cishe ama-terabytes angu-200 edatha egciniwe engase ibe usizo.

Ukuhlaziywa kwedatha okukhulu ukuthuthukisa ukukhula kuyo yonke imikhakha

Manje njengoba kunedatha eningi ezulazulayo, amabhizinisi nezinye izinkampani ezihlukahlukene, nemikhakha ingahlanganisa amasethi edatha ahlukahlukene ukuze kukhishwe noma yiluphi ulwazi oluwusizo.

U-Wayne Hansen, umphathi we-Student Technology Center eNyuvesi yaseNew Brunswick e-Saint John uchaza idatha enkulu ngokuthi "ibinzana lokubamba elichaza umqondo wokuthi manje sesingahlaziya amasethi amakhulu edatha. Ngokuyisisekelo sithwebula idatha eyengeziwe, yomuntu siqu, yomphakathi. , ezesayensi, nokunye, futhi manje amandla ekhompyutha afinyelele isivinini esisivumela ukuthi sihlaziye le datha ngokucophelela."

Intshisekelo enkulu ka-Hansen yezobuchwepheshe isekusebenzisaneni phakathi kobuchwepheshe namasiko. Uyakwazi ukuhlola le ntshisekelo ngedatha enkulu. Isibonelo ulwazi oluvela emadolobheni ahlakaniphile, olufana nobugebengu nezinga lentela, inani labantu, kanye nezibalo zabantu kungahlaziywa ukuze kubhekwe okuvamile mayelana nalelo dolobha namasiko.

Idatha enkulu ikhiqizwa ngezindlela ezihlukahlukene. Kusukela kumasiginali weselula kanye nenkundla yezokuxhumana ukuya kokuthenga okwenziwayo ku-inthanethi nasezitolo, idatha iyadalwa futhi ishintshwa njalo eduze kwethu. Le datha ingase igcinwe ukuze isetshenziswe esikhathini esizayo.

Kunezici ezintathu ezibalulekile zedatha enkulu ezenza kube usizo ezimakethe ezihlukahlukene, zaziwa ngokuthi ama-v amathathu; ivolumu, isivinini, nokuhlukahluka. Ivolumu, ibhekisela enanini ledatha edaliwe futhi engasetshenziswa, efinyelela kuma-terabytes nama-petabytes. Isivinini, okusho isivinini lapho idatha itholwa futhi icutshungulwa khona ngaphambi kokuthi ingasasebenzi ngaphakathi komkhakha othile noma uma kuqhathaniswa namanye amasethi edatha. Futhi ukuhlukahluka, okusho ukuthi ukwehlukahlukana okwengeziwe phakathi kwezinhlobo zamasethi edatha asetshenziswa kuba ngcono futhi kunembe kakhudlwana imiphumela nezibikezelo.

Ukuhlaziywa kwedatha enkulu kunamandla amakhulu ezimakethe ezahlukahlukene. Kusukela kusimo sezulu nobuchwepheshe, kuya kwezamabhizinisi nezokuxhumana, idatha enkulu ibambe ithuba lokuqhubekisela phambili ukuthengisa, ukukhiqiza, nokubikezela imiphumela yesikhathi esizayo yemikhiqizo, ukuthengisa namasevisi. Amathuba awapheli.

"Isisekelo siwukuthi ngedatha eyanele yonke into iyakwazi ukubikezelwa," kusho uHansen. Amaphethini angembulwa, kusungulwe imizila, futhi izibalo zivezwe. Ngezibikezelo ezinjalo kufika umkhawulo omusha wokuncintisana cishe kuyo yonke imikhakha. Ukuhlaziywa kwedatha enkulu kube yingxenye ebalulekile empumelelweni noma ekuhlulekeni kwebhizinisi elisha, nokudala amasha.

Zicabange uyisisebenzi enkampanini edizayina izingubo zokugqoka eziqondiswe kubantu besifazane abaseminyakeni yabo eyishumi nambili kuya kweyamashumi amabili. Bekungeke yini kube lula, futhi kube nenzuzo, uma ungakwazi ukubikezela ngokushesha nangokunembile ukuthengiswa okungase kube khona ukusho izithende eziphakeme ze-sequin ezibomvu?

Yilapho ukuhlaziya okukhulu kwedatha kungena khona. Uma ukwazi ukusebenzisa kahle zonke izibalo ezifanele, njengokuthi bangaki abesifazane aba-ode izithende ezibomvu ze-sequin ku-inthanethi, futhi bangaki ababhale ku-tweet ngabo, noma bathumele amavidiyo e-YouTube ebhekisela ezithendeni ezibomvu eziphakeme, khona-ke nawe ungabikezela ngokunembile ukuthi umkhiqizo wakho uzokwenza kahle kangakanani ngaphambi kokuthi ufike ngisho naseshalofini.Ngalokho kuqeda umsebenzi wokuqagela futhi kwandise amathuba empumelelo.

Ikhono lokwenza izibikezelo ezinjalo liba yisidingo esikhulayo futhi kanjalo nokuthuthukiswa kokuhlaziywa kwedatha enkulu.

I-Pulse Group PLC, i-ejensi yocwaningo lwedijithali e-Asia, yinkampani eyodwa eye yagxumela eqoqweni elikhulu ledatha. I-Pulse ihlose ukutshala izimali ezinkulu esikhathini esizayo esiseduze kulo mkhakha okhulayo. Uhlelo lwabo lokutshala izimali luhlanganisa ukuthuthukisa isikhungo esisha sokuhlaziya idatha eCyberjaya.

Izikhungo ezinjalo zizoba nesibopho sokuhlanganisa konke ukusakazwa kwezinsuku ezifanele zeklayenti nokuyihlaziya ngendlela esheshayo nephumelelayo ukuze kutholwe ulwazi olubalulekile, olufana namaphethini nokuhlotshaniswa okungenzeka kube usizo ebhizinisini noma ezinhlosweni zeklayenti.

"Singakwazi ukusebenzisa ukuhlaziywa kwedatha enkulu," kusho u-Hansen, "futhi senze izitatimende ezijwayelekile." Lokhu kuhlanganisa kunamandla okuthuthukisa yonke imikhakha, okuhlanganisa ibhizinisi, imfundo, inkundla yezokuxhumana, kanye nobuchwepheshe.

Izinkampani eziningi zinedatha eziyidingayo ukuze zenze izibikezelo, kodwa azinawo amandla okuxhuma amaphakethe ahlukahlukene wedatha futhi ziwaphule ngendlela yokuthi awenze abe wusizo.

U-Bob Chua, isikhulu esiphezulu sakwaPulse, uyavuma ukuthi ibhizinisi labo elisha elikhulu ledatha, elaziwa ngePulsate, lingase libe ukugxila kwabo okuyinhloko. Umnyakazo ohlakaniphile wezezimali njengoba imakethe yedatha enkulu kulindeleke ukuthi ikhule ngaphezu kwamaRandi ayizigidi eziyizinkulungwane ezingama-50 eminyakeni emihlanu ezayo.

Eminyakeni emithathu ezayo i-Pulsate ihlela ukwenza intuthuko ekuhlaziyeni idatha enkulu futhi idale amathuba emisebenzi angama-200 eqophelweni eliphezulu kososayensi bedatha. "Kokubili ukuqoqa nokuhlaziya idatha kuzodinga amasethi amakhono akhethekile," kuphawula u-Hansen, "ngaleyo ndlela kuvulwe amathuba amasha."

Ukuze benze le misebenzi emisha, abasebenzi kuzodingeka baqeqeshwe ngendlela efanele. I-Pulse Group iphinde ihlose ukuqala esinye sezikhungo zokuqala zokuqeqesha ososayensi bedatha emhlabeni ukuze bahambisane nesikhungo sabo esisha sokuhlaziya idatha, futhi bahlangabezane nesidingo esikhulayo sabahlaziyi bedatha.

Idatha enkulu ingaba neminye imiphumela emihle emhlabeni wezemfundo ngaphandle kokunikeza amathuba amasha nolwazi lokufunda. U-Hansen uthi ukuziphatha kwabafundi kungahlaziywa ngedatha enkulu ehlaziywe ukuze kuthuthukiswe umkhakha wezemfundo. "Ekugcineni umgomo uwukusebenzisa idatha enjalo eqoqiwe ukuthuthukisa ukuzizwisa kwabafundi [kanye] nokwandisa izinombolo zokugcinwa."

Phakathi kokwakhiwa kwamathuba emisebenzi emisha namathuba emfundo, kanye nezibikezelo ezingase zibe khona kanye nokukhula kwamabhizinisi, idatha enkulu ibonakala iyinhle yonke into. Nokho, kukhona ukungalungi kanye namaphutha akhona ngokuhlaziywa kanye nokusetshenziswa kwenani elikhulu kangaka lolwazi.

Inkinga eyodwa okufanele ixazululwe ukuthi yiluphi ulwazi oluwumdlalo wamahhala wezinkampani ezahlukahlukene ongazisebenzisa njengamasethi azo wedatha. Izinkinga ezibandakanya ubumfihlo nokuvikeleka kuzodingeka zixazululwe. Futhi umnikazi waluphi ulwazi umbuzo ozodinga ukuphendulwa. Uma idatha ithunyelwa njalo futhi yamukelwe umugqa phakathi kwempahla yomuntu siqu nezindawo zomphakathi uyafiphala.

Okwesibili akulona lonke ulwazi oluwusizo, noma alunamsebenzi ngaphandle kokuthi luhlaziywe kahle. Amanye amasethi edatha ngeke asho lutho ngaphandle kokuthi ehlanganiswe nedatha efanele nehambisanayo. Okusho ukuthi ngaphandle uma inkampani ikwazi ukufinyelela yonke imininingwane eyidingayo kanye nolwazi lokuthi ingayithola kanjani futhi iyihlaziye kahle, khona-ke idatha enkulu iwukumosha isikhathi sayo.

Futhi idatha ikhula ngesivinini esishaqisayo. Amaphesenti angamashumi ayisishiyagalolunye edatha yomhlaba adalwe eminyakeni emibili edlule iyodwa, futhi lelo nani likhula kancane kancane. Uma idatha emisha efanelekile idalwa ngokushesha kunalokho esingakwazi ukuyihlaziya, khona-ke ukuhlaziywa kwedatha okukhulu kuba kungasebenzi. Phela, imiphumela mihle njengokwaziswa okusetshenziswayo.