Byaravuzwe ko ibigo byikoranabuhanga byihutira gushaka GPU cyangwa munzira yo kubigura. Muri Mata, Umuyobozi mukuru wa Tesla, Elon Musk yaguze GPU 10,000 kandi avuga ko iyi sosiyete izakomeza kugura GPU nyinshi muri NVIDIA. Kuruhande rwibigo, abakozi ba IT nabo barimo kwihatira kwemeza ko GPU ihora ikoreshwa kugirango inyungu nyinshi zishoramari. Nyamara, ibigo bimwe bishobora gusanga mugihe umubare wa GPU wiyongera, ubupfura bwa GPU buragenda bukabije.
Niba amateka yatwigishije ikintu cyose kijyanye na comptabilite ikora cyane (HPC), ni uko kubika no guhuza imiyoboro bitagomba gutambwa amafaranga yo kwibanda cyane kubara. Niba ububiko budashobora kohereza amakuru neza mubice bibarwa, niyo waba ufite GPU nyinshi kwisi, ntuzagera kubikorwa byiza.
Nk’uko byatangajwe na Mike Matchett, umusesenguzi muri World World Big Data, moderi nto zishobora gukorerwa mu mutwe (RAM), bigatuma hashobora kwibandwaho cyane kubara. Nyamara, moderi nini nka ChatGPT hamwe na miliyari ya node ntishobora kubikwa mububiko kubera igiciro kinini.
Matchett agira ati: "Ntushobora guhuza amamiliyaridi y'urwibutso mu kwibuka, bityo kubika biba ngombwa kurushaho." Kubwamahirwe, kubika amakuru akenshi birengagizwa mugihe cyo gutegura.
Muri rusange, tutitaye kubibazo byakoreshejwe, hari ingingo enye zisanzwe mubikorwa byamahugurwa yicyitegererezo:
1. Amahugurwa y'icyitegererezo
2
3. Kubika amakuru
4. Kubara vuba
Mugihe cyo gukora no gukoresha moderi, ibisabwa byinshi bishyira imbere byihuse-byerekana-ibitekerezo (POC) cyangwa ibizamini byo kugerageza gutangiza amahugurwa yicyitegererezo, hamwe no kubika amakuru ntibikenewe kwitabwaho hejuru.
Nyamara, imbogamizi zishingiye ku kuba amahugurwa cyangwa kohereza imyanzuro bishobora kumara amezi cyangwa imyaka. Ibigo byinshi byihutisha ubunini bwikitegererezo muri iki gihe, kandi ibikorwa remezo bigomba kwaguka kugirango byemere imiterere na datasets zikura.
Ubushakashatsi bwakozwe na Google kuri miliyoni zamahugurwa ya ML yerekana ko impuzandengo ya 30% yigihe cyamahugurwa ikoreshwa kumuyoboro winjiza. Mugihe ubushakashatsi bwashize bwibanze mugutezimbere GPU kugirango yihutishe amahugurwa, ibibazo byinshi biracyahari mugutezimbere ibice bitandukanye byumuyoboro. Iyo ufite imbaraga zikomeye zo kubara, icyuho nyacyo gihinduka uburyo bwihuse ushobora kugaburira amakuru mubibare kugirango ubone ibisubizo.
By'umwihariko, imbogamizi mu kubika no gucunga amakuru bisaba igenamigambi ryo gukura kwamakuru, bikwemerera guhora ukuramo agaciro kamakuru uko utera imbere, cyane cyane iyo winjiye mubibazo byinshi byo gukoresha nko kwiga byimbitse hamwe n’imiyoboro y’imitsi, ibyo bikaba bisabwa cyane kuri ububiko ukurikije ubushobozi, imikorere, nubunini.
By'umwihariko:
Ubunini
Kwiga imashini bisaba gukoresha amakuru menshi, kandi uko ingano yamakuru yiyongera, ubwiza bwikitegererezo nabwo buratera imbere. Ibi bivuze ko ubucuruzi bugomba gukusanya no kubika amakuru menshi buri munsi. Iyo ububiko budashobora gupimwa, akazi-gakubiyemo akazi kenshi gatera icyuho, kugabanya imikorere kandi bikavamo igihe kinini cya GPU.
Guhinduka
Inkunga ihindagurika kuri protocole nyinshi (harimo NFS, SMB, HTTP, FTP, HDFS, na S3) irakenewe kugirango ihuze ibikenewe muri sisitemu zitandukanye, aho kugarukira ku bwoko bumwe bwibidukikije.
Ubukererwe
I / O ubukererwe nibyingenzi mukubaka no gukoresha moderi nkuko amakuru asomwa kandi agasubirwamo inshuro nyinshi. Kugabanya ubukererwe bwa I / O birashobora kugabanya igihe cyamahugurwa yicyitegererezo iminsi cyangwa ukwezi. Iterambere ryihuse ryihuse risobanura neza inyungu zubucuruzi.
Ibicuruzwa
Kwinjiza sisitemu yo kubika ningirakamaro mumahugurwa meza yicyitegererezo. Inzira zamahugurwa zirimo amakuru menshi, mubisanzwe muri terabaýt kumasaha.
Kubangikanya
Kugirango ugere kumurongo mwinshi, imyitozo yimyitozo igabanya ibikorwa mubikorwa byinshi bisa. Ibi akenshi bivuze ko imashini yiga algorithms igera kuri dosiye imwe mubikorwa byinshi (birashoboka kuri seriveri nyinshi zifatika) icyarimwe. Sisitemu yo kubika igomba gukemura ibisabwa icyarimwe itabangamiye imikorere.
Nubushobozi bwayo buhebuje mubukererwe buke, ibicuruzwa byinshi byinjira, hamwe nini nini igereranya I / O, Dell PowerScale nububiko bwiza bwuzuzanya na GPU yihuta. PowerScale igabanya neza igihe gikenewe kubisesengura byerekana imyitozo kandi igerageza imibare myinshi-terabyte. Muri PowerScale yose-flash ububiko, umurongo wiyongera inshuro 18, ukuraho icyuho cya I / O, kandi urashobora kongerwaho mumasoko asanzwe ya Isilon kugirango yihute kandi ufungure agaciro k'amakuru menshi atubatswe.
Byongeye kandi, ubushobozi bwa PowerScale bwo kubona ibintu byinshi butanga uburyo butagira imipaka bwo gukora imirimo ikora, bigatuma amakuru abikwa ukoresheje protocole imwe kandi ukaboneka ukoresheje indi. By'umwihariko, ibintu bikomeye, ibintu byoroshye, ubwuzuzanye, hamwe n’ibikorwa byo mu rwego rwa entreprise ya PowerScale ifasha gukemura ibibazo bikurikira:
- Kwihutisha udushya inshuro zigera kuri 2.7, kugabanya icyiciro cyamahugurwa yicyitegererezo.
- Kurandura icyuho cya I / O no gutanga amahugurwa yihuse yicyitegererezo no kwemezwa, kunonosora icyitegererezo cyukuri, kongera ubumenyi bwa siyanse yubumenyi, no kugaruka kwinshi kubushoramari bwo kubara ukoresheje uburyo bwo murwego rwibikorwa, imikorere myiza, guhuriza hamwe, hamwe nubunini. Kuzamura icyitegererezo cyukuri hamwe nimbaraga zimbitse, zikemurwa cyane namakuru ukoresheje gukoresha PB igera kuri 119 yubushobozi bwiza bwo kubika muri cluster imwe.
- Kugera kubyoherejwe mugipimo utangira ntoya kandi yigenga gupima mudasobwa no kubika, gutanga amakuru akomeye yo kurinda umutekano hamwe namahitamo yumutekano.
- Kunoza umusaruro wubumenyi bwa siyanse hamwe nisesengura-ryibisubizo hamwe nibisubizo byemejwe mbere yo kohereza byihuse, ibyago bike.
- Gukoresha ibishushanyo byemejwe bishingiye ku buhanga-bwa-tekinoroji, harimo kwihuta kwa NVIDIA GPU hamwe nububiko bwerekana hamwe na sisitemu ya NVIDIA DGX. Imikorere ya PowerScale ihanitse kandi ihuye yujuje ibyangombwa bisabwa mububiko kuri buri cyiciro cyo kwiga imashini, kuva gushaka amakuru no kwitegura kugeza kumahugurwa yicyitegererezo no gufata umwanzuro. Hamwe na sisitemu y'imikorere ya OneFS, imitwe yose irashobora gukora muburyo bumwe murwego rumwe ruyobowe na OneFS, hamwe nurwego rwibikorwa nko gucunga imikorere, gucunga amakuru, umutekano, no kurinda amakuru, bigafasha kurangiza byihuse amahugurwa yicyitegererezo no kwemeza ubucuruzi.
Igihe cyo kohereza: Jul-03-2023
