銆怲echWeb銆?鏈?鏃ユ秷鎭紝鑻辩壒灏斿甯僅abana Gaudi2娣卞害瀛︿範澶勭悊鍣ㄥ湪MLPerf琛屼笟娴嬭瘯涓〃鐜颁紭浜庤嫳浼熻揪A100鎻愪氦鐨凙I璁粌鏃堕棿锛岀粨鏋滅獊鏄句簡5鏈堝湪鑻辩壒灏擮n浜т笟鍒涙柊宄颁細涓婂彂甯冪殑Gaudi2澶勭悊鍣ㄥ湪瑙嗚锛圧esNet-50锛夊拰璇█锛圔ERT锛夋ā鍨嬩笂璁粌鏃堕棿鐨勪紭鍔裤€?/p>

鑻辩壒灏斿叕鍙告墽琛屽壇 鎬昏鍏兼暟鎹腑蹇冧笌浜哄伐鏅鸿兘浜嬩笟閮ㄦ€荤粡鐞?Sandra Rivera琛ㄧず锛?ldquo;闈炲父楂樺叴鑳戒笌澶у鍒嗕韩Gaudi 2鍦∕LPerf鍩哄噯娴嬭瘯涓殑鍑鸿壊琛ㄧ幇锛屾垜涔熶负鑻辩壒灏斿洟闃熷湪浜у搧鍙戝竷浠呬竴涓湀鍙栧緱鐨勬垚灏辨劅鍒拌嚜璞€傛垜浠浉淇★紝鍦ㄨ瑙夊拰璇█妯″瀷涓彁渚涢鍏堢殑鎬ц兘鑳藉涓哄鎴峰甫鏉ヤ环鍊硷紝鏈夊姪浜庡姞閫熷叾AI娣卞害瀛︿範瑙ｅ喅鏂规銆?rdquo;

鍊熷姪Habana Labs鐨凣audi骞冲彴锛岃嫳鐗瑰皵鏁版嵁涓績鍥㈤槦鑳藉涓撴敞浜庢繁搴﹀涔犲鐞嗗櫒鎶€鏈紝璁╂暟鎹瀛﹀鍜屾満鍣ㄥ涔犲伐绋嬪笀寰椾互楂樻晥鍦拌繘琛屾ā鍨嬭缁冿紝骞堕€氳繃绠€鍗曠殑浠ｇ爜瀹炵幇鏂版ā鍨嬫瀯寤烘垨鐜版湁妯″瀷杩佺Щ锛屾彁楂樺伐浣滄晥鐜囩殑鍚屾椂闄嶄綆杩愯惀鎴愭湰銆?/p>

Habana Gaudi2澶勭悊鍣ㄥ湪缂╃煭璁粌鏃堕棿锛圱TT锛夋柟闈㈢浉杈冪涓€浠audi鏈変簡鏄捐憲鎻愬崌銆侶abana Labs浜?022骞?鏈堟彁浜ょ殑Gaudi2澶勭悊鍣ㄥ湪瑙嗚鍜岃瑷€妯″瀷璁粌鏃堕棿涓婂凡瓒呰秺鑻变紵杈続100-80G鐨凪LPerf娴嬭瘯缁撴灉銆傚叾涓紝閽堝瑙嗚妯″瀷ResNet-50锛孏audi2澶勭悊鍣ㄧ殑TTT缁撴灉鐩歌緝鑻变紵杈続100-80GB缂╃煭浜?6%锛岀浉杈冩埓灏旀彁浜ょ殑鍚屾牱閽堝ResNet-50鍜孊ERT妯″瀷銆侀噰鐢?涓姞閫熷櫒鐨凙100-40GB鏈嶅姟鍣紝Gaudi2鐨凾TT娴嬭瘯缁撴灉鍒欑缉鐭簡45%銆?/p>

MLCommons鍙戝竷鐨勬暟鎹紝2022骞?鏈堛€俬ttps://mlcommons.org/en/training-normal-20/

鐩告瘮浜庣涓€浠audi澶勭悊鍣紝Gaudi2鍦≧esNet-50妯″瀷鐨勮缁冨悶鍚愰噺鎻愰珮浜?鍊嶏紝BERT妯″瀷鐨勮缁冨悶鍚愰噺鎻愰珮浜?.7鍊嶃€傝繖浜涘綊鍥犱簬鍒剁▼宸ヨ壓浠?6绾崇背鎻愬崌鑷?绾崇背銆乀ensor澶勭悊鍣ㄥ唴鏍告暟閲忓鍔犱簡涓夊€嶃€佸鍔燝EMM寮曟搸绠楀姏銆佸皝瑁呯殑楂樺甫瀹藉瓨鍌ㄥ閲忔彁鍗囦簡涓夊€嶃€丼RAM甯﹀鎻愬崌浠ュ強瀹归噺澧炲姞涓€鍊嶃€傚浜庤瑙夊鐞嗘ā鍨嬬殑璁粌锛孏audi2澶勭悊鍣ㄩ泦鎴愪簡濯掍綋澶勭悊寮曟搸锛岃兘澶熺嫭绔嬪畬鎴愬寘鎷珹I璁粌鎵€闇€鐨勬暟鎹寮哄拰鍘嬬缉鍥惧儚鐨勯澶勭悊銆?/p>

涓や唬Gaudi澶勭悊鍣ㄧ殑鎬ц兘閮芥槸鍦ㄦ病鏈夌壒娈婅蒋浠舵搷浣滅殑鎯呭喌涓嬮€氳繃Habana瀹㈡埛寮€绠卞嵆鐢ㄧ殑鍟嗕笟杞欢鏍堝疄鐜扮殑銆?/p>

閫氳繃鍟嗙敤杞欢鎵€鎻愪緵鐨勫紑绠卞嵆鐢ㄦ€ц兘锛屽湪Habana 8涓狦PU鏈嶅姟鍣ㄤ笌HLS-Gaudi2鍙傝€冩湇鍔″櫒涓婅繘琛屾祴璇曟瘮瀵广€傚叾涓紝璁粌鍚炲悙閲忔潵鑷簬NGC鍜孒abana鍏叡搴撶殑TensorFlow docker锛岄噰鐢ㄥ弻鏂规帹鑽愮殑鏈€浣虫€ц兘鍙傛暟鍦ㄦ贩鍚堢簿搴﹁缁冩ā寮忎笅杩涜娴嬮噺銆傚€煎緱娉ㄦ剰鐨勬槸锛屽悶鍚愰噺鏄奖鍝嶆渶缁堣缁冩椂闂存敹鏁涚殑鍏抽敭鍥犵礌銆?/p>

鍥惧舰娴嬭瘯閰嶇疆璇﹁鏂囨湯璇存槑閮ㄥ垎銆?/p>

鍥惧舰娴嬭瘯閰嶇疆璇﹁鏂囨湯璇存槑閮ㄥ垎銆?/p>

闄や簡Gaudi2鍦∕LPerf娴嬭瘯涓殑鍗撹秺琛ㄧ幇锛岀涓€浠audi鍦?28涓姞閫熷櫒鍜?56涓姞閫熷櫒鐨凴esNet鍩哄噯娴嬭瘯涓睍鐜颁簡寮哄ぇ鐨勬€ц兘鍜屼护浜哄嵃璞℃繁鍒荤殑杩戠嚎鎬ф墿灞曪紝鏀寔瀹㈡埛楂樻晥绯荤粺鎵╁睍銆?/p>

Habana Labs棣栧腑杩愯惀瀹楨itan Medina琛ㄧず锛?ldquo;鎴戜滑鏈€鏂扮殑MLPerf娴嬭瘯缁撴灉璇佹槑Gaudi2鍦ㄨ缁冩€ц兘鏂归潰鏄捐憲浼樺娍銆傛垜浠皢鎸佺画娣卞害瀛︿範璁粌鏋舵瀯鍜岃蒋浠跺垱鏂帮紝鎵撻€犳渶鍏锋€т环姣旂殑AI璁粌瑙ｅ喅鏂规銆?rdquo;

璇存槑锛?/p>

ResNet-50鎬ц兘瀵规瘮涓娇鐢ㄧ殑娴嬭瘯閰嶇疆

A100-80GB锛欻abana浜?022骞?鏈堝湪Azure瀹炰緥Standard_ND96amsr_A100_v4涓婅繘琛屾祴閲忥紝浣跨敤浜嗕竴涓狝100-80GB锛屽叾涓簲鐢ㄤ簡NGC鐨凾F docker 22.03-tf2-py3锛坥ptimizer=sgd, BS=256锛?/p>

A100-40GB锛欻abana浜?022骞?鏈堝湪DGX-A100涓婅繘琛屾祴閲忥紝浣跨敤浜嗕竴涓狝100-40GB锛屽叾涓簲鐢ㄤ簡NGC鐨凾F docker 22.03-tf2-py3锛坥ptimizer=sgd, BS=256锛?/p>

V100-32GB 锛欻abana浜?022骞?鏈堝湪p3dn.24xlarge涓婅繘琛屾祴閲忥紝浣跨敤浜嗕竴涓猇100-32GB锛屽叾涓簲鐢ㄤ簡NGC鐨凾F docker 22.03-tf2-py3锛坥ptimizer=sgd, BS=256锛?/p>

Gaudi2锛欻abana浜?022骞?鏈堝湪Gaudi2-HLS绯荤粺涓婅繘琛屾祴閲忥紝浣跨敤浜嗕竴涓狦audi2锛屽叾涓簲鐢ㄤ簡SynapseAI TF docker 1.5.0锛圔S=256锛?/p>

缁撴灉鍙兘鏈夋墍涓嶅悓銆?/p>

BERT鎬ц兘瀵规瘮涓娇鐢ㄧ殑娴嬭瘯閰嶇疆

A100-80GB锛欻abana浜?022骞?鏈堝湪Azure瀹炰緥Standard_ND96amsr_A100_v4涓婅繘琛屾祴璇曪紝浣跨敤浜嗕竴涓狝100-80GB锛屽寘鍚玁GC鐨凾F docker 22.03-tf2-py3锛圥hase-1锛歋eq len=128锛孊S=312锛宎ccu steps=256锛汸hase-2锛歴eq len=512锛孊S=40锛宎ccu steps=768锛?nbsp;

A100-40GB锛欻abana浜?022骞?鏈堝湪DGX-A100涓婅繘琛屾祴璇曪紝浣跨敤浜嗕竴涓狝100-40GB锛屽寘鍚玁GC鐨凾F docker 22.03-tf2-py3锛圥hase-1锛歋eq len=128锛孊S=64锛宎ccu steps=1024锛汸hase-2锛歴eq len=512锛孊S=16锛宎ccu steps=2048锛?/p>

V100-32GB锛欻abana浜?022骞?鏈堝湪涓妏3dn.24xlarge杩涜娴嬭瘯锛屼娇鐢ㄤ簡涓€涓猇100-32GB锛屽寘鍚玁GC鐨凾F docker 21.12-tf2-py3锛圥hase-1锛歋eq len=128锛孊S=64锛宎ccu steps=1024锛汸hase-2锛歴eq len=512锛孊S=8锛宎ccu steps=4096锛?/p>

Gaudi2锛欻abana浜?022骞?鏈堝湪涓奊audi2-HLS杩涜娴嬭瘯锛屼娇鐢ㄤ簡涓€涓狦audi2锛屽寘鍚玈ynapseAI TF docker 1.5.0锛圥hase-1锛歋eq len=128锛孊S=64锛宎ccu steps=1024锛汸hase-2锛歴eq len=512锛孊S=16锛宎ccu steps=2048锛?/p>

缁撴灉鍙兘鏈夋墍涓嶅悓銆?/p>
娑堟伅绉伴缚钂橦armony OS 3.0姝ｅ紡鐗堟湀搴曞彂甯?/a> 瀹樻柟寰崥/寰俊

姣忔棩澶存潯銆佷笟鐣岃祫璁€佺儹鐐硅祫璁€佸叓鍗︾垎鏂欙紝鍏ㄥぉ璺熻釜寰崥鎾姤銆傚悇绉嶇垎鏂欍€佸唴骞曘€佽姳杈广€佽祫璁竴缃戞墦灏姐€傜櫨涓囦簰鑱旂綉绮変笣浜掑姩鍙備笌锛孴echWeb瀹樻柟寰崥鏈熷緟鎮ㄧ殑鍏虫敞銆?/p> 鈫戞壂鎻忎簩缁寸爜

鎯冲湪鎵嬫満涓婄湅绉戞妧璧勮鍜岀鎶€鍏崷鍚楋紵

鎯崇涓€鏃堕棿鐪嬬嫭瀹剁垎鏂欏拰娣卞害鎶ラ亾鍚楋紵

璇峰叧娉═echWeb瀹樻柟寰俊鍏紬甯愬彿锛?/p>

1.鐢ㄦ墜鏈烘壂宸︿晶浜岀淮鐮侊紱

2.鍦ㄦ坊鍔犳湅鍙嬮噷锛屾悳绱㈠叧娉═echWeb銆?/p> 浠婃棩鐑偣 骞磋交浜虹埍涓婄殑缃戠孩鐗涘ザ锛屽叏閮芥槸鈥滄场娌€濓紵 Uber鍚瑰摠浜?/h4> 闀垮煄鎵嬫挄浣欐壙涓滐細澧炵▼鐨勭姜锛屾彃娣风殑娉?

鍑开鎷夊厠鏅鸿兘绾數姒傚康杞YRIQ鍥捐祻

2021涓婃捣杞﹀睍锝滀笂姹介€氱敤姹借溅闆紬鍏板睍鍙伴珮娓呭ぇ鍥?/p>

2021涓婃捣杞﹀睍锝滀笂姹介€氱敤姹借溅鍑开鎷夊厠灞曞彴楂樻竻澶у浘

2021涓婃捣杞﹀睍锝滀笂姹介€氱敤姹借溅鍒厠灞曞彴楂樻竻澶у浘

浣庣鐢熸椿涓庨珮绛夌鎶€鐨勭粨鍚?涓€鍔?T璧涘崥鏈嬪厠2077闄愬畾鐗堢湡鏈哄浘璧?/p>