銆€銆€灏�(d菐o)璁€锛�8鏈�12鏃ワ紝鍦�(gu贸)闅涙瑠(qu谩n)濞佹(j墨)鍣ㄨ瑕�(ju茅)鍟�(w猫n)绛旀鍠甐QA Leaderboard鍑虹従(xi脿n)闂�(gu膩n)閸电獊鐮达細闃块噷宸村反閬�(d谩)鎽╅櫌浠�81.26%鐨勬簴(zh菙n)纰虹巼鍓�(chu脿ng)閫犱簡鏂扮磤(j矛)閷�锛岃畵AI鍦ㄢ€滆畝鍦栨渻(hu矛)鎰忊€濅笂瓒呰秺浜洪鍩烘簴(zh菙n)銆�

銆€銆€鍓嶄笉涔咃紝鍦ㄤ腑鏂囪獮(y菙)瑷€鐞嗚В娆�(qu谩n)濞佽⿻(p铆ng)娓�(c猫)鍩烘簴(zh菙n)CLUE涓�锛岄樋閲屽反宸寸殑AI妯″瀷鍦ㄦ柊鑱炴枃鏈笂瓒呰秺浜嗕汉椤炶瓨(sh铆)鍒ョ簿纰哄害?锛孎(xi脿n)鍦ㄢ€滆畝鍦栨渻(hu矛)鎰忊€濅笂锛岄樋閲屽反宸撮仈(d谩)鎽╅櫌鍦╒QA涓婁篃瓒呰秺浜嗕汉椤�锛岄€欐槸姒滃柈瑷�(sh猫)绔�6骞翠締(l谩i)鐨勯娆°€�

銆€銆€8鏈�12鏃�锛屽湅(gu贸)闅涙瑠(qu谩n)濞佹(j墨)鍣ㄨ瑕�(ju茅)鍟�(w猫n)绛旀鍠甐QA Leaderboard鍑虹従(xi脿n)闂�(gu膩n)閸电獊鐮达細闃块噷宸村反閬�(d谩)鎽╅櫌浠�81.26%鐨勬簴(zh菙n)纰虹巼鍓�(chu脿ng)閫犱簡鏂扮磤(j矛)閷�锛岃畵AI鍦ㄢ€滆畝鍦栨渻(hu矛)鎰忊€濅笂瓒呰秺浜洪鍩烘簴(zh菙n)銆�

銆€銆€绻�2015骞�銆�2018骞碅I鍒嗗垾鍦ㄨ瑕�(ju茅)璀�(sh铆)鍒ュ強鏂囨湰鐞嗚В闋�(l菒ng)鍩熻秴瓒婁汉椤炲垎?j菒n)?sh霉)鍚�锛屼汉宸ユ櫤鑳藉湪澶氭ā鎱�(t脿i)鎶€琛�(sh霉)闋�(l菒ng)鍩熶篃杩庝締(l谩i)涓€澶ч€�(j矛n)灞曘€�

銆€銆€鈥滆┅(sh墨)鏄劇(w煤)褰㈢暙(hu脿)锛岀暙(hu脿)鏄湁褰㈣┅(sh墨)?锛佸郊鏈專?sh墨)浜哄嫉鑸滄皯鏇炬弿绻獮(y菙)瑷€鑸囪瑕�(ju茅)鐨勭浉閫氫箣铏�?锛佺櫧x鍦栨渻(hu矛)鎰忊€濓紝鍗抽€氶亷(gu貌)瑕栬(ju茅)鐞嗚В淇℃伅锛屾槸浜洪鐨勪竴闋�(xi脿ng)鍩虹(ch菙)鑳藉姏锛屼絾灏�(du矛)AI渚�(l谩i)瑾�(shu艒)鍗绘槸瑕佹眰妤甸珮鐨勮獚(r猫n)鐭ヤ换鍕�(w霉)銆�

銆€銆€瑙ｆ焙瑭叉寫鎴�(zh脿n)锛屽皪(du矛)鐮旂櫦(f膩)閫氱敤浜哄伐鏅鸿兘鏈夐噸瑕佹剰缇�銆傝繎10骞翠締(l谩i)锛孉I鍦ㄤ笅妫嬨€佽瑕�(ju茅)銆佹枃鏈悊瑙ｇ瓑鍠ā鎱�(t脿i)鎶€鑳戒笂绐侀鐚涢€�(j矛n)锛屼絾鍦ㄦ秹鍙婅瑕�(ju茅)-鏂囨湰璺ㄦā鎱�(t脿i)鐞嗚В鐨勯珮闅庤獚(r猫n)鐭ヤ换鍕�(w霉)涓婏紝AI閬�(gu貌)鍘诲绲傛湭閬�(d谩)鍒颁汉椤炴按骞�銆�

銆€銆€鐐烘敾鍏嬮€欎竴闆ｉ鑰岃ō(sh猫)绔嬬殑鎸戞埌(zh脿n)璩絍QA Challenge锛岃嚜2015骞磋捣鍏堝悗浜庡叏鐞冭▓(j矛)绠楁(j墨)瑕栬(ju茅)闋傛渻(hu矛)ICCV鍙奀VPR鑸夎睛锛屽惛寮曚簡鍖呮嫭寰粺銆丗acebook銆佹柉鍧︾澶у(xu茅)銆侀樋閲屽反宸�銆佺櫨搴︾瓑鐪惧闋傚皷姗�(j墨)妲�(g貌u)韪磋簫鍙冭垏锛屽苟褰㈡垚浜嗗湅(gu贸)闅涗笂瑕�(gu墨)妯℃渶澶�銆佽獚(r猫n)鍙害鏈€楂樼殑VQA(Visual Question Answering)鏁�(sh霉)鎿�(j霉)闆�锛屽叾鍖呭惈瓒�20钀�(w脿n)寮电湡瀵�(sh铆)鐓х墖銆�110钀�(w脿n)閬撹€冮銆�

銆€銆€VQA鏄疉I闋�(l菒ng)鍩熼洠搴︽渶楂樼殑鎸戞埌(zh脿n)涔嬩竴銆傚湪娓�(c猫)瑭︿腑锛孉I闇€鏍规摎(j霉)绲﹀畾鍦栫墖鍙婅嚜鐒惰獮(y菙)瑷€鍟�(w猫n)椤岀敓鎴愭纰虹殑鑷劧瑾�(y菙)瑷€鍥炵瓟銆�

銆€銆€閫欐剰鍛宠憲鍠€�(g猫)AI妯″瀷闇€铻嶅悎寰�(f霉)闆滅殑瑷�(j矛)绠楁(j墨)瑕栬(ju茅)鍙婅嚜鐒惰獮(y菙)瑷€鎶€琛�(sh霉)锛氶鍏堝皪(du矛)鎵€鏈夊湒鍍忎俊鎭€�(j矛n)琛屾巸鎻忥紝鍐嶇祼(ji茅)鍚堝皪(du矛)鏂囨湰鍟�(w猫n)椤岀殑鐞嗚В锛屽埄鐢ㄥ妯℃厠(t脿i)鎶€琛�(sh霉)瀛�(xu茅)缈�(x铆)鍦栨枃鐨勯棞(gu膩n)鑱�(li谩n)鎬�銆佺簿婧�(zh菙n)瀹氫綅鐩搁棞(gu膩n)鍦栧儚淇℃伅锛屾渶鍚庢牴鎿�(j霉)甯歌瓨(sh铆)鍙婃帹鐞嗗洖绛斿晱(w猫n)椤屻€�

銆€銆€浠婂勾6鏈�锛岄樋閲岄仈(d谩)鎽╅櫌鍦╒QA 2021 Challenge鐨�55鏀彁浜ら殜(du矛)浼嶄腑濂啝锛屾垚绺�(j墨)闋�(l菒ng)鍏堢浜屽悕绱�1鍊�(g猫)鐧惧垎榛�(di菐n)銆佸幓骞村啝杌�3.4鍊�(g猫)鐧惧垎榛�(di菐n)銆傚叐鍊�(g猫)鏈堝悗锛岄仈(d谩)鎽╅櫌鍐嶆浠�81.26%鐨勬簴(zh菙n)纰虹巼鍓�(chu脿ng)閫燰QA Leaderboard鍏ㄧ悆绱€(j矛)閷�锛岄娆¤秴瓒婁汉椤炲熀婧�(zh菙n)绶�80.83%銆�

銆€銆€VQA鐨勬牳蹇冮洠榛�(di菐n)鍦ㄤ簬灏�(du矛)澶氭ā鎱�(t脿i)淇℃伅閫�(j矛n)琛岃伅(li谩n)鍚堟帹鐞嗚獚(r猫n)鐭�锛屽嵆鍦ㄧ当(t菕ng)涓€妯″瀷閲屽仛涓嶅悓妯℃厠(t脿i)鐨勮獮(y菙)缇╂槧灏勫拰灏�(du矛)榻�銆�

銆€銆€鎿�(j霉)浜嗚В锛岄仈(d谩)鎽╅櫌NLP鍙婅瑕�(ju茅)鍦�(tu谩n)闅�(du矛)灏�(du矛)AI瑕栬(ju茅)-鏂囨湰鎺ㄧ悊楂旂郴閫�(j矛n)琛屼簡绯荤当(t菕ng)鎬х殑瑷�(sh猫)瑷�(j矛)锛岃瀺鍚堜簡澶ч噺绠楁硶鍓�(chu脿ng)鏂帮紝鍖呮嫭澶氭ǎ鎬х殑瑕栬(ju茅)鐗瑰緛琛ㄧず銆佸妯℃厠(t脿i)闋�(y霉)瑷�(x霉n)绶存ā鍨�銆佽嚜閬╂噳(y墨ng)鐨勮法妯℃厠(t脿i)瑾�(y菙)缇╄瀺鍚堝拰灏�(du矛)榻婃妧琛�(sh霉)銆佺煡璀�(sh铆)椹�(q奴)鍕�(d貌ng)鐨勫鎶€鑳紸I闆嗘垚绛�锛岃畵AI鈥滆畝鍦栨渻(hu矛)鎰忊€濇按骞充笂浜嗕竴鍊�(g猫)鏂拌嚭(t谩i)闅�銆�

銆€銆€VQA鎶€琛�(sh霉)鎿佹湁寤ｉ棅鐨勬噳(y墨ng)鐢ㄥ牬(ch菐ng)鏅�锛屽彲鐢ㄤ簬鍦栨枃闁辫畝銆佽法妯℃厠(t脿i)鎼滅储銆佺洸浜鸿瑕�(ju茅)鍟�(w猫n)绛�銆侀啱(y墨)鐧傚晱(w猫n)瑷恒€佹櫤鑳介椐涚瓑闋�(l菒ng)鍩�锛屾垨?q奴)鈷嗗厪閿惰棻C(j墨)浜や簰鏂瑰紡銆�

銆€銆€鍫�(b脿o)閬撻’绀�锛岄€欎笉鏄樋閲岄仈(d谩)鎽╅櫌绗竴娆″湪AI闂�(gu膩n)閸甸牁(l菒ng)鍩熻秴瓒婁汉椤炲熀婧�(zh菙n)銆�2018骞�锛岄仈(d谩)鎽╅櫌鏇惧湪鏂潶绂廠QuAD鎸戞埌(zh脿n)璩戒腑姝峰彶鎬у湴璁撴(j墨)鍣ㄩ柋璁€鐞嗚В棣栨瓒呰秺浜洪锛屽紩鐧�(f膩)娴峰濯掗珨闂�(gu膩n)娉�銆�

銆€銆€浠婂勾浠ヤ締(l谩i)锛岄仈(d谩)鎽╅櫌鍦ˋI搴曞堡鎶€琛�(sh霉)闋�(l菒ng)鍩熷嫊(d貌ng)浣滈牷闋�锛屽厛鍚庣櫦(f膩)甯冧簡涓湅(gu贸)绉戞妧鍏徃涓鍊�(g猫)瓒呭ぇ瑕�(gu墨)妯″妯℃厠(t脿i)闋�(y霉)瑷�(x霉n)绶存ā鍨婱6鍙婇鍊�(g猫)瓒呭ぇ瑕�(gu墨)妯′腑鏂囪獮(y菙)瑷€妯″瀷PLUG锛屽苟闁�(k膩i)婧愪簡姝风稉(j墨ng)3骞存墦閫犵殑娣卞害瑾�(y菙)瑷€妯″瀷楂旂郴A(ch菙)liceMind(https://github.com/alibaba/AliceMind)锛屽叾鏇剧櫥闋侴LUE绛夊叚澶у湅(gu贸)闅涙瑠(qu谩n)濞丯LP姒滃柈銆�