妲�(g貌u)寤鸿兘澶犲湪浠讳綍鐠�(hu谩n)澧冧腑鐒�(w煤)绺搷浣�銆佷娇鐢ㄥ悇绋妧鑳借檿鐞嗕笉鍚岀墿楂斿拰瀹屾垚澶氭ǎ鍖栦换鍕�(w霉)鐨勯€氱敤姗�(j墨)鍣ㄤ汉锛屼竴鐩存槸浜哄伐鏅鸿兘闋�(l菒ng)鍩熺殑闀�(zh菐ng)鏈熺洰妯�(bi膩o)銆傜劧鑰�锛屼笉骞哥殑鏄�锛屽ぇ澶氭暩(sh霉)鐝�(xi脿n)鏈夌殑姗�(j墨)鍣ㄤ汉绯荤当(t菕ng)鍙楀埌闄愬埗鈥斺€斿畠鍊戣瑷�(sh猫)瑷�(j矛)鐢ㄤ簬鐗瑰畾浠诲嫏(w霉)銆佸湪鐗瑰畾鏁�(sh霉)鎿�(j霉)闆嗕笂閫�(j矛n)琛岃〒(x霉n)绶达紝骞跺湪鐗瑰畾鐠�(hu谩n)澧冧腑閮ㄧ讲銆傞€欎簺绯荤当(t菕ng)閫氬父闇€瑕佸ぇ閲忔(bi膩o)娉ㄦ暩(sh霉)鎿�(j霉)锛屼緷璩�(l脿i)浜庣壒瀹氫换鍕�(w霉)鐨勬ā鍨�锛屽湪鐝�(xi脿n)瀵�(sh铆)涓栫晫鍫�(ch菐ng)鏅腑閮ㄧ讲鏅�(sh铆)瀛樺湪璜稿娉涘寲鍟�(w猫n)椤�锛屽苟涓旈洠浠ュ皪(du矛)鍒嗗竷璁婂寲淇濇寔榄鎬�銆�

鍙楀埌缍�(w菐ng)绲�(lu貌)瑕�(gu墨)妯″ぇ瀹归噺闋�(y霉)瑷�(x霉n)绶存ā鍨嬶紙鍗冲熀绀�(ch菙)妯″瀷锛夊湪鑷劧瑾�(y菙)瑷€铏曠悊锛圢LP锛夊拰瑷�(j矛)绠楁(j墨)瑕栬(ju茅)锛圕V锛夌瓑鐮旂┒闋�(l菒ng)鍩熼枊(k膩i)鏀鹃泦琛ㄧ従(xi脿n)鍜屽収(n猫i)瀹圭敓鎴愯兘鍔涘嵃璞℃繁鍒荤殑鍟熺櫦(f膩)锛�鎴戝€戝皣鏈稖杩帮紙survey锛夎嚧鍔涗簬鎺㈢储锛坕锛夊浣曞皣鐝�(xi脿n)鏈夌殑NLP鍜孋V闋�(l菒ng)鍩熺殑鍩虹(ch菙)妯″瀷鎳�(y墨ng)鐢ㄤ簬姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)闋�(l菒ng)鍩�锛屼互鍙婏紙ii锛夊皥(zhu膩n)闁€(m茅n)閲濆皪(du矛)姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鐨勫熀绀�(ch菙)妯″瀷灏囨渻(hu矛)鏄粈涔堟ǎ瀛�銆傛垜鍊戦鍏堟杩颁簡鍌崇当(t菕ng)姗�(j墨)鍣ㄤ汉绯荤当(t菕ng)鐨勬(g貌u)鎴愬強鍏舵櫘閬嶉仼鐢ㄦ€х殑鍩烘湰闅滅銆�

鎺ヨ憲锛屾垜鍊戝缓绔嬩簡涓€鍊�(g猫)鍒嗛(l猫i)楂旂郴锛岃◣璜栦簡鐣�(d膩ng)鍓嶅埄鐢ㄧ従(xi脿n)鏈夊熀绀�(ch菙)妯″瀷閫�(j矛n)琛屾(j墨)鍣ㄤ汉鎶€琛�(sh霉)鎺㈢储鍜岄枊(k膩i)鐧�(f膩)閲濆皪(du矛)姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鐨勬ā鍨嬬殑宸ヤ綔銆傛渶鍚庯紝鎴戝€戣◣璜栦簡浣跨敤鍩虹(ch菙)妯″瀷鍟熺敤閫氱敤姗�(j墨)鍣ㄤ汉绯荤当(t菕ng)鐨勯棞(gu膩n)閸垫寫鎴�(zh脿n)鍜屾湁鍓嶆櫙鐨勬湭渚�(l谩i)鐧�(f膩)灞曟柟鍚�銆�

鎴戝€�?c猫)闄俖(k膩i)鐧�(f膩)鑳藉閬╂噳(y墨ng)涓嶅悓鐠�(hu谩n)澧冨苟鍦ㄥ叾涓亱(y霉n)浣滅殑鑷不姗�(j墨)鍣ㄤ汉绯荤当(t菕ng)鏂归潰浠嶉潰鑷ㄨū澶氭寫鎴�(zh脿n)銆備互寰€鐨勬(j墨)鍣ㄤ汉鎰熺煡绯荤当(t菕ng)鍒╃敤鍌崇当(t菕ng)娣卞害瀛�(xu茅)缈�(x铆)鏂规硶锛岄€氬父闇€瑕佸ぇ閲忔(bi膩o)瑷樻暩(sh霉)鎿�(j霉)渚�(l谩i)瑷�(x霉n)绶寸洠(ji膩n)鐫ｅ(xu茅)缈�(x铆)妯″瀷[1-3]锛涜垏姝ゅ悓鏅�(sh铆)锛岀偤閫欎簺澶у瀷鏁�(sh霉)鎿�(j霉)闆嗘(g貌u)寤虹溇鍖呮(bi膩o)瑷橀亷(gu貌)绋嬩粛鐒剁浉鐣�(d膩ng)鏄傝泊銆傛澶栵紝鐢变簬鍌崇当(t菕ng)鐩�(ji膩n)鐫ｅ(xu茅)缈�(x铆)鏂规硶鐨勬硾鍖栬兘鍔涙湁闄�锛岃〒(x霉n)绶村嚭鐨勬ā鍨嬮€氬父闇€瑕佺簿蹇冭ō(sh猫)瑷�(j矛)鐨勯牁(l菒ng)鍩熼仼鎳�(y墨ng)鎶€琛�(sh霉)鎵嶈兘灏囬€欎簺妯″瀷閮ㄧ讲鍒扮壒瀹氬牬(ch菐ng)鏅垨浠诲嫏(w霉)[4, 5]锛岄€欏線寰€闇€瑕侀€�(j矛n)涓€姝ョ殑鏁�(sh霉)鎿�(j霉)鏀堕泦鍜屾(bi膩o)瑷樸€�

椤�(l猫i)浼煎湴锛屽偝绲�(t菕ng)鐨勬(j墨)鍣ㄤ汉瑕�(gu墨)鍔冨拰鎺у埗鏂规硶閫氬父闇€瑕佺簿纰哄缓妯′笘鐣�銆佽嚜涓婚珨鐨勫嫊(d貌ng)鍔涘(xu茅)鍜�/鎴栧叾浠栦唬鐞嗙殑琛岀偤[6-8]銆傞€欎簺妯″瀷閲濆皪(du矛)姣忓€�(g猫)鐗瑰畾鐠�(hu谩n)澧冩垨浠诲嫏(w霉)寤虹珛锛屽苟涓斿湪鐧�(f膩)鐢熻畩鍖栨檪(sh铆)閫氬父闇€瑕侀噸鏂版(g貌u)寤�锛屾毚闇蹭簡瀹冨€戠殑鏈夐檺鍙伔绉绘€8]锛涗簨瀵�(sh铆)涓婏紝鍦ㄨū澶氭儏娉佷笅锛屾(g貌u)寤烘湁鏁堟ā鍨嬭涔堝お鏄傝泊锛岃涔堜笉鍒囧(sh铆)闅�銆傜洝绠″熀浜庢繁搴︼紙寮�(qi谩ng)鍖栵級瀛�(xu茅)缈�(x铆)鐨勯亱(y霉n)鍕�(d貌ng)瑕�(gu墨)鍔僛9, 10]鍜屾帶鍒舵柟娉昜11-14]鍙互骞姪绶╄В閫欎簺鍟�(w猫n)椤�锛屼絾瀹冨€戜篃浠嶇劧鍙楀埌鍒嗗竷璁婂寲鍜屾硾鍖栬兘鍔涢檷浣庣殑鍥版摼[15, 16]銆�  

鍦ㄦ(g貌u)寤哄叿鏈夋硾鍖栬兘鍔涚殑姗�(j墨)鍣ㄤ汉绯荤当(t菕ng)鎵€闈㈣嚚鐨勬寫鎴�(zh脿n)鐨勫悓鏅�(sh铆)锛屾垜鍊戜篃娉ㄦ剰鍒拌嚜鐒惰獮(y菙)瑷€铏曠悊锛圢LP锛夊拰瑷�(j矛)绠楁(j墨)瑕栬(ju茅)锛圕V锛夐牁(l菒ng)鍩熺殑椤憲閫�(j矛n)姝モ€斺€斿紩鍏ヤ簡澶у瀷瑾�(y菙)瑷€妯″瀷锛圠LMs锛塠17]鐢ㄤ簬NLP锛屼娇鐢ㄦ摯(ku貌)鏁ｆā鍨嬮€�(j矛n)琛岄珮淇濈湡鍦栧儚鐢熸垚[18, 19]锛屼互鍙婁娇鐢ㄥぇ瀹归噺瑕栬(ju茅)妯″瀷鍜岃瑕�(ju茅)瑾�(y菙)瑷€妯″瀷锛圴LMs锛夊(sh铆)鐝�(xi脿n)CV浠诲嫏(w霉)鐨勯浂娆�/灏戞瀛�(xu茅)缈�(x铆)娉涘寲[20-22]銆�

閫欎簺琚ū(ch膿ng)鐐衡€滃熀绀�(ch菙)妯″瀷鈥漑23]锛屾垨绨�(ji菐n)绋�(ch膿ng)鐐哄ぇ鍨嬮爯(y霉)瑷�(x霉n)绶存ā鍨嬶紙LPTMS锛�锛岄€欎簺澶у閲忚瑕�(ju茅)鍜岃獮(y菙)瑷€妯″瀷涔熷凡鎳�(y墨ng)鐢ㄤ簬姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)闋�(l菒ng)鍩焄24-26]锛屾湁娼涘姏璩︿簣姗�(j墨)鍣ㄤ汉绯荤当(t菕ng)闁�(k膩i)鏀句笘鐣岀殑鎰熺煡銆佷换鍕�(w霉)瑕�(gu墨)鍔冪敋鑷�閬�(y霉n)鍕�(d貌ng)鎺у埗鑳藉姏銆傞櫎浜嗙洿鎺ユ噳(y墨ng)鐢ㄧ従(xi脿n)鏈夌殑瑕栬(ju茅)鍜�/鎴栬獮(y菙)瑷€鍩虹(ch菙)妯″瀷浜庢(j墨)鍣ㄤ汉浠诲嫏(w霉)涔嬪锛屾垜鍊戜篃鐪嬪埌浜嗛枊(k膩i)鐧�(f膩)鏇村閲濆皪(du矛)姗�(j墨)鍣ㄤ汉鐨勭壒瀹氭ā鍨嬬殑鐩哥暥(d膩ng)娼涘姏锛屼緥濡傜敤浜庢搷鎺х殑鍕�(d貌ng)浣滄ā鍨媅27, 28]鎴栫敤浜庡皫(d菐o)鑸殑閬�(y霉n)鍕�(d貌ng)瑕�(gu墨)鍔冩ā鍨媅29]銆傞€欎簺姗�(j墨)鍣ㄤ汉鍩虹(ch菙)妯″瀷鍦ㄤ笉鍚屼换鍕�(w霉)鐢氳嚦涓嶅悓瀵�(sh铆)楂斾笂椤ず鍑轰簡妤靛ぇ鐨勬硾鍖栬兘鍔�銆�

瑕栬(ju茅)/瑾�(y菙)瑷€鍩虹(ch菙)妯″瀷涔熷凡鐩存帴鎳�(y墨ng)鐢ㄤ簬姗�(j墨)鍣ㄤ汉浠诲嫏(w霉)[30, 31]锛岄’绀轰簡灏囦笉鍚屾(j墨)鍣ㄤ汉妯″铻嶅悎鐐哄柈涓€绲�(t菕ng)涓€妯″瀷鐨勫彲鑳芥€�銆傜洝绠℃垜鍊戠湅鍒板皣瑕栬(ju茅)鍜岃獮(y菙)瑷€鍩虹(ch菙)妯″瀷鎳�(y墨ng)鐢ㄤ簬姗�(j墨)鍣ㄤ汉浠诲嫏(w霉)浠ュ強闁�(k膩i)鐧�(f膩)鏂扮殑姗�(j墨)鍣ㄤ汉鍩虹(ch菙)妯″瀷鐨勬湁鍓嶆櫙鐨勬噳(y墨ng)鐢�锛屼絾瑷卞姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鐨勬寫鎴�(zh脿n)浠嶇劧闆ｄ互浼佸強銆傚緸瀵�(sh铆)闅涢儴缃茬殑瑙掑害渚�(l谩i)鐪�锛屾ā鍨嬮€氬父鐒�(w煤)娉曞京(f霉)鍒�锛岀己涔忓瀵�(sh铆)楂旀硾鍖栬兘鍔�锛屾垨鑰呯劇(w煤)娉曟簴(zh菙n)纰烘崟鎹夌挵(hu谩n)澧冧腑鍙锛堟垨鍙帴鍙楋級鐨勬儏娉�銆傛澶�锛屽ぇ澶氭暩(sh霉)鍑虹増鐗╁埄鐢ㄥ熀浜嶵ransformer鐨勬灦妲�(g貌u)锛屽皥(zhu膩n)娉ㄤ簬鐗╅珨鍜屽牬(ch菐ng)鏅殑瑾�(y菙)缇╂劅鐭�銆佷换鍕�(w霉)绱�(j铆)瑕�(gu墨)鍔冩垨鎺у埗[28]锛涘叾浠栧彲鑳藉彈鐩婁簬璺ㄩ牁(l菒ng)鍩熸硾鍖栬兘鍔涚殑姗�(j墨)鍣ㄤ汉绯荤当(t菕ng)绲勬垚閮ㄥ垎灏氭湭琚厖鍒嗘帰绱⑩€斺€斾緥濡�锛岀敤浜庝笘鐣屽嫊(d貌ng)鍔涘(xu茅)鐨勫熀绀�(ch菙)妯″瀷鎴栧彲浠ラ€�(j矛n)琛岀铏�(h脿o)鎺ㄧ悊鐨勫熀绀�(ch菙)妯″瀷銆傛渶鍚�锛屾垜鍊戞兂寮�(qi谩ng)瑾�(di脿o)闇€瑕佹洿澶氬ぇ瑕�(gu墨)妯″(sh铆)闅涙暩(sh霉)鎿�(j霉)浠ュ強鍏锋湁澶氭ǎ鍖栨(j墨)鍣ㄤ汉浠诲嫏(w霉)鐨勯珮淇濈湡妯℃摤鍣ㄣ€�  

鍦ㄦ湰鏂囦腑锛屾垜鍊戣(di脿o)鏌ヤ簡鍩虹(ch菙)妯″瀷鍦ㄦ(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓殑鎳�(y墨ng)鐢�锛屽苟鏃ㄥ湪鐞嗚В鍩虹(ch菙)妯″瀷濡備綍骞姪绶╄В鏍稿績姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鎸戞埌(zh脿n)銆傛垜鍊戜娇鐢ㄢ€�姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鍩虹(ch菙)妯″瀷鈥濅竴瑭炰締(l谩i)鍖呮嫭鍏╁€�(g猫)涓嶅悓鐨勬柟闈細锛�1锛夊皣鐝�(xi脿n)鏈夌殑锛堜富瑕佹槸锛夎瑕�(ju茅)鍜岃獮(y菙)瑷€妯″瀷鎳�(y墨ng)鐢ㄤ簬姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)锛屼富瑕侀€氶亷(gu貌)闆舵ǎ鏈(xu茅)缈�(x铆)鍜屾儏澧冨(xu茅)缈�(x铆)锛涗互鍙婏紙2锛変娇鐢ㄦ(j墨)鍣ㄤ汉鐢熸垚鐨勬暩(sh霉)鎿�(j霉)闁�(k膩i)鐧�(f膩)鍜屽埄鐢ㄥ皥(zhu膩n)闁€(m茅n)閲濆皪(du矛)姗�(j墨)鍣ㄤ汉浠诲嫏(w霉)鐨勬(j墨)鍣ㄤ汉鍩虹(ch菙)妯″瀷銆傛垜鍊戠附绲�(ji茅)浜嗘(j墨)鍣ㄤ汉鎶€琛�(sh霉)鍩虹(ch菙)妯″瀷璜栨枃鐨勬柟娉曡珫锛屽苟灏�(du矛)鎴戝€戣(di脿o)鏌ョ殑璜栨枃鐨勫(sh铆)椹�(y脿n)绲�(ji茅)鏋滈€�(j矛n)琛屼簡鍏冨垎鏋�銆�  

鏈枃鐨勪富瑕佺祫鎴愰儴鍒嗗湪鍦�1涓€�(j矛n)琛屼簡绺界祼(ji茅)銆傛湰鏂囩殑鏁撮珨绲�(ji茅)妲�(g貌u)濡傚湒2鎵€杩般€傚湪绗�2绡€(ji茅)涓�锛屾垜鍊戠啊(ji菐n)瑕佷粙绱逛簡鍩虹(ch菙)妯″瀷鏅�(sh铆)浠ｄ箣鍓嶇殑姗�(j墨)鍣ㄤ汉鐮旂┒锛屽苟瑷庤珫浜嗗熀绀�(ch菙)妯″瀷鐨勫熀绀�(ch菙)鐭ヨ瓨(sh铆)銆傚湪绗�3绡€(ji茅)涓�锛屾垜鍊戝垪鑸変簡姗�(j墨)鍣ㄤ汉鐮旂┒涓殑鎸戞埌(zh脿n)锛屽苟瑷庤珫浜嗗熀绀�(ch菙)妯″瀷鍙兘濡備綍绶╄В閫欎簺鎸戞埌(zh脿n)銆傚湪绗�4绡€(ji茅)涓�锛屾垜鍊戠附绲�(ji茅)浜嗘(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓熀绀�(ch菙)妯″瀷鐨勭暥(d膩ng)鍓嶇爺绌剁従(xi脿n)鐙€銆傛渶鍚�锛屽湪绗�6绡€(ji茅)涓�锛屾垜鍊戞彁鍑轰簡鍙兘灏�(du矛)閫欎竴鐮旂┒浜ゅ弶闋�(l菒ng)鍩熺敘(ch菐n)鐢熼噸澶у奖闊跨殑娼涘湪鐮旂┒鏂瑰悜銆�  

姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓殑鎸戞埌(zh脿n) 鍦ㄦ湰绡€(ji茅)涓�锛屾垜鍊戠附绲�(ji茅)浜嗗吀鍨嬫(j墨)鍣ㄤ汉绯荤当(t菕ng)涓悇绋ā濉婇潰鑷ㄧ殑浜斿€�(g猫)鏍稿績鎸戞埌(zh脿n)锛屾瘡鍊�(g猫)鎸戞埌(zh脿n)閮藉湪浠ヤ笅灏忕瘈(ji茅)涓┏绱�(x矛)浠嬬垂銆傜洝绠￠(l猫i)浼肩殑鎸戞埌(zh脿n)宸插湪鍏堝墠鏂囩嵒(xi脿n)涓◣璜栭亷(gu貌)锛堣(ji脿n)绗�1.2绡€(ji茅)锛�锛屼絾鏈瘈(ji茅)涓昏闂�(gu膩n)娉ㄩ偅浜涘彲鑳介€氶亷(gu貌)閬╃暥(d膩ng)鍒╃敤鍩虹(ch菙)妯″瀷渚�(l谩i)瑙ｆ焙鐨勬寫鎴�(zh脿n)锛岄€欎竴榛�(di菐n)寰炵暥(d膩ng)鍓嶇爺绌剁祼(ji茅)鏋滀腑寰楀埌浜嗚瓑鎿�(j霉)銆傛垜鍊戦倓鍦ㄦ湰绡€(ji茅)涓弿杩颁簡鍒嗛(l猫i)娉�锛屼互渚垮湪鍦�3涓洿瀹规槗鍥為¨銆�  

鐢ㄤ簬姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鐨勫熀绀�(ch菙)妯″瀷鍦ㄦ湰绡€(ji茅)涓�锛屾垜鍊戦噸榛�(di菐n)瑷庤珫鍦ㄦ(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓浂娆″(xu茅)缈�(x铆)鎳�(y墨ng)鐢ㄨ瑕�(ju茅)鍜岃獮(y菙)瑷€鍩虹(ch菙)妯″瀷銆傞€欎富瑕佸寘鎷敤浜庢(j墨)鍣ㄤ汉鎰熺煡鐨刅LMs鐨勯浂妯ｆ湰瀛�(xu茅)缈�(x铆)閮ㄧ讲锛屽湪浠诲嫏(w霉)绱�(j铆)鍒ュ拰閬�(y霉n)鍕�(d貌ng)绱�(j铆)鍒ヨ(gu墨)鍔冧互鍙婂嫊(d貌ng)浣滅敓鎴愭柟闈㈢殑LLMs鐨勬儏澧冨(xu茅)缈�(x铆)銆傛垜鍊�?c猫)瓒獶6涓睍绀轰簡涓€浜涗唬琛ㄦ€х殑宸ヤ綔銆�  

姗�(j墨)鍣ㄤ汉鍩虹(ch菙)妯″瀷锛圧FMs锛�

闅ㄨ憲鍖呭惈鐪熷(sh铆)姗�(j墨)鍣ㄤ汉鐨勭媭鎱�(t脿i)-鍕�(d貌ng)浣滃皪(du矛)鐨勬(j墨)鍣ㄤ汉鏁�(sh霉)鎿�(j霉)闆嗘暩(sh霉)閲忕殑澧炲姞锛屾(j墨)鍣ㄤ汉鍩虹(ch菙)妯″瀷锛圧FMs锛夌殑椤�(l猫i)鍒ヤ篃璁婂緱瓒婁締(l谩i)瓒婂彲琛孾28, 29, 176]銆傞€欎簺妯″瀷鐨勭壒榛�(di菐n)鏄娇鐢ㄦ(j墨)鍣ㄤ汉鏁�(sh霉)鎿�(j霉)渚�(l谩i)瑷�(x霉n)绶�锛屼互瑙ｆ焙姗�(j墨)鍣ㄤ汉浠诲嫏(w霉)銆傚湪鏈皬绡€(ji茅)涓�锛屾垜鍊戠附绲�(ji茅)骞惰◣璜栦簡涓嶅悓椤�(l猫i)鍨嬬殑RFMs銆傛垜鍊戦鍏堜粙绱硅兘澶犲湪绗�2.1绡€(ji茅)涓殑涓€鍊�(g猫)姗�(j墨)鍣ㄤ汉妯″鍏�(n猫i)鍩�(zh铆)琛屼竴绲勪换鍕�(w霉)鐨凴FMs锛岄€欒瀹氱京鐐哄柈涓€鐩殑鐨勬(j墨)鍣ㄤ汉鍩虹(ch菙)妯″瀷銆備緥濡�锛屼竴鍊�(g猫)鑳藉鐢熸垚鐢ㄤ簬鎺у埗姗�(j墨)鍣ㄤ汉鐨勪綆绱�(j铆)鍕�(d貌ng)浣滅殑RFM锛屾垨涓€鍊�(g猫)鑳藉鐢熸垚鏇撮珮绱�(j铆)鍒ラ亱(y霉n)鍕�(d貌ng)瑕�(gu墨)鍔冪殑妯″瀷銆備箣鍚庯紝鎴戝€戜粙绱硅兘澶犲湪澶氬€�(g猫)姗�(j墨)鍣ㄤ汉妯″涓煼(zh铆)琛屼换鍕�(w霉)鐨凴FMs锛屽洜姝ゅ畠鍊戞槸鑳藉鍩�(zh铆)琛屾劅鐭ャ€佹帶鍒剁敋鑷抽潪姗�(j墨)鍣ㄤ汉浠诲嫏(w霉)鐨勯€氱敤妯″瀷[30, 31]銆�

濡備綍鍒╃敤鍩虹(ch菙)妯″瀷瑙ｆ焙姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鎸戞埌(zh脿n) 

鍦ㄧ3绡€(ji茅)涓�锛屾垜鍊戝垪鍑轰簡姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓殑浜斿€�(g猫)涓昏鎸戞埌(zh脿n)銆傚湪鏈瘈(ji茅)涓�锛屾垜鍊戠附绲�(ji茅)浜嗗熀绀�(ch菙)妯″瀷鈥斺€旂劇(w煤)璜栨槸瑕栬(ju茅)鍜岃獮(y菙)瑷€妯″瀷閭勬槸姗�(j墨)鍣ㄤ汉鍩虹(ch菙)妯″瀷鈥斺€斿浣曚互鏇存湁绲勭箶鐨勬柟寮忓公鍔╄В姹洪€欎簺鎸戞埌(zh脿n)銆�    鎵€鏈夎垏瑕栬(ju茅)淇℃伅鐩搁棞(gu膩n)鐨勫熀绀�(ch菙)妯″瀷锛屽VFMs銆乂LMs鍜孷GMs锛岄兘鐢ㄤ簬姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓殑鎰熺煡妯″銆傝€孡LMs鍓囨洿鍔犲鍔熻兘锛屽彲浠ユ噳(y墨ng)鐢ㄤ簬瑕�(gu墨)鍔冨拰鎺у埗闋�(l菒ng)鍩�銆傛垜鍊戦倓鍦ㄩ€欓噷鍒楀嚭浜哛FMs锛岄€欎簺姗�(j墨)鍣ㄤ汉鍩虹(ch菙)妯″瀷閫氬父鐢ㄤ簬瑕�(gu墨)鍔冨拰鍕�(d貌ng)浣滅敓鎴愭ā濉�銆傛垜鍊�?c猫)璇�?涓附绲�(ji茅)浜嗗熀绀�(ch菙)妯″瀷濡備綍瑙ｆ焙鍓嶈堪鐨勬(j墨)鍣ㄤ汉鎶€琛�(sh霉)鎸戞埌(zh脿n)銆傚緸閫欏€�(g猫)琛ㄤ腑鎴戝€戝彲浠ョ湅鍑猴紝鎵€鏈夊熀绀�(ch菙)妯″瀷閮芥搮闀�(zh菐ng)浜庡悇绋(j墨)鍣ㄤ汉妯″浠诲嫏(w霉)鐨勬硾鍖�銆傛澶�锛孡LMs灏ゅ叾鎿呴暦(zh菐ng)浜庝换鍕�(w霉)瑕�(gu墨)鑼冨寲銆傚彟涓€鏂归潰锛孯FMs鎿呴暦(zh菐ng)铏曠悊鍕�(d貌ng)鍔涘(xu茅)妯″瀷鐨勬寫鎴�(zh脿n)锛屽洜?y脿n)姒囪爾閯�?sh霉)RFMs鏄劇(w煤)妯″瀷鏂规硶銆� 

灏�(du矛)浜庢(j墨)鍣ㄤ汉鎰熺煡锛屾硾鍖栬兘鍔涘拰妯″瀷鐨勬寫鎴�(zh脿n)鏄浉浜掕伅(li谩n)绯荤殑锛屽洜?y脿n)?锛屽鏋滄劅鐭ユā鍨嬪凡?j墨ng)鍏锋湁闈炲父濂界殑娉涘寲鑳藉姏锛岄偅涔堝氨娌�(m茅i)鏈夊繀瑕佺偤浜嗛牁(l菒ng)鍩熼仼鎳�(y墨ng)鎴栭澶栫殑寰(di脿o)鑰岀嵅鍙栨洿澶氭暩(sh霉)鎿�(j霉)銆傛澶�锛岃В姹哄畨鍏ㄦ寫鎴�(zh脿n)鐨勫懠鑱插湪寰堝ぇ绋嬪害涓婄己澶�锛屾垜鍊戝皣鍦ㄧ6绡€(ji茅)涓◣璜栭€欏€�(g猫)鐗规畩鍟�(w猫n)椤�銆傜敤浜庢硾鍖栫殑鍩虹(ch菙)妯″瀷 闆舵娉涘寲鏄暥(d膩ng)鍓嶅熀绀�(ch菙)妯″瀷鐨勬渶椤憲鐗瑰緛涔嬩竴銆傛(j墨)鍣ㄤ汉鎶€琛�(sh霉)骞句箮鍦ㄦ墍鏈夋柟闈㈠拰妯″閮藉彈鐩婁簬鍩虹(ch菙)妯″瀷鐨勬硾鍖栬兘鍔涖€傞鍏�锛孷LM鍜孷FM浣滅偤榛樿獚(r猫n)鐨勬(j墨)鍣ㄤ汉鎰熺煡妯″瀷鍦ㄦ劅鐭ユ柟闈㈢殑娉涘寲鑳藉姏鏄竴鍊�(g猫)寰堝ソ鐨勯伕鎿�銆傜浜屾柟闈㈡槸浠诲嫏(w霉)绱�(j铆)瑕�(gu墨)鍔冪殑娉涘寲鑳藉姏锛岀敱LLMs[24]鐢熸垚浠诲嫏(w霉)瑷�(j矛)鍔冪殑绱�(x矛)绡€(ji茅)銆傜涓夊€�(g猫)鏂归潰鏄亱(y霉n)鍕�(d貌ng)瑕�(gu墨)鍔冨拰鎺у埗鏂归潰鐨勬硾鍖栬兘鍔涳紝閫氶亷(gu貌)鍒╃敤RFMs鐨勫姏閲�銆� 

鐢ㄤ簬鏁�(sh霉)鎿�(j霉)绋€缂虹殑鍩虹(ch菙)妯″瀷 

鍩虹(ch菙)妯″瀷鍦ㄨВ姹烘(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓殑鏁�(sh霉)鎿�(j霉)绋€缂哄晱(w猫n)椤屼笂鑷抽棞(gu膩n)閲嶈銆傚畠鍊�?y艒u)妲绫抽拰淇氬ザ鍥熴€�?sh霉)鎿�(j霉)瀛�(xu茅)缈�(x铆)鍜岄仼鎳�(y墨ng)鏂颁换鍕�(w霉)鎻愪緵浜嗗爡(ji膩n)瀵�(sh铆)鐨勫熀绀�(ch菙)銆備緥濡�锛屾渶杩戠殑鏂规硶鍒╃敤鍩虹(ch菙)妯″瀷鐢熸垚鏁�(sh霉)鎿�(j霉)渚�(l谩i)骞姪瑷�(x霉n)绶存(j墨)鍣ㄤ汉锛屽姗�(j墨)鍣ㄤ汉杌岃贰[236]鍜屼豢鐪焄237]銆傞€欎簺妯″瀷鎿呴暦(zh菐ng)寰炲皯閲忕ず渚嬩腑瀛�(xu茅)缈�(x铆)锛屼娇姗�(j墨)鍣ㄤ汉鑳藉浣跨敤鏈夐檺鐨勬暩(sh霉)鎿�(j霉)蹇€熼仼鎳�(y墨ng)鏂颁换鍕�(w霉)銆傚緸閫欏€�(g猫)瑙掑害渚�(l谩i)鐪嬶紝瑙ｆ焙鏁�(sh霉)鎿�(j霉)绋€缂哄晱(w猫n)椤岀浉鐣�(d膩ng)浜庤В姹烘(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓殑娉涘寲鑳藉姏鍟�(w猫n)椤�銆傞櫎姝や箣澶栵紝鍩虹(ch菙)妯″瀷鈥斺€斿挨鍏舵槸LLMs鍜孷GMs鈥斺€斿彲浠ョ敓鎴愮敤浜庤〒(x霉n)绶存劅鐭ユā濉奫238]锛堣(ji脿n)涓婇潰鐨�4.1.5绡€(ji茅)锛夊拰浠诲嫏(w霉)瑕�(gu墨)鑼冨寲[239]鐨勬(j墨)鍣ㄤ汉鎶€琛�(sh霉)鏁�(sh霉)鎿�(j霉)闆�銆�   

鐢ㄤ簬娓涜紩妯″瀷瑕佹眰鐨勫熀绀�(ch菙)妯″瀷

姝ｅ绗�3.3绡€(ji茅)鎵€瑷庤珫鐨�锛屽缓绔嬫垨?q奴)W缈�(x铆)涓€鍊�(g猫)妯″瀷鈥斺€旂劇(w煤)璜栨槸鐠�(hu谩n)澧冨湴鍦�銆佷笘鐣屾ā鍨嬮倓鏄挵(hu谩n)澧冨嫊(d貌ng)鍔涘(xu茅)妯″瀷鈥斺€斿皪(du矛)浜庤В姹烘(j墨)鍣ㄤ汉鎶€琛�(sh霉)鍟�(w猫n)椤岃嚦闂�(gu膩n)閲嶈锛屽挨鍏舵槸鍦ㄩ亱(y霉n)鍕�(d貌ng)瑕�(gu墨)鍔冨拰鎺у埗鏂归潰銆傜劧鑰�锛屽熀绀�(ch菙)妯″瀷灞曠従(xi脿n)鐨勫挤(qi谩ng)澶х殑灏�/闆舵娉涘寲鑳藉姏鍙兘鏈�(hu矛)鎵撶牬閫欎竴瑕佹眰銆傞€欏寘鎷娇鐢↙LMs鐢熸垚浠诲嫏(w霉)瑷�(j矛)鍔僛24]锛屼娇鐢≧FMs瀛�(xu茅)缈�(x铆)鐒�(w煤)妯″瀷鐨勭鍒扮鎺у埗绛栫暐[27, 256]绛�銆�   

鐢ㄤ簬浠诲嫏(w霉)瑕�(gu墨)鑼冨寲鐨勫熀绀�(ch菙)妯″瀷 

浠诲嫏(w霉)瑕�(gu墨)鑼冨寲浣滅偤瑾�(y菙)瑷€鎻愮ず[24, 27, 28]锛岀洰妯�(bi膩o)鍦栧儚[181, 272]锛屽睍绀轰换鍕�(w霉)鐨勪汉椤�(l猫i)瑕栭牷[273, 274]锛岀崕(ji菐ng)鍕�(l矛)[26, 182]锛岃粚璺＄矖鐣ヨ崏鍦朳239]锛屾斂绛栬崏鍦朳275]鍜屾墜绻湒鍍廩276]锛屼娇鐩(bi膩o)瑕�(gu墨)鑼冨寲浠ヤ竴绋洿鑷劧銆侀(l猫i)浜虹殑鏍煎紡瀵�(sh铆)鐝�(xi脿n)銆傚妯℃厠(t脿i)鍩虹(ch菙)妯″瀷鍏佽ū鐢ㄦ埗(h霉)涓嶅儏鎸囧畾鐩(bi膩o)锛岄倓鍙互閫氶亷(gu貌)灏�(du矛)瑭�(hu脿)瑙ｆ焙姝х京銆傛渶杩戝湪鐞嗚В浜烘(j墨)浜や簰闋�(l菒ng)鍩熶腑鐨勪俊浠诲拰鎰忓湒璀�(sh铆)鍒ユ柟闈㈢殑宸ヤ綔闁�(k膩i)杈熶簡鎴戝€戠悊瑙ｄ汉椤�(l猫i)濡備綍浣跨敤椤紡鍜岄毐寮忕窔(xi脿n)绱㈠偝閬�(d谩)浠诲嫏(w霉)瑕�(gu墨)鑼冨寲鐨勬柊鑼冨紡銆傞洊鐒跺彇寰椾簡椤憲閫�(j矛n)灞�锛屼絾鏈€杩戝湪LLMs鎻愮ず宸ョ▼鏂归潰鐨勫伐浣滆〃鏄�锛屽嵆浣垮彧鏈変竴鍊�(g猫)妯℃厠(t脿i)锛屼篃寰堥洠鐢熸垚鐩搁棞(gu膩n)杓稿嚭銆傝瑕�(ju茅)-瑾�(y菙)瑷€妯″瀷琚瓑鏄庡湪浠诲嫏(w霉)瑕�(gu墨)鑼冨寲鏂归潰灏ゅ叾鎿呴暦(zh菐ng)锛岄’绀哄嚭瑙ｆ焙姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鍟�(w猫n)椤岀殑娼涘姏銆傛摯(ku貌)灞曞熀浜庤瑕�(ju茅)-瑾�(y菙)瑷€鐨勪换鍕�(w霉)瑕�(gu墨)鑼冨寲鐨勭悊蹇�锛屽磾绛変汉[181]鎺㈢储浜嗕娇鐢ㄦ洿鑷劧鐨勮几鍏ワ紝濡傚緸浜掕伅(li谩n)缍�(w菐ng)鐛插彇鐨勫湒鍍�锛屽(sh铆)鐝�(xi脿n)澶氭ā鎱�(t脿i)浠诲嫏(w霉)瑕�(gu墨)鑼冨寲鐨勬柟娉�銆侭rohan绛変汉[27]閫�(j矛n)涓€姝ユ帰绱簡寰炰换鍕�(w霉)鐒�(w煤)闂�(gu膩n)鏁�(sh霉)鎿�(j霉)閫�(j矛n)琛岄浂娆¤綁(zhu菐n)绉荤殑閫欎竴鐞嗗康锛屾彁鍑轰簡涓€鍊�(g猫)鍏锋湁鎿�(ku貌)灞曟ā鍨嬪爆鎬х殑鏂板瀷妯″瀷椤�(l猫i)銆傝┎妯″瀷灏囬珮缍几鍏ュ拰杓稿嚭锛屽寘鎷敐鍍忛牠鍦栧儚銆佹寚浠ゅ拰棣仈(d谩)鍛戒护绶ㄧ⒓鎴愮穵婀婄殑浠ょ墝琛ㄧず锛屼互瀵�(sh铆)鐝�(xi脿n)绉诲嫊(d貌ng)鎿嶇副鍣ㄧ殑瀵�(sh铆)鏅�(sh铆)鎺у埗銆�   

鐢ㄤ簬涓嶇⒑瀹氭€у拰瀹夊叏鐨勫熀绀�(ch菙)妯″瀷 

鐩＄涓嶇⒑瀹氭€у拰瀹夊叏鏄(j墨)鍣ㄤ汉鎶€琛�(sh霉)涓殑闂�(gu膩n)閸靛晱(w猫n)椤�锛屼絾浣跨敤姗�(j墨)鍣ㄤ汉鎶€琛�(sh霉)鍩虹(ch菙)妯″瀷瑙ｆ焙閫欎簺鍟�(w猫n)椤屼粛鐒舵湭琚厖鍒嗘帰绱�?锛孎(xi脿n)鏈夌殑宸ヤ綔锛屽KNOWNO[187]锛屾彁鍑轰簡涓€绋脯(c猫)閲忓拰灏�(du矛)榻婂熀浜嶭LM鐨勪换鍕�(w霉)瑕�(gu墨)鍔冨櫒涓嶇⒑瀹氭€х殑妗嗘灦銆傛渶杩戝湪閺�?zh菙n)鍓夸紟缁у淳缍�277]銆侀枊(k膩i)鏀捐鍖(xu茅)缈�(x铆)[278]鍜孡LMs涓够瑕�(ju茅)璀�(sh铆)鍒279]鏂归潰鐨勯€�(j矛n)灞曞彲鑳界偤瑙ｆ焙閫欎簺鎸戞埌(zh脿n)闁�(k膩i)杈熸柊閫斿緫銆�