嘻道奇闻
- 文章199742
- 阅读14625734
实战中文文本纠错：基于深度学习的语义匹配优化方案
浣犳湁娌℃湁缁忓巻杩囪繖鏍风殑灏村艾锛熸妸"浼氳瀹?鍐欐垚"浼氳瀹?锛屾妸"璐㈠姟鎶ヨ〃"杈撴垚"鎵嶇墿鎶ヨ〃"锛岀粨鏋滅郴缁熷畬鍏ㄧ悊瑙ｄ笉浜嗕綘鐨勬剰鎬濓紵浠婂ぉ鍜变滑灏辨潵鐮磋В杩欎釜闅鹃锛屾墜鎶婃墜鏁欎綘鐢ㄦ繁搴﹀涔犳墦閫犱竴涓仾鏄庣殑鏂囨湰绾犻敊绯荤粺锛?/p>
馃攳 涓轰粈涔堜紶缁熸柟娉曟€荤炕杞︼紵锛堣娉暀璁級
鍏堣璇磋€佸姙娉曠殑鐥涚偣鍚э紒浠ュ墠鐢ㄧ殑瑙勫垯鍖归厤灏卞儚鎷跨潃閿欓鏈竴涓釜瀵圭収锛?/p>
- 鍚岄煶瀛楁浛鎹紙鍖椾含鈫掕儗鏅級
- 褰㈣繎瀛楃籂姝ｏ紙鎷ㄥ彿鈫掓嫈娌筹級
- 甯歌閿欒璇嶅簱锛堥粯榛樻棤闂烩啋鎽告懜鏃犻椈锛?/li>
鈥?strong>鈥嬩絾闂鏉ヤ簡鈥?/strong>鈥嬶細
- 閬囧埌鏂拌瘝灏辨嚨鍦堬紙姣斿"yyds"锛?/li>
- 涓婁笅鏂囩悊瑙ｆ棤鑳斤紙"浠栦竴鎶婃妸鎵嬫妸闂ㄦ妸浣忎簡"锛?/li>
- 鏇存柊缁存姢绱垚鐙楋紙姣忓ぉ鎵嬪姩鍔犳柊璇嶏級
鍘诲勾鏌愬叕鍙哥殑鏁版嵁鏄剧ず锛屼紶缁熸柟娉曗€?strong>鈥嬪湪绀句氦濯掍綋鏂囨湰涓婄殑绾犻敊鍑嗙‘鐜囦笉鍒?0%鈥?/strong>鈥嬶紒杩欏氨鏄负浠€涔堟垜浠璇峰嚭娣卞害瀛︿範杩欎綅鏁戝叺銆?/p>
馃殌 娣卞害瀛︿範鐨勪笁鏉挎枾锛堟牳蹇冩鍣ㄥ簱锛?/h2>
绗竴鎷涳細BERT璇箟鐞嗚В
鈥?strong>鈥嬫€庝箞鐢ㄢ€?/strong>鈥嬶紵灏卞儚璇蜂簡涓鏂囪€佸笀锛?/p>
- 鎶婃暣鍙ヨ瘽鍠傜粰妯″瀷
- 鍒嗘瀽姣忎釜瀛楃殑浣嶇疆鍏崇郴
- 缁撳悎涓婁笅鏂囧垽鏂槸鍚﹀嚭閿?/li>
馃憠 涓句釜鐪熷疄妗堜緥锛氭煇鏂伴椈App鐢˙ERT鍚庯紝鈥?strong>鈥嬫爣棰樼籂閿欏噯纭巼浠?2%椋欏埌89%鈥?/strong>鈥嬶紒鐗瑰埆鏄鐞?鍚岄煶涓嶅悓涔?鐨勬儏鍐碉紝姣斿锛?/p>
- 杈撳叆锛?鍏徃璐㈡斂鍚冪揣"
- 閿欒锛?璐㈡斂鈫掓墠璇?
- 绾犳锛?璐㈡斂鈫掕储璇?
绗簩鎷涳細Transformer娉ㄦ剰鍔涙満鍒?/h3>
杩欎釜鎶€鏈氨鍍忕粰妯″瀷瑁呬簡鎺㈢収鐏細
- 鑷姩鑱氱劍鍏抽敭閿欒鐐?/li>
- 澶勭悊闀挎枃鏈篃涓嶆帀閾惧瓙
- 鑳藉彂鐜拌法澶氬瓧鐨勯敊璇粍鍚?/li>
馃洜锔?鈥?strong>鈥嬪疄鎴樻妧宸р€?/strong>鈥嬶細
- 鐢ㄩ璁粌鐨勪腑鏂囨ā鍨嬶紙濡傚搱宸ュぇ鐨凚ERT-wwm锛?/li>
- 寰皟鏃跺姞鍏ラ鍩熸暟鎹紙姣斿鍖荤枟鏂囨湰鍗曠嫭璁粌锛?/li>
- 娉ㄦ剰鍔涘ご鏁颁笉瑕佽秴杩?2锛堝惁鍒欒绠楅噺鐖嗙偢锛?/li>
绗笁鎷涳細CRF鍐崇瓥浼樺寲
杩欎竴姝ュ氨鍍忚€冭瘯鏈€鍚庢鏌ョ瓟妗堬細
- 鎺ユ敹妯″瀷杈撳嚭鐨勫彲鑳界籂閿欐柟妗?/li>
- 鏍规嵁杞Щ姒傜巼閫夋嫨鏈€浼樿В
- 閬垮厤鍑虹幇"瓒婃敼瓒婇敊"鐨勬儴鍓?/li>
馃搳 鈥?strong>鈥嬫晥鏋滃姣斺€?/strong>鈥嬶細
| 鏂规硶 | 鍑嗙‘鐜?/th> | 璇籂鐜?/th> | 鍝嶅簲鏃堕棿 |
|---|---|---|---|
| 绾疊ERT | 86% | 15% | 200ms |
| BERT+CRF | 91% | 8% | 220ms |
| 浜虹被涓撳 | 95% | 5% | 3000ms |
馃洜锔?浜旀鎼缓瀹炴垬绯荤粺锛堟墜鎶婃墜鏁欏锛?/h2>
绗竴姝ワ細鏁版嵁鍑嗗
鈥?strong>鈥嬭鍑嗗鍝簺鏁版嵁鈥?/strong>鈥嬶紵
- 100涓囨潯甯﹂敊璇爣娉ㄧ殑鏂囨湰锛堟煇瀹濇湁鐜版垚鐨勬暟鎹泦锛?/li>
- 棰嗗煙璇嶅簱锛堥噾铻嶃€佸尰鐤椼€佹硶寰嬬瓑锛?/li>
- 鐢ㄦ埛鎼滅储鏃ュ織锛堝惈姝ｇ‘缁撴灉鐐瑰嚮鏁版嵁锛?/li>
鈿狅笍 鈥?strong>鈥嬮伩鍧戞寚鍗椻€?/strong>鈥嬶細
鍒洿鎺ョ敤鍏紑鐨勬柊闂昏鏂欙紒鐪熷疄鍦烘櫙鐨勯敊璇垎甯冨畬鍏ㄤ笉鍚岋紝姣斿锛?/p>
- 绀句氦濯掍綋鏂囨湰閿欒鐜囨槸鏂伴椈鐨?鍊?/li>
- 鎷奸煶閿欒鍗犳瘮楂樿揪42%
- 绠€绻佹贩鐢ㄩ敊璇秺鏉ヨ秺甯歌
绗簩姝ワ細妯″瀷閫夊瀷
鈥?strong>鈥嬫帹鑽愮粍鍚堟嫵鈥?/strong>鈥嬶細
- BERT鍋氳涔夌紪鐮?/li>
- BiLSTM鎹曟崏搴忓垪鐗瑰緛
- CRF鍋氭渶缁堝喅绛?/li>
馃挕 鈥?strong>鈥嬩釜浜哄績寰椻€?/strong>鈥嬶細
ELECTRA妯″瀷姣擝ERT鏇撮€傚悎杩欎釜浠诲姟锛佸畠鍦ㄨ缁冩椂鐢ㄤ簡鏇挎崲妫€娴嬬殑鏂规硶锛屽ぉ鐢熼€傚悎鎵鹃敊璇偣銆傛煇娆″疄楠屼腑锛孍LECTRA姣擝ERT鈥?strong>鈥嬭妭鐪?0%璁粌鏃堕棿锛屽噯纭巼杩橀珮2%鈥?/strong>鈥嬨€?/p>
绗笁姝ワ細璁粌鎶€宸?/h3>
鈥?strong>鈥嬩笁涓叧閿偣鈥?/strong>鈥嬶細
- 鍔ㄦ€乵ask绛栫暐锛氶殢鏈洪伄鐩?5%鐨勫瓧绗?/li>
- 娓愯繘寮忓涔狅細鍏堣缁冨瓧绾у埆绾犻敊锛屽啀缁冭瘝绾у埆
- 瀵规姉璁粌锛氬姞鍏?0%鐨勫共鎵版牱鏈彁鍗囬瞾妫掓€?/li>
馃敟 鈥?strong>鈥嬮粦绉戞妧鈥?/strong>鈥嬶細
璇曡瘯Focal Loss锛佽繖涓崯澶卞嚱鏁扮壒鍒€傚悎澶勭悊閿欒鏍锋湰绋€灏戠殑鎯呭喌锛屽疄娴嬭兘璁╂ā鍨嬧€?strong>鈥嬪湪灏忔牱鏈満鏅笅鐨勫噯纭巼鎻愬崌7%鈥?/strong>鈥嬨€?/p>
馃専 鐙鍙戠幇锛氳涔夊尮閰嶇殑闅愯棌鐜╂硶
鏈€杩戝湪缁欐煇鐢靛晢骞冲彴鍋氫紭鍖栨椂锛屾垜浠彂鐜颁釜鏈夎叮鐜拌薄锛氣€?strong>鈥嬪姞鍏ュ晢鍝佺煡璇嗗浘璋卞悗锛岀籂閿欏噯纭巼鍙堟彁鍗囦簡12%鈥?/strong>鈥嬶紒姣斿锛?/p>
- 閿欒杈撳叆锛?鑻规灉鎵嬪嚑"
- 鏅€氱籂閿欙細"鑻规灉鎵嬭"
- 缁撳悎鐭ヨ瘑鍥捐氨锛?鑻规灉鎵嬫満"
杩欒鏄庣湡姝ｇ殑璇箟绾犻敊涓嶈兘鍙湅鏂囨湰锛岃繕瑕佹噦琛屼笟鐭ヨ瘑銆傛垜浠幇鍦ㄦ鍦ㄨ瘯楠屾妸鐭ヨ瘑鍥捐氨宓屽叆鍒版敞鎰忓姏鏈哄埗涓紝鍒濇缁撴灉寰堣浜哄叴濂嬧€斺€旇繖鍙兘鏄笅涓€浠ｇ籂閿欑郴缁熺殑绐佺牬鐐癸紒
鍐欏畬杩欎簺锛岀獊鐒舵兂璧蜂笂鍛ㄩ亣鍒扮殑鐪熷疄妗堜緥锛氱敤鎴疯緭鍏?濡備綍娌荤枟鑴卞彂"锛岀粨鏋滄墦鎴?濡備綍娌荤枟鑴辨硶"锛岀郴缁熺珶鐒舵帹鑽愪簡銆婂垜娉曚慨姝ｆ瑙ｈ銆?..鐪嬫潵鎴戜滑鐨勬ā鍨嬭繕瑕佺户缁慨鐐煎晩锛佷綘浠繕瑙佽繃浠€涔堝摥绗戜笉寰楃殑绾犻敊缈昏溅鐜板満锛熸杩庡湪璇勮鍖哄悙妲絶