{"id":12227,"date":"2024-07-14T19:14:54","date_gmt":"2024-07-14T11:14:54","guid":{"rendered":"https:\/\/ihower.tw\/blog\/?p=12227"},"modified":"2025-07-04T07:24:29","modified_gmt":"2025-07-03T23:24:29","slug":"reranker","status":"publish","type":"post","link":"https:\/\/ihower.tw\/blog\/12227-reranker","title":{"rendered":"\u4f7f\u7528\u7e41\u9ad4\u4e2d\u6587\u8a55\u6e2c\u5404\u5bb6 Reranker \u6a21\u578b\u7684\u91cd\u6392\u80fd\u529b"},"content":{"rendered":"\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u60f3\u7cfb\u7d71\u6027\u5b78\u7fd2\u5982\u4f55\u6253\u9020 LLM\u3001RAG \u548c Agents \u61c9\u7528\u55ce? \u6b61\u8fce\u5831\u540d\u6211\u7684\u8ab2\u7a0b\u00a0<a href=\"https:\/\/aihao.tw\/llm\">\u5927\u8a9e\u8a00\u6a21\u578b LLM \u61c9\u7528\u958b\u767c\u5de5\u4f5c\u574a<\/a><\/p>\n<\/blockquote>\n\n\n\n<p>\u63a5\u7e8c\u4e0a\u4e00\u7bc7 <a href=\"https:\/\/ihower.tw\/blog\/archives\/12167\">Embedding \u6a21\u578b\u8a55\u6e2c<\/a>\uff0c\u9019\u6b21\u6211\u5011\u4f86\u770b\u770b\u642d\u914d Reranker (\u91cd\u6392)\u6a21\u578b\uff0c\u505a\u6210\u4e8c\u968e\u6bb5\u6aa2\u7d22\u6703\u662f\u4ec0\u9ebc\u60c5\u6cc1\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"457\" data-attachment-id=\"12229\" data-permalink=\"https:\/\/ihower.tw\/blog\/12227-reranker\/xnip2024-07-14_15-29-30\" data-orig-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30.jpg\" data-orig-size=\"1694,756\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"Xnip2024-07-14_15-29-30\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30-300x134.jpg\" data-large-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30-1024x457.jpg\" src=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30-1024x457.jpg\" alt=\"\" class=\"wp-image-12229\" srcset=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30-1024x457.jpg 1024w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30-300x134.jpg 300w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30-768x343.jpg 768w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30-1536x685.jpg 1536w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30-1568x700.jpg 1568w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/Xnip2024-07-14_15-29-30.jpg 1694w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>\u5716\u7247\u51fa\u8655: <a href=\"https:\/\/blog.voyageai.com\/2024\/03\/15\/boosting-your-search-and-rag-with-voyages-rerankers\/\">Boosting Your Search and RAG with Voyage\u2019s Rerankers<\/a><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\u4ec0\u9ebc\u662f\u4e8c\u968e\u6bb5\u6aa2\u7d22?<\/h3>\n\n\n\n<p>Reranker \u6a21\u578b\u662f\u53e6\u4e00\u7a2e\u4e0d\u4e00\u6a23\u7684\u6a21\u578b(\u5b78\u540d\u53eb\u505a Cross-Encoder)\uff0c\u4e0d\u540c\u65bc embedding \u6a21\u578b(\u5b78\u540d\u53eb\u505a Bi-Encoder) \u8f38\u5165\u662f\u6587\u5b57\uff0c\u8f38\u51fa\u662f\u9ad8\u7dad\u5ea6\u5411\u91cf\u3002Reranker \u6a21\u578b\u7684\u8f38\u5165\u662f\u5169\u6bb5\u6587\u5b57\uff0c\u8f38\u51fa\u4e00\u500b\u76f8\u95dc\u6027\u5206\u6578 0 \u5230 1 \u4e4b\u9593\uff0c\u4e5f\u5c31\u662f\u6211\u5011\u6703\u5c07\u7528\u6236 query \u8ddf\u6bcf\u4e00\u4efd\u6587\u4ef6\u90fd\u53bb\u7b97\u76f8\u95dc\u6027\u5206\u6578\uff0c\u7136\u5f8c\u6839\u64da\u5206\u6578\u6392\u5e8f\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image is-resized\"><img decoding=\"async\" src=\"https:\/\/cdn.gamma.app\/t2dzhthyf839zum\/0bc5064184184d3cbc2a64d0ccf0fae3\/original\/Bi_vs_Cross-Encoder.png\" alt=\"\" style=\"width:632px;height:auto\"\/><\/figure>\n\n\n\n<p>Reranker \u7684\u57f7\u884c\u901f\u5ea6\u8f03\u6162\uff0c\u6210\u672c\u8f03\u9ad8\uff0c\u4f46\u5728\u5224\u65b7\u76f8\u95dc\u6027\u4e0a\u9762\uff0c\u6bd4 embedding \u6a21\u578b\u66f4\u6e96\u78ba<br>\u56e0\u6b64\u7576\u8cc7\u6599\u975e\u5e38\u591a\u3001\u60f3\u8981\u5feb\u53c8\u8981\u6e96\u6642\uff0c\u8ddf embeddings \u6a21\u578b\u642d\u914d\uff0c\u505a\u6210\u5169\u968e\u6bb5\u6aa2\u7d22\uff0c\u662f\u524d\u4eba\u505a\u63a8\u85a6\u5f15\u64ce\u6642\u5c31\u767c\u660e\u7684\u62db\u5f0f\u3002<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u7b2c\u4e00\u968e\u6bb5: \u5f9e\u4e0a\u842c\u4e0a\u5104\u7b46\u8cc7\u6599\u4e2d\uff0c\u7528 Embedding \u5411\u91cf\u76f8\u4f3c\u6027\uff0c\u641c\u5c0b\u51fa\u524d\u6578\u5341\u540d\u5230\u6578\u767e\u7b46<\/li>\n\n\n\n<li>\u7b2c\u4e8c\u968e\u6bb5: \u5f9e\u6578\u5341\u5230\u5e7e\u767e\u7b46\u8cc7\u6599\u4e2d\uff0c\u7528 Reranker \u9032\u884c\u7cbe\u7d30\u7684\u76f8\u95dc\u6027\u6392\u5e8f<\/li>\n<\/ul>\n\n\n\n<!--more-->\n\n\n\n<h3 class=\"wp-block-heading\">\u8a55\u6e2c\u65b9\u6cd5<\/h3>\n\n\n\n<p>\u6211\u6311\u9078\u4e86 4 \u500b embedding \u6a21\u578b\uff0c\u4ee5\u53ca 10 \u500b Reranker \u6a21\u578b\uff0ctop-k \u53d6 10, 50, 100 \u4e09\u7a2e\uff0c\u5171\u6709 78 \u7a2e\u7d44\u5408\u3002<\/p>\n\n\n\n<p>\u76f8\u6bd4\u65bc\u4e0a\u6b21\u4e00\u968e\u6bb5\u6aa2\u7d22\u53ea\u7528 embedding \u6a21\u578b\u6311\u51fa top 5\uff0c\u9019\u6b21\u63a1\u7528\u4e8c\u968e\u6bb5\u6aa2\u7d22\u662f\u5148\u7528 embedding \u6a21\u578b\u6311\u51fa top-k 10\/50\/100\uff0c\u7136\u5f8c\u518d\u7528 Reranker \u6a21\u578b\u91cd\u6392\u53d6\u51fa top 5 \u5f8c\uff0c\u518d\u8a55\u5206\u547d\u4e2d\u7387\u548c MRR (\u5012\u6578\u6392\u540d)<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\u8a55\u6e2c\u7d50\u679c<\/h3>\n\n\n\n<p><a href=\"https:\/\/docs.google.com\/spreadsheets\/d\/1dVqlSiyE6D91mDy2pm9jmq03m9u4RYZGuLu2-X9pWss\/edit?usp=sharing\">\u8a55\u4f30\u6578\u64da\u7d50\u679c google spreadsheets \u50b3\u9001\u9580 \u2197\ufe0f<\/a><\/p>\n\n\n\n<p>OpenAI text-embedding-3-small \u642d\u914d\u4e0d\u540c Reranker \u548c top-k \u505a\u4e8c\u968e\u6bb5\u6aa2\u7d22<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"624\" data-attachment-id=\"12271\" data-permalink=\"https:\/\/ihower.tw\/blog\/12227-reranker\/image-1-3\" data-orig-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1.png\" data-orig-size=\"1691,1031\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"image-1\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1-300x183.png\" data-large-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1-1024x624.png\" src=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1-1024x624.png\" alt=\"\" class=\"wp-image-12271\" srcset=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1-1024x624.png 1024w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1-300x183.png 300w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1-768x468.png 768w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1-1536x936.png 1536w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1-1568x956.png 1568w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-1.png 1691w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>voyage-multilingual-2 \u642d\u914d\u4e0d\u540c Reranker \u548c top-k \u505a\u4e8c\u968e\u6bb5\u6aa2\u7d22<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"619\" data-attachment-id=\"12272\" data-permalink=\"https:\/\/ihower.tw\/blog\/12227-reranker\/image-2-4\" data-orig-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2.png\" data-orig-size=\"1349,815\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"image-2\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2-300x181.png\" data-large-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2-1024x619.png\" src=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2-1024x619.png\" alt=\"\" class=\"wp-image-12272\" srcset=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2-1024x619.png 1024w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2-300x181.png 300w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2-768x464.png 768w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/image-2.png 1349w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p>\u5168\u90e8\u6392\u540d<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><a href=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark.jpeg\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"664\" data-attachment-id=\"12230\" data-permalink=\"https:\/\/ihower.tw\/blog\/12227-reranker\/reranker-benchmark\" data-orig-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark.jpeg\" data-orig-size=\"2357,1528\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"reranker-benchmark\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-300x194.jpeg\" data-large-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-1024x664.jpeg\" src=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-1024x664.jpeg\" alt=\"\" class=\"wp-image-12230\" style=\"width:1157px;height:auto\" srcset=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-1024x664.jpeg 1024w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-300x194.jpeg 300w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-768x498.jpeg 768w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-1536x996.jpeg 1536w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-2048x1328.jpeg 2048w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/07\/reranker-benchmark-1568x1017.jpeg 1568w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">\u6536\u7a6b\u5e7e\u9ede\u5fc3\u5f97<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u9a5a\u4eba\u7684\u6e96\u78ba\u7387: voyage-multilingual-2 embedding \u642d\u914d Voyage rerank-1 (k=100) \u6210\u529f\u63d0\u5347\u5230\u547d\u4e2d\u7387 99.88% \u4e86\uff0c3393\u984c\u53ea\u67094\u984c\u6c92\u6709\u628a\u6b63\u78ba context \u9078\u9032 top 5\uff0c\u800c\u4e14\u7d55\u5927\u90e8\u5206\u90fd\u662f top 1<\/li>\n\n\n\n<li>\u4f7f\u7528 Reranker \u9032\u884c\u4e8c\u968e\u6bb5\u6392\u5e8f\u78ba\u5be6\u80fd\u986f\u8457\u63d0\u5347\u547d\u4e2d\u7387\u3002\u5373\u4f7f\u662f\u8f03\u5f31\u7684 Embedding \u6a21\u578b\u4f8b\u5982 OpenAI small \uff0c\u5728\u9996\u8f2a top-k 100 \u7684\u60c5\u6cc1\u4e0b\u91cd\u6392\u53d6\u524d 5\uff0c\u4e5f\u80fd\u9054\u5230 98% \u7684\u8d85\u9ad8\u6e96\u78ba\u7387\uff0c<strong>\u8d85\u8d8a\u6240\u6709\u53ea\u7528 Embedding \u6a21\u578b\u7684\u4e00\u968e\u6bb5\u6aa2\u7d22<\/strong>\u3002<\/li>\n\n\n\n<li>\u7b2c\u4e00\u968e\u6bb5 top-k \u503c\u8d8a\u5927\u6700\u5f8c\u7684\u7d50\u679c\u8d8a\u597d\uff0c\u7576\u7136\u9650\u5236\u662f Reranker \u7684 latency \u548c API \u6210\u672c\u3002\u7528 top-k 10 \u7684\u78ba\u592a\u5c0f\u4e86\u3002\u82e5\u6587\u4ef6 chunk \u662f 500 tokens \u53ef\u7528 top-k 100\uff0c\u82e5 chunk \u662f 1000 tokens \u53ef\u7528 top-k 50\uff0c\u5982\u6b64\u624d\u53ef\u4ee5\u5145\u5206\u767c\u63ee Reranker \u6a21\u578b\u7684\u512a\u52e2\u3002<\/li>\n\n\n\n<li>\u6216\u662f\u8003\u616e\u505a\u6210\u52d5\u614b top-k \u4f86\u7bc0\u7701\u6210\u672c: \u53ef\u6839\u64da\u7b2c\u4e00\u968e\u6bb5\u641c\u5c0b\u7684\u76f8\u4f3c\u6027\u5206\u6578\uff0c\u8d85\u904e\u67d0\u500b\u4f4e\u6a19\u624d\u9032\u53bb\u7b2c\u4e8c\u968e\u6bb5\u91cd\u6392<\/li>\n\n\n\n<li>\u91cd\u6392\u53ef\u5c07 MRR \u5927\u5e45\u63d0\u5347\u5230\u63a5\u8fd1\u547d\u4e2d\u7387\uff0c\u9019\u4ee3\u8868\u91cd\u6392\u4e4b\u5f8c\u5f88\u591a\u6b63\u78ba\u7b54\u6848\u5c31\u88ab\u6392\u5230\u7b2c\u4e00\u4f4d\u7f6e\uff0c\u9019\u5c0d\u5f8c\u7e8c LLM \u751f\u6210\u6703\u6709\u5e6b\u52a9\u3002\u800c\u4e14\u82e5 LLM context window \u6709\u9650\u6216\u60f3\u7bc0\u7701 LLM tokens \u6210\u672c\uff0c\u900f\u904e reranker \u91cd\u6392\u5f8c\u53d6 top 3\uff0c\u4e5f\u53ef\u4ee5\u6709\u6548\u7bc0\u7701 RAG \u8017\u8cbb\u7684 tokens \u91cf<\/li>\n\n\n\n<li>\u9806\u9053\u4e00\u63d0\uff0c\u91cd\u6392\u4e5f\u53ef\u4ee5\u7528\u5728\u5408\u4f75\u591a\u7a2e\u7b2c\u4e00\u968e\u6bb5\u641c\u5c0b\u7d50\u679c\u5217\u8868\uff0c\u4f8b\u5982\u5c07\u7528\u6236\u67e5\u8a62\uff0c\u900f\u904e LLM \u505a\u4e00\u6b21 Query Expansion \u5e73\u884c\u641c\u7d22\u51fa\u591a\u500b\u7d50\u679c\u5217\u8868\uff0c\u53bb\u9664\u91cd\u8907\u5f8c\u518d\u5408\u4f75\u4e1f\u9032 Reranker \u91cd\u6392<\/li>\n\n\n\n<li>\u5c0d\u65bc\u5b8c\u5168\u4e0d\u652f\u63f4\u4e2d\u6587\u7684 Reranker \u6a21\u578b\uff0c\u4f8b\u5982 cross-encoder\/ms-marco-MiniLM-L-6-v2\uff0c\u7576 top-k \u589e\u52a0\u6642\uff0c\u547d\u4e2d\u7387\u53cd\u800c\u4e0b\u964d\uff0c\u6392\u7684\u8d8a\u591a\u6027\u80fd\u8d8a\u5dee\uff0c\u7b11\u6b7b<\/li>\n\n\n\n<li>\u4e0d\u540c\u65bc Embedding \u6a21\u578b\u7684\u6210\u672c\u5728\u524d\u671f\u6e96\u5099\u7d22\u5f15\u968e\u6bb5\uff0cReranker \u6a21\u578b\u547c\u53eb API \u6210\u672c\u5728\u5f8c\u671f\u7528\u6236 query \u7684\u7528\u91cf<\/li>\n\n\n\n<li>\u540c\u7406\uff0c\u4e5f\u56e0\u70ba\u91cd\u6392\u767c\u751f\u5728\u7528\u6236 query \u7576\u4e0b\uff0c\u56e0\u6b64 Reranker \u7684\u901f\u5ea6\u883b\u91cd\u8981\u7684\uff0c\u5e7e\u767e\u6beb\u79d2\u6211\u9084\u53ef\u4ee5\u63a5\u53d7\uff0c\u8d85\u904e 1\u79d2 \u6211\u4e0d\u884c<\/li>\n\n\n\n<li>\u958b\u6e90\u6a21\u578b\u53ea\u6709 bge-reranker-base (n=10) \u6211\u5728\u672c\u6a5f MBP pro m2 \u9084\u53ef\u4ee5\u8dd1\uff0c\u5176\u4ed6\u9700\u8981\u4f7f\u7528 GPU \u4e0d\u7136\u6703\u592a\u6162\uff0c\u6211\u8a55\u6e2c\u662f\u7528 Google Colab \u958b A100 GPU \u53bb\u8dd1 bge-reranker \u7cfb\u5217\u3002<\/li>\n\n\n\n<li>\u7d9c\u5408\u5e7e\u500b\u9078 Reranker \u7684 trade-off \u56e0\u7d20: \u642d\u914d\u7684 embedding \u6a21\u578b\u3001\u6e96\u78ba\u7387\u6027\u80fd\u3001\u901f\u5ea6\u3001\u50f9\u683c\u3001\u7b2c\u4e00\u968e\u6bb5 top-k \u9078\u591a\u5c11\uff0c\u7b2c\u4e8c\u968e\u6bb5 top-n \u9078\u591a\u5c11\u3001\u6a21\u578b\u6700\u5927\u8f38\u5165\u9577\u5ea6\u3001API \u8a08\u8cbb\u65b9\u5f0f\u6216\u662f\u958b\u6e90\u90e8\u7f72\u6210\u672c\u3002<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">\u7d50\u8ad6<\/h3>\n\n\n\n<p>Reranker \u505a\u7684\u4eba\u6bd4\u8f03\u5c11\uff0c\u6709\u505a\u4e2d\u6587\u7684\u9078\u64c7\u53c8\u66f4\u5c11\u4e86\uff0c\u57fa\u672c\u5c31\u56db\u5bb6 <a href=\"https:\/\/docs.voyageai.com\/docs\/reranker\">Voyage<\/a>, <a href=\"https:\/\/docs.cohere.com\/docs\/overview\">Cohere<\/a>, <a href=\"https:\/\/jina.ai\/reranker\/\">Jina<\/a> \u8ddf\u958b\u6e90\u7684 <a href=\"https:\/\/huggingface.co\/BAAI\/bge-reranker-v2-m3\">bge \u7cfb\u5217<\/a>:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u6027\u80fd: Voyage &gt;  bge-m3 &gt; Cohere &gt; Jina <\/li>\n\n\n\n<li>\u901f\u5ea6: bge-m3(\u6709 A100 GPU \u7684\u8a71) &gt; Cohere &gt; Voyage &gt; Jina &gt; bge-m3 (\u53ea\u6709 CPU \u7684\u8a71)<\/li>\n\n\n\n<li>API \u50f9\u9322: Cohere &gt; Voyage &gt; Jina\n<ul class=\"wp-block-list\">\n<li>\u4ee5 Voyage \u8cbb\u7387 USD 0.05 per 1M tokens \u4f86\u4f30\u7b97\uff0c\u82e5 chunk \u662f 500 tokens \u52a0\u4e0a\u7b2c\u4e00\u968e\u6bb5 top-k 100 \u7684\u8a71\uff0c\u55ae\u6b21\u91cd\u6392\u7684\u8cbb\u7528\u662f 0.0025 \u7f8e\u91d1 = 0.08 \u53f0\u5e63<\/li>\n\n\n\n<li>Jina \u8cbb\u7387\u662f USD 0.02 per 1M tokens<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<p>\u5f9e\u6210\u672c\u4e0a\u63a2\u8a0e:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Voyage \u8ddf Cohere \u90fd\u662f\u9802\u7d1a Reranker\uff0c\u6700\u5927\u5dee\u5225\u5176\u5be6\u662f API \u8a08\u50f9\u65b9\u5f0f<\/li>\n\n\n\n<li>Cohere API \u7684\u8a08\u50f9\u5f88\u7279\u5225\uff0c\u662f\u7528\u641c\u7d22\u6b21\u6578\u6bcf\u4e00\u5343\u6b21 USD $2 \uff0c\u800c Voyage \u8ddf Jina \u90fd\u662f\u7b97 tokens \u6578\u3002\u6211\u89ba\u5f97\u7528 tokens \u8a08\u50f9\u6bd4\u8f03\u6709\u5f48\u6027\u6709\u7701\u9322\u7a7a\u9593\u3002<\/li>\n\n\n\n<li>\u6211\u5f97\u51fa\u7684\u516c\u5f0f\u79d8\u8a23\u662f\u82e5\u6587\u4ef6 chunk \u7684 tokens \u6578\u4e58\u4e0a top-k \u8d85\u904e 4 \u842c\uff0c\u9078 cohere \u6bd4\u8f03\u4fbf\u5b9c\uff0c\u53cd\u4e4b\u9078 voyage \u4fbf\u5b9c<\/li>\n\n\n\n<li>Jina API \u96d6\u6bd4\u8f03\u4fbf\u5b9c\uff0c\u4f46\u662f API \u662f\u6700\u6162\u7684\uff0c\u5373\u4f7f\u53ea\u6709 10 chunks \u4e5f\u8981\u82b1\u500b 1 \u79d2 (\u6574\u500b\u6aa2\u7d22\u968e\u6bb5\u548c\u7db2\u8def\u5f80\u8fd4)\uff0c100 chunks \u8981 2 \u79d2\uff0c\u6709\u9ede\u53ef\u60dc<\/li>\n\n\n\n<li>\u81f3\u65bc\u958b\u6e90\u6a21\u578b\uff0c\u4f60\u9700\u8981\u90e8\u7f72 GPU \u624d\u80fd\u628a\u91cd\u6392\u901f\u5ea6\u58d3\u5230 1 \u79d2\u4ee5\u5167<\/li>\n<\/ul>\n\n\n\n<p>\u5f9e\u61c9\u7528\u5834\u666f\u63a2\u8a0e:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u5982\u679c\u4f60\u6709\u5f88\u591a\u5f88\u591a\u6587\u4ef6\uff0c\u4f46\u662f\u7528\u6236\u67e5\u8a62\u91cf\u5176\u5be6\u4e0d\u7b97\u591a\uff0c\u4f8b\u5982\u4f01\u696d\u5167\u5834\u666f\n<ul class=\"wp-block-list\">\n<li>\u9019\u6a23\u9069\u5408\u7528\u4fbf\u5b9c\u7684 embeddings \u6a21\u578b\uff0c\u642d\u914d top-k 100 \u505a\u91cd\u6392\u53d6\u524d3\u524d5\uff0c\u628a\u6210\u672c\u82b1\u5728\u5f8c\u671f query \u52d5\u614b\u968e\u6bb5<\/li>\n\n\n\n<li><a href=\"https:\/\/platform.openai.com\/docs\/guides\/embeddings\">OpenAI text-embedding-3-small<\/a> + Cohere \u6216 Voyage \u7684 Re-ranker<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>\u5982\u679c\u4f60\u6587\u4ef6\u4e0d\u7b97\u591a\uff0c\u4f46\u662f\u7e3d\u7528\u6236\u67e5\u8a62\u91cf\u6bd4\u8f03\u591a\uff0c\u4f8b\u5982 B2C \u5834\u666f\n<ul class=\"wp-block-list\">\n<li>\u9019\u6a23\u9069\u5408 Embeddings \u6a21\u578b\u7528\u9ad8\u7d1a\u7684\uff0cReranker \u53ef\u80fd\u5c31\u4f4e\u914d\u7701\u9ede\uff0c\u628a\u6210\u672c\u82b1\u5728\u524d\u671f\u56fa\u5b9a\u6210\u672c<\/li>\n\n\n\n<li>&nbsp;<a href=\"https:\/\/www.voyageai.com\/\">voyage-multilingual-2<\/a> + Voyage Re-ranker (\u628a top-k \u53d6\u5c0f\u4e00\u9ede\u7bc0\u7701\u6210\u672c)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<p>\u5728\u9019\u500b\u7cfb\u5217\u5be6\u6e2c\u4e4b\u524d\uff0c\u6211\u5c0d Embedding \u6e96\u78ba\u6027\u7684\u60f3\u50cf\u5927\u6982\u5c31\u662f\u4e00\u500b\u4e5d 90%\uff0c\u6c92\u60f3\u5230 Voyage embedding \u53ef\u4ee5\u505a\u5230\u5169\u500b\u4e5d 99% \uff0c\u4e26\u4e14\u52a0\u4e0a Reranker \u4e4b\u5f8c\uff0c\u9084\u53ef\u4ee5\u518d\u63d0\u5347\u5230\u4e09\u500b\u4e5d 99.9%\uff0c\u771f\u7684\u662f\u5f88\u731b\u3002<\/p>\n\n\n\n<p>\u7576\u7136\uff0cRAG \u7cfb\u7d71\u6709\u5f88\u591a\u74b0\u7bc0\uff0c\u81f3\u5c11 Embedding + Reranker \u9019\u90e8\u5206\u662f\u53ef\u4ee5\u5f88\u6e96\u7684\u3002\u6700\u5f8c RAG \u8f38\u51fa\u7d50\u679c\u82e5\u4e0d\u597d\uff0c\u5f88\u53ef\u80fd\u662f\u5176\u4ed6\u74b0\u7bc0\u7684\u554f\u984c\u8981\u6539\u5584\uff0c\u4f8b\u5982\u5207\u584a(chunking) \u6216 LLM \u751f\u6210\u8f38\u51fa\u968e\u6bb5\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\u66f4\u591a\u7d30\u7bc0\u88dc\u5145<\/h3>\n\n\n\n<p>\u7a0b\u5f0f\u78bc\u653e\u5728 github \u4e0a\u4e86:&nbsp;<a href=\"https:\/\/github.com\/ihower\/zh-tw-embedding-model-benchmark\">github.com\/ihower\/zh-tw-embedding-model-benchmark<\/a> \u627e reranker-{provider}.py<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Reranker \u6a21\u578b\u7684 context length \u9577\u5ea6\u9650\u5236\u662f query \u8ddf document chunk \u52a0\u8d77\u4f86\u3002\u901a\u5e38\u7528\u6236 query \u6bd4\u8f03\u77ed\u5566\uff0c\u4e0d\u592a\u6703\u8d85\u904e 100 tokens\u3002\u81f3\u65bc document chunk \u901a\u5e38\u5728 500~2000 \u4e4b\u9593\u6bd4\u8f03\u5e38\u898b<\/li>\n\n\n\n<li>Voyage reranker\n<ul class=\"wp-block-list\">\n<li>\u8f38\u5165\u652f\u63f4\u5230 8000 tokens\uff0c\u8d85\u904e\u9810\u8a2d\u6703\u622a\u65b7<\/li>\n\n\n\n<li>API \u662f\u7528 tokens \u6578\u7b97\u8cbb\u7528<\/li>\n\n\n\n<li>\u652f\u63f4\u591a\u8a9e\u7cfb\u7684 rerank-1 \u6a21\u578b\u662f 0.05 per 1M tokens (\u5c0d\u6bd4 gpt-3.5 \u662f 0.5)<\/li>\n\n\n\n<li>rerank-lite-1 \u6a21\u578b\u662f 0.02 per 1M tokens<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Cohere reranker\n<ul class=\"wp-block-list\">\n<li>\u8f38\u5165\u652f\u63f4\u5230 4096 tokens\uff0c\u8d85\u904e\u81ea\u52d5\u5e6b\u4f60\u62c6 chunks\uff0c\u6bcf\u500b chunk \u7b97\u76f8\u95dc\u6027\u5206\u6578\uff0c\u7136\u5f8c\u53d6\u6700\u9ad8\u5206\u7d66\u4f60<\/li>\n\n\n\n<li>API \u8cbb\u7528\u662f\u7167\u547c\u53eb\u6b21\u6578\u7684\uff0c\u6bcf 1000 \u6b21 $2 \u5143<\/li>\n\n\n\n<li>\u6bcf\u6b21\u547c\u53eb\u81f3\u591a100\u4efd\u6587\u4ef6\uff0c510 tokens \u4ee5\u5167\u7b97\u4e00\u4efd\uff0c\u8d85\u904e\u8981\u591a\u7b97\u4e00\u4efd<\/li>\n\n\n\n<li>\u56e0\u6b64\u82e5 chunk \u53ea\u6709 500\uff0c\u5efa\u8b70\u5c31 k = 100 \u4efd\u7d66\u4ed6\uff0c\u5982\u679c chunk \u662f 1000\uff0c\u5efa\u8b70 k = 50\u3002\u56e0\u70ba\u4f60 k \u5c31\u7b97\u5c11\u4e1f\u4e00\u9ede\u4e5f\u4e00\u6a23\u50f9\u9322\uff0c\u53ea\u5dee\u5728 latency \u6162\u4e00\u9ede\u9ede\u800c\u5df2<\/li>\n\n\n\n<li>Cohere API \u7684\u901f\u5ea6\u76f8\u6bd4\u5176\u4ed6\u5bb6\u662f\u6700\u5feb\u7684\uff0ck = 100 \u4e5f\u53ef\u4ee5\u5728 600ms \u5de6\u53f3\u5b8c\u6210<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Jina reranker\n<ul class=\"wp-block-list\">\n<li>jina-reranker-v2-base-multilingual \u6709\u958b\u6e90\u4f46\u6388\u6b0a\u662f CC-BY-NC-4.0 \u7121\u6cd5\u5546\u7528<\/li>\n\n\n\n<li>\u8f38\u5165\u9577\u5ea6\u4e0a\u9650\u662f 1024 tokens\uff0c\u8d85\u904e\u5e6b\u4f60\u62c6 chunk \u5206\u958b\u7b97\uff0c\u731c\u6e2c\u8ddf Cohere \u4e00\u6a23\u53d6\u6700\u9ad8\u5206<\/li>\n\n\n\n<li>API \u50f9\u683c\u662f 0.02 per 1M tokens \u6bd4\u8f03\u4fbf\u5b9c\uff0c\u4f46\u6700\u5927\u7f3a\u9ede\u6211\u8a8d\u70ba\u662f API \u901f\u5ea6\u592a\u6162\u4e86\uff0c\u5373\u4f7f\u662f top-k 10 \u4e5f\u8981 1 \u79d2\uff0ctop-k 100 \u8981 2 \u79d2\u4e86<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>\u958b\u6e90\u7684 bge-reranker \u7cfb\u5217\n<ul class=\"wp-block-list\">\n<li>bge-reranker-base \u8ddf bge-reranker-large \u8f38\u5165\u9577\u5ea6\u9650\u5236\u662f 512 tokens\uff0c\u8d85\u904e\u622a\u65b7<\/li>\n\n\n\n<li>bge-reranker-m3 \u96d6\u7136\u8f38\u5165 tokens \u6700\u5927\u5230 8k\uff0c\u4f46\u5efa\u8b70\u5c0f\u65bc 1024\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/huggingface.co\/BAAI\/bge-reranker-v2-m3\/discussions\/8\" class=\"autohyperlink\">huggingface.co\/BAAI\/bge-reranker-v2-m3\/discussions\/8<\/a> \u5beb\u8aaa &#8220;\u672c\u8eab\u57fa\u5ea7\u6a21\u578b\u652f\u6301\u6700\u59278192 tokens\u3002\u4f46\u5fae\u8c03\u7684\u65f6\u5019\u4f7f\u7528\u4e861024 tokens\uff0c\u56e0\u6b64\u8d85\u8fc71024 tokens\u6548\u679c\u53ef\u80fd\u6709\u4e0b\u964d&#8221;<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>bge-reranker-v2-gemma \u8ddf bge-reranker-v2-gemma \u9019\u5169\u500b\u6a21\u578b\u7167\u6587\u4ef6\u5beb\u6027\u80fd\u66f4\u9ad8\uff0c\u4f46\u6211\u7684\u8a55\u6e2c\u770b\u4e0d\u51fa\u4f86\uff0c\u800c\u4e14\u9019\u5169\u5957\u6a21\u578b\u5927\u5c0f\u6bd4 m3 \u5927\u597d\u5e7e\u500d\uff0c\u662f\u7528\u4e0d\u540c\u6280\u8853\u8a13\u7df4\u51fa\u4f86\u7684\uff0c\u5c31\u7b97\u662f A100 \u53bb\u8dd1 top-k 100 \u4e5f\u4e0d\u5920\u5feb\uff0c\u6050\u9700\u8981 H100\uff0c\u73a9\u4e0d\u8d77\u3002<\/li>\n\n\n\n<li>\u7e3d\u4e4b\uff0c\u8981\u5be6\u7528\u9700\u8981\u90e8\u7f72 GPU \u901f\u5ea6\u624d\u80fd\u63a5\u53d7<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">\u8cbb\u7528<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u8dd1\u4e00\u6b21\u8a55\u6e2c\u5171\u6709 3493 \u984c\uff0c\u6240\u4ee5 Cohere API \u6bcf\u6b21\u6e2c\u8a66\u82b1\u4e86 (3,762 \/ 1,000) \u00d7 2 = $7\u7f8e\u91d1\uff0c\u7e3d\u5171\u505a\u4e86 15\u6b21\u7d66\u4e0d\u540c embedding \u6a21\u578b\u548c top-k \u7d44\u5408\uff0c\u82b1\u4e86 105 \u7f8e\u91d1<\/li>\n\n\n\n<li>Voyage API \u56e0\u70ba\u662f\u7167 tokens \u8a08\u8cbb\uff0c\u800c\u6211\u7684\u6587\u4ef6 chunk \u53ea\u6709 500 \u5de6\u53f3\uff0c\u56e0\u6b64\u5728 top-k 50 \u8ddf 10 \u7684\u5834\u666f\u53cd\u800c\u6bd4\u8f03\u4fbf\u5b9c\u3002\u6574\u500b\u5be6\u9a57(top-k 10, 50, 100)\u5168\u90e8\u5927\u7d04\u82b1\u4e86 50 \u7f8e\u91d1\u3002<\/li>\n\n\n\n<li>\u70ba\u4e86\u8dd1 bge-reranker \u6a21\u578b\uff0c\u8cb7\u4e86 Google Colab \u904b\u7b97\u9ede\u6578\u4f86\u7528 A100 GPU\uff0c\u82b1\u4e86 20 \u7f8e\u91d1<\/li>\n\n\n\n<li><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">LLM-based Ranker (7\/25 \u65b0\u589e\u5167\u5bb9)<\/h2>\n\n\n\n<p>\u9664\u4e86\u4e0a\u8ff0 Cross-Encoder \u7684 Reranker\uff0c\u4e5f\u6709\u4eba\u5728\u7814\u7a76\u76f4\u63a5\u4f7f\u7528 LLM\uff0c\u7528\u4e0b prompt \u7684\u65b9\u5f0f\u505a\u76f8\u95dc\u6027\u91cd\u6392\u3002\u5176\u4e2d\u6700\u6709\u540d\u7684\u5c31\u662f RankGPT \u4e86\uff0c\u5305\u62ec <a href=\"https:\/\/arxiv.org\/abs\/2304.09542\">code<\/a> \u548c <a href=\"https:\/\/arxiv.org\/abs\/2304.09542\">paper<\/a>\u3002<\/p>\n\n\n\n<p>RankGPT \u7684 prompt \u9577\u9019\u6a23:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>system: You are RankGPT, an intelligent assistant that can rank passages based on their relevancy to the query.\n\nuser: I will provide you with 5 passages, each indicated by number identifier &#91;]. Rank the passages based on their relevance to query: {\u9019\u88cf\u653equery}\n\nassistant: Okay, please provide the passages.\n\nuser: &#91;1] {\u9019\u88cf\u653e\u6587\u4ef61}\nassistant: 'Received passage &#91;1].\nuser: &#91;2] {\u9019\u88cf\u653e\u6587\u4ef62}\nassistant: 'Received passage &#91;2].\nuser: &#91;3] {\u9019\u88cf\u653e\u6587\u4ef63}\nassistant: 'Received passage &#91;3].\nuser: &#91;4] {\u9019\u88cf\u653e\u6587\u4ef64}\nassistant: 'Received passage &#91;4].\nuser: &#91;5] {\u9019\u88cf\u653e\u6587\u4ef65}\nassistant: 'Received passage &#91;5].\n\nuser: Search Query: {\u9019\u88cf\u653equery}. Rank the 5 passages above based on their relevance to the search query. The passages should be listed in descending order using identifiers. The most relevant passages should be listed first. The output format should be &#91;] &gt; &#91;], e.g., &#91;1] &gt; &#91;2]. Only response the ranking results, do not say any word or explain.\n\nassistant: &#91;3] &gt; &#91;1] &gt; &#91;5] &gt; &#91;4] &gt; &#91;2]<\/code><\/pre>\n\n\n\n<p>\u6211\u4e5f\u7528\u4e86 gpt-4o-mini \u505a\u4e86 top-k 10 \u53d6 5 \u7684 reranker \u8a55\u6e2c\uff0c\u7d50\u679c\u9084\u4e0d\u5dee\uff0c\u7d50\u679c\u88dc\u5728 google spreadsheets\u30023493 \u984c\u5171\u82b1\u4e86 $2.66 \u7f8e\u91d1\uff0c\u6bcf\u984c\u7684 input tokens \u6578\u5927\u7d04\u662f 4k~5k (\u670910\u4efd\u6587\u4ef6)\uff0c\u901f\u5ea6\u505a1\u984c\u5927\u7d04\u82b11\u79d2\u3002<\/p>\n\n\n\n<p>\u4e0d\u904e\u5982\u679c\u662f top-k 50 \u7684\u8a71\uff0c\u6bcf\u984c\u8981 4s (\u592a\u6162\u4e86\u4e0d\u5be6\u7528)\uff0c\u6bcf\u984c tokens \u6578\u5927\u7d04 22k\uff0c\u8f38\u51fa\u7d50\u679c\u633a\u4e0d\u7a69\u5b9a\u7684\uff0c\u5c31\u662f50\u4efd\u6587\u4ef6\u6392\u5e8f\uff0c\u51fa\u4f86\u7684\u7d50\u679c\u5e38\u6703\u6c92\u6709\u6392\u597d\u6392\u6eff 50 \u4efd\u6587\u4ef6\uff0c\u53ef\u80fd\u53ea\u6709\u524d 6, \u524d 10, \u524d 41 \u7b49\u7b49\u3002<\/p>\n\n\n\n<p>\u611f\u60f3\u662f: \u6709\u6f5b\u529b\uff0c\u4f46\u5c31\u6210\u672c\u3001\u901f\u5ea6\u548c\u7a69\u5b9a\u6027\u4e0a\uff0c\u500b\u4eba\u89ba\u5f97\u53ef\u80fd\u4e0d\u662f\u9996\u9078\u3002\u6709\u6f5b\u529b\u6307\u7684\u662f\u56e0\u70ba LLM \u6bd4\u8f03\u8070\u660e\u9ebb\uff0c\u56e0\u6b64\u8a9e\u610f\u7406\u89e3\u548c\u6cdb\u5316\u80fd\u529b\u61c9\u8a72\u6709\u6bd4 Cross-Encoder \u5f37\u3002\u4f46\u662f LLM \u5c31\u662f\u500b\u76f8\u6bd4 cross-encoder \u6bd4\u8f03\u5927\u7684\u6a21\u578b\uff0c\u56e0\u6b64\u8dd1\u8d77\u4f86\u7684\u6210\u672c\u548c\u901f\u5ea6\uff0c\u90fd\u6bd4\u8f03\u5927\uff0c\u800c\u4e14\u8f38\u51fa\u4e5f\u6bd4\u8f03\u4e0d\u7a69\u5b9a(\u8f38\u51fa\u51fa\u73fe\u7a7a\u7d50\u679c\u3001\u6c92\u6709\u91cd\u6392\u5b8c\u6574\u3001\u6216\u662f\u4e0d\u5408\u6cd5\u7684\u8f38\u51fa\u7b49)\u3002<\/p>\n\n\n\n<p>Google Research \u6709\u7bc7 paper \u6539\u63a1\u7528 pairwise \u7684\u65b9\u5f0f(\u5169\u5169\u76f8\u6bd4\uff0c\u800c\u4e0d\u662f\u50cf RankGPT \u662f\u4e00\u6b21\u5168\u90e8\u5217\u8868\u53bb\u7d66 LLM \u91cd\u6392)\u4f86\u505a: <a href=\"https:\/\/arxiv.org\/abs\/2306.17563\">Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting<\/a>\uff0c\u6548\u7387\u4f3c\u4e4e\u66f4\u597d\u66f4\u7a69\u5b9a\uff0c\u4e5f\u53ef\u4ee5\u7528\u66f4\u5c0f\u66f4\u5feb\u7684\u958b\u6e90 LLM \u6a21\u578b\u4f86\u505a\uff0c\u6548\u679c\u4e5f\u4e0d\u932f\u7684\u6a23\u5b50\u3002\u4f46\u56e0\u70ba\u6c92\u6709 github repo \u6709 code \u6211\u53ef\u4ee5\u76f4\u63a5\u8dd1\uff0c\u6240\u4ee5\u53ea\u597d\u4e4b\u5f8c\u6709\u7a7a\u518d\u5be6\u4f5c\u8a55\u6e2c\u4e86\u3002<\/p>\n\n\n\n<p>\u2014<\/p>\n\n\n\n<p><a href=\"https:\/\/www.facebook.com\/ihower\/posts\/10161227363963971\">\u6b64\u8a55\u6e2c Facebook \u8cbc\u6587\u8a0e\u8ad6 \u50b3\u9001\u9580 \u2197\ufe0f<\/a>&nbsp;(\u6b61\u8fce\u6309\u8b9a\u3001\u8ffd\u8e64\u3001\u5206\u4eab)<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u60f3\u7cfb\u7d71\u6027\u5b78\u7fd2\u5982\u4f55\u6253\u9020 LLM\u3001RAG \u548c Agents \u61c9\u7528\u55ce? \u6b61\u8fce\u5831\u540d\u6211\u7684\u8ab2\u7a0b\u00a0\u5927\u8a9e\u8a00\u6a21\u578b LLM \u61c9\u7528\u958b &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/ihower.tw\/blog\/12227-reranker\" class=\"more-link\">\u95b1\u8b80\u5168\u6587<span class=\"screen-reader-text\">\u3008\u4f7f\u7528\u7e41\u9ad4\u4e2d\u6587\u8a55\u6e2c\u5404\u5bb6 Reranker \u6a21\u578b\u7684\u91cd\u6392\u80fd\u529b\u3009<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[80],"tags":[],"class_list":["post-12227","post","type-post","status-publish","format-standard","hentry","category-llm","entry"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/s1q6tG-reranker","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12227","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/comments?post=12227"}],"version-history":[{"count":100,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12227\/revisions"}],"predecessor-version":[{"id":12704,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12227\/revisions\/12704"}],"wp:attachment":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/media?parent=12227"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/categories?post=12227"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/tags?post=12227"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}