{"id":12016,"date":"2024-04-08T15:00:00","date_gmt":"2024-04-08T07:00:00","guid":{"rendered":"https:\/\/ihower.tw\/blog\/?p=12016"},"modified":"2025-07-04T07:25:05","modified_gmt":"2025-07-03T23:25:05","slug":"matryoshka-embedding-model","status":"publish","type":"post","link":"https:\/\/ihower.tw\/blog\/12016-matryoshka-embedding-model","title":{"rendered":"\u4fc4\u7f85\u65af\u5957\u5a03(Matryoshka)\u5d4c\u5165\u6a21\u578b\u7c21\u4ecb"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

\u8a71\u8aaa OpenAI \u4eca\u5e74\u4e00\u6708\u65b0\u51fa\u7684 Embeddings \u6a21\u578b<\/a>(\u5c07\u6587\u5b57\u8f49\u6210\u8a9e\u610f\u5411\u91cf)\uff0c\u53ef\u4ee5\u900f\u904e\u50b3\u53c3\u6578\u6307\u5b9a\u4e0d\u540c\u7684\u7dad\u5ea6\u5927\u5c0f\uff0c\u9019\u80cc\u5f8c\u4f7f\u7528\u7684\u662f\u4e00\u7a2e\u53eb\u505a Matryoshka \u4fc4\u7f85\u65af\u5957\u5a03\u7684\u5d4c\u5165\u8868\u793a\u65b9\u5f0f\uff0c\u975e\u5e38\u9177\u3002<\/p>\n\n\n\n

Paper: Matryoshka Representation Learning<\/a><\/p>\n\n\n\n

\u9019\u9177\u7684\u5730\u65b9\u5728\u65bc\uff0c\u4f60\u53ef\u4ee5\u4e1f\u68c4\u4efb\u610f\u9577\u5ea6\u7684\u5c3e\u90e8\uff0c\u50c5\u4f7f\u7528\u958b\u982d\u4e5f\u662f\u6709\u6548\u7684!<\/p>\n\n\n\n

\u4f8b\u5982\u547c\u53eb text-embedding-3-large \u6a21\u578b\u5f97\u5230 3072 \u9ad8\u7dad\u5ea6\u7684\u5411\u91cf\u5f8c\uff0c\u53ef\u628a\u5f8c\u9762 2048 \u500b\u6578\u5b57\u4e1f\u68c4\uff0c\u53ea\u4f7f\u7528\u524d\u9762 1024 \u500b\u4e5f\u662f\u6709\u6548\u7684\u3002<\/p>\n\n\n\n

<\/a>\u53ea\u8981\u505a\u500b\u5411\u91cf\u6b63\u898f\u5316(normalization)\u8abf\u6574\u4e00\u4e0b\u9577\u5ea6\u55ae\u4f4d\uff0c \u5c31\u6703\u5f97\u5230\u8ddf\u50b3 1024 \u7dad\u5ea6\u53c3\u6578\u5f97\u5230\u7684\u5411\u91cf\u6578\u5b57\u4e00\u6a21\u4e00\u6a23!<\/p>\n\n\n\n

\u9019\u6709\u4ec0\u9ebc\u7528\u5462? \u53ef\u4ee5\u505a\u591a\u5c64\u6aa2\u7d22\u52a0\u901f\uff0c\u6e96\u5099\u968e\u6bb5\u53ea\u9700\u8981\u547c\u53eb\u6a21\u578b\u7b97\u4e00\u6b21\u9ad8\u7dad\u5ea6\uff0c\u4f60\u5c31\u53ef\u4ee5\u81ea\u5df1\u7e2e\u5c0f\u5230\u4e0d\u540c\u7dad\u5ea6\u5b58\u4e0b\u4f86\u3002<\/p>\n\n\n\n

\u5411\u91cf\u641c\u7d22\u6642\uff0c\u5148\u7528\u4f4e\u7dad\u5ea6\u4f8b\u5982 256 \u7dad\u5ea6\u521d\u6b65\u7be9\u9078\u4e00\u6b21(\u53ef\u7528ANN\u52a0\u901f)\uff0c\u9019\u6703\u6bd4\u8f03\u5feb\u56e0\u70ba\u7dad\u5ea6\u4f4e\u3002<\/p>\n\n\n\n

\u63a5\u8457\u518d\u7528 3072 \u9ad8\u7dad\u5ea6\u4f86\u6392\u5e8f\u904e\u6ffe\u7b2c\u4e8c\u6b21(\u53ef\u7528KNN\u66f4\u6e96)\uff0c\u9019\u6a23\u5c31\u7cbe\u6e96\u5566\u3002<\/p>\n\n\n\n

\u88dc\u5145(2024\/7\/23):<\/p>\n\n\n\n

Weaviate \u5beb\u4e86\u4e00\u7bc7 OpenAI’s Matryoshka Embeddings in Weaviate<\/a> \u4ecb\u7d39<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

\u8a71\u8aaa OpenAI \u4eca\u5e74\u4e00\u6708\u65b0\u51fa\u7684 Embeddings \u6a21\u578b(\u5c07\u6587\u5b57\u8f49\u6210\u8a9e\u610f\u5411\u91cf)\uff0c\u53ef\u4ee5\u900f\u904e\u50b3\u53c3\u6578\u6307\u5b9a\u4e0d\u540c\u7684 … <\/p>\n

\u95b1\u8b80\u5168\u6587\u3008\u4fc4\u7f85\u65af\u5957\u5a03(Matryoshka)\u5d4c\u5165\u6a21\u578b\u7c21\u4ecb\u3009<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[80],"tags":[],"class_list":["post-12016","post","type-post","status-publish","format-standard","hentry","category-llm","entry"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p1q6tG-37O","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12016","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/comments?post=12016"}],"version-history":[{"count":5,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12016\/revisions"}],"predecessor-version":[{"id":12324,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12016\/revisions\/12324"}],"wp:attachment":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/media?parent=12016"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/categories?post=12016"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/tags?post=12016"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}