{"id":11814,"date":"2023-10-26T17:20:40","date_gmt":"2023-10-26T09:20:40","guid":{"rendered":"https:\/\/ihower.tw\/blog\/?p=11814"},"modified":"2025-07-19T19:37:32","modified_gmt":"2025-07-19T11:37:32","slug":"aie-poe-llms","status":"publish","type":"post","link":"https:\/\/ihower.tw\/blog\/11814-aie-poe-llms","title":{"rendered":"\u611b\u597d AI Engineer \u9031\u5831 \ud83d\ude80 Poe \u7684 LLM \u6a21\u578b\u6392\u540d #02"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2023\/10\/chatbot.png\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"600\" data-attachment-id=\"11815\" data-permalink=\"https:\/\/ihower.tw\/blog\/11814-aie-poe-llms\/chatbot\" data-orig-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2023\/10\/chatbot.png\" data-orig-size=\"600,600\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"chatbot\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2023\/10\/chatbot-300x300.png\" data-large-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2023\/10\/chatbot.png\" src=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2023\/10\/chatbot.png\" alt=\"\" class=\"wp-image-11815\" srcset=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2023\/10\/chatbot.png 600w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2023\/10\/chatbot-300x300.png 300w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2023\/10\/chatbot-150x150.png 150w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/a><\/figure>\n\n\n\n<p>Hello! \u4f60\u597d&nbsp;<img loading=\"lazy\" decoding=\"async\" height=\"19\" width=\"21\" src=\"https:\/\/gallery.eomail1.com\/476855be-63fc-11ee-ad4b-b75b2c5ce28f%2F1698310498741-1698310497893.png\" alt=\"\ud83d\udc4b\"><\/p>\n\n\n\n<p>\u6211\u662f ihower\uff0c\u4ee5\u4e0b\u662f\u672c\u9031 AI Engineer \u96fb\u5b50\u5831\u5167\u5bb9\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><img loading=\"lazy\" decoding=\"async\" height=\"29\" width=\"31\" src=\"https:\/\/gallery.eomail1.com\/476855be-63fc-11ee-ad4b-b75b2c5ce28f%2F1698310498744-1698310497928.png\" alt=\"\ud83d\udd1d\"><a href=\"https:\/\/poe.com\/bot_rankings\" target=\"_blank\" rel=\"noreferrer noopener\">Poe bot ranking<\/a><\/h3>\n\n\n\n<p>Poe AI Chatbot \u548c SurgeAI \u5408\u4f5c\uff0c\u91dd\u5c0d\u4e3b\u6d41\u53ef\u5546\u7528\u7684 LLM \u9032\u884c\u4e86\u7cfb\u7d71\u6027\u8a55\u4f30\u548c\u6392\u540d\uff0c\u4ee3\u8868\u5be6\u969b\u7528\u6236\u5728 Poe \u804a\u5929\u6a5f\u5668\u4eba\u7684\u4f7f\u7528\u60c5\u6cc1\u3002\u8a55\u4f30\u9805\u76ee\u5305\u62ec\u63a8\u7406\u80fd\u529b\u3001\u975e\u82f1\u8a9e\u6d41\u5229\u7a0b\u5ea6\u3001&nbsp;\u5275\u9020\u529b\u548c\u5beb\u4f5c\u80fd\u529b\u3002\u4ee5\u4e0b\u662f\u4e00\u4e9b\u7d50\u679c:<\/p>\n\n\n\n<p>* GPT-4 \u5728\u6240\u6709\u7dad\u5ea6\u90fd\u662f\u7b2c\u4e00\uff0c\u5176\u4ed6\u6a21\u578b\u53ea\u80fd\u6436\u7b2c\u4e8c\u540d\u3002\u7576\u7136\uff0c&nbsp;\u9019\u88e1\u6c92\u8003\u616e\u6210\u672c\uff0cGPT-4 \u7684\u8cbb\u7528\u53ef\u662f\u5176\u4ed6\u6a21\u578b\u7684\u6578\u5341\u500d\u6602\u8cb4\u3002<br>* Google PaLM \u5728\u975e\u82f1\u8a9e\u80fd\u529b\u6392\u7b2c\u4e8c<br>* Claude 2 \u5728\u63a8\u7406\u80fd\u529b\u6392\u7b2c\u4e8c\uff0c\u9019\u5305\u62ec\u908f\u8f2f\u63a8\u7406\u3001\u76ca\u667a\u63a8\u7406\u3001Coding \u548c\u8a08\u7b97\u7b49<br>* GPT-3.5-Turbo \u5728\u5275\u9020\u529b\u8ddf\u5beb\u4f5c\u6392\u7b2c\u4e8c<\/p>\n\n\n\n<p>Poe \u505a\u7684\u9019\u500b\u8a55\u6e2c\u6392\u884c\u6211\u89ba\u5f97\u883b\u5be6\u7528\u7684\uff0c\u76ee\u524d\u6709\u5728\u96f2\u7aef\u4e0a\u63d0\u4f9b Token-based \u8a08\u8cbb\u7684 API \u670d\u52d9\uff0c\u4e5f\u5c31\u662f OpenAI, Google, Claude, Llama \u9019\u5e7e\u5bb6\u4e3b\u6d41\u6a21\u578b\u3002<\/p>\n\n\n\n<!--more-->\n\n\n\n<h3 class=\"wp-block-heading\"><img loading=\"lazy\" decoding=\"async\" height=\"29\" width=\"31\" src=\"https:\/\/gallery.eomail1.com\/476855be-63fc-11ee-ad4b-b75b2c5ce28f%2F1698310498736-1698310497910.png\" alt=\"\ud83d\udcb0\"><a href=\"https:\/\/docs.google.com\/spreadsheets\/d\/1NX8ZW9Jnfpy88PC2d6Bwla87JRiv3GTeqwXoB4mKU_s\/edit#gid=0\" target=\"_blank\" rel=\"noreferrer noopener\">LLM Token based pricing: Embeddings and LLMs<\/a><\/h3>\n\n\n\n<p>\u9019\u662f\u6709\u4eba\u6574\u7406\u7684\u50f9\u76ee\u8868\uff0c\u90fd\u662f Token based pricing \u7684 API \u670d\u52d9\uff0c\u6839\u64da\u7528\u91cf\u8a08\u8cbb\u3002<\/p>\n\n\n\n<p>* Embeddings \u50f9\u9322\u90fd\u5dee\u4e0d\u591a\uff0c\u9664\u4e86 Google \u6bd4\u5225\u4eba\u8cb4 4 \u500d ((\u5982\u679c1 token = 4 char \u7684\u8a71\uff0cGoogle \u7528 char \u4f86\u7b97)<br>* GPT-3.5 \u5f88\u6709\u7af6\u722d\u529b\uff0c\u5373\u4f7f\u548c Llama 70B \u76f8\u6bd4\u3002\u6700\u4fbf\u5b9c\u7684\u662f Anyscale \u7684 Llama 2 70B<br>* GPT4 \u6700\u8cb4\uff0c\u4e5f\u6bd4 Claude 2 on Bedrock \u8cb4\u4e00\u500d<br><br>\u5982\u679c\u4f60\u9084\u4e0d\u77e5\u9053\uff0c\u4e0a\u8ff0\u7684\u6a21\u578b\u6b64\u6642\u6b64\u523b\u90fd\u53ef\u4ee5\u547c\u53eb\u4f7f\u7528\u4e86\uff0c&nbsp;\u4e0d\u9700\u8981\u9059\u9059\u7121\u671f\u6392\u968a:<\/p>\n\n\n\n<p>* OpenAI API \u53ea\u8981<a href=\"https:\/\/platform.openai.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">\u8a3b\u518a<\/a>\u4e26\u5237\u5361\u5132\u503c\uff0c\u5c31\u53ef\u4ee5\u62ff\u5230\u9664\u4e86 GPT-4-32k \u4e4b\u5916\u7684 API \u6b0a\u9650<br>* Azure OpenAI \u9700\u8981\u984d\u5916\u586b\u8868\u55ae\u7533\u8acb\uff0c\u53ef\u80fd\u8981\u7b49\u4e00\u9031\uff0c\u4f46\u901a\u904e\u5f8c\u6703\u4e00\u4f75\u62ff\u5230 GPT-4-32k \u6b0a\u9650\u3002\u53e6\u5916\uff0c\u4e0d\u4e00\u5b9a\u9700\u8981\u627e\u4ee3\u7406\u5546\uff0c\u53f0\u7063\u5fae\u8edf\u6703\u958b\u96fb\u5b50\u767c\u7968\u3002<br>* Google \u6709\u5169\u500b\u7522\u54c1\u7dda\u63d0\u4f9b PaLM API: Markersuite \u8ddf Vertex AI \u7684 Generative AI Studio\uff0c\u5f8c\u8005\u4e0d\u9700\u8981\u6392\u968a\uff0c\u9032\u53bb GCP \u5f8c\u53f0\u5c31\u53ef\u4ee5\u4f7f\u7528\u4e86<br>* Claude \u7684<a href=\"https:\/\/www.anthropic.com\/product\" target=\"_blank\" rel=\"noreferrer noopener\">\u5b98\u65b9<\/a>\u9700\u8981\u7533\u8acb\u6392\u968a\uff0c\u4f46\u662f<a href=\"https:\/\/aws.amazon.com\/tw\/bedrock\/\" target=\"_blank\" rel=\"noreferrer noopener\">&nbsp;AWS Bedrock<\/a>&nbsp;(AWS \u525b\u63a8\u51fa\u7684 API \u670d\u52d9\uff0c\u9019\u4e5f\u4e0d\u7528\u6392\u968a\u4e86) \u53ef\u4ee5\u76f4\u63a5\u7528 Claude \u6a21\u578b\u4e0d\u7528\u7b49<br>* Llama 2 \u56e0\u70ba\u662f\u958b\u6e90\u7684\uff0c\u883b\u591a\u5bb6\u6709\u63d0\u4f9b\uff0c\u4f8b\u5982&nbsp;<a href=\"https:\/\/app.endpoints.anyscale.com\/landing\" target=\"_blank\" rel=\"noreferrer noopener\">AnyScale<\/a>&nbsp;\u3001<a href=\"https:\/\/www.mosaicml.com\/inference\" target=\"_blank\" rel=\"noreferrer noopener\">MosaicML<\/a>\u3001<a href=\"https:\/\/replicate.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Replicate<\/a>\uff0c\u81f3\u65bc AWS Bedrock \u4e5f\u8aaa\u4ed6\u5011\u5f88\u5feb\u63a8\u51fa Llama \u6a21\u578b\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><img loading=\"lazy\" decoding=\"async\" height=\"29\" width=\"31\" src=\"https:\/\/gallery.eomail1.com\/476855be-63fc-11ee-ad4b-b75b2c5ce28f%2F1698310498763-1698310497976.png\" alt=\"\ud83d\udcd5\"><a href=\"https:\/\/book.premai.io\/state-of-open-source-ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">State of Open Source AI Book &#8211; 2023 Edition<\/a><\/h3>\n\n\n\n<p>\u9019\u672c\u958b\u6e90 AI \u6307\u5357\u6db5\u84cb\u5167\u5bb9\u5f88\u591a\uff0c\u4f5c\u8005\u6301\u7e8c\u66f4\u65b0\u4e2d\uff0c\u503c\u5f97\u6bcf\u7ae0\u81f3\u5c11\u770b\u500b\u958b\u982d\u3002&nbsp;\u7ae0\u7bc0\u5305\u62ec\u6709:<\/p>\n\n\n\n<p>* \u6388\u6b0a: \u6bd4\u8f03\u5404\u500b\u6a21\u578b\u5728\u6b0a\u91cd\u3001\u8a13\u7df4\u8cc7\u6599\u3001\u8f38\u51fa\u662f\u5426\u53ef\u5546\u7528\u7684\u6388\u6b0a\u60c5\u6cc1<br>* \u8a55\u4f30: \u6709\u54ea\u4e9b\u6392\u884c\u699c\u8ddf Benchmarks<br>* \u6a21\u578b: \u6574\u7406\u6bd4\u8f03\u4e86\u5404\u5bb6\u6a21\u578b<br>* \u672a\u5c0d\u9f4a\u7684\u6a21\u578b: \u6574\u7406\u6bd4\u8f03\u4e86\u4e00\u4e9b\u6c92\u6709\u4fdd\u8b77\u63aa\u65bd\u7684\u6a21\u578b!<br>* \u5fae\u8abf<br>* \u6a21\u578b\u683c\u5f0f\u7684\u6bd4\u8f03<br>* MLOps<br>* \u5411\u91cf\u8cc7\u6599\u5eab\uff0c\u6bd4\u8f03\u4e86\u5404\u5bb6\u8cc7\u6599\u5eab<br>* SDK: \u6bd4\u8f03\u4e86 LangChain, LLamaIndex, LiteLLM<br>* \u684c\u9762\u8edf\u9ad4: \u6bd4\u8f03\u4e86\u4e00\u4e9b\u53ef\u4ee5\u8dd1\u5728\u672c\u6a5f\u7684\u6a21\u578b\u61c9\u7528<br>* \u786c\u9ad4<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><img loading=\"lazy\" decoding=\"async\" height=\"29\" width=\"31\" src=\"https:\/\/gallery.eomail1.com\/476855be-63fc-11ee-ad4b-b75b2c5ce28f%2F1698310498810-1698310497940.png\" alt=\"\ud83d\udc4d\"><a href=\"https:\/\/www.youtube.com\/watch?v=DHacEPuM4T4\" target=\"_blank\" rel=\"noreferrer noopener\">The Large Language Model Revolution \u6f14\u8b1b<\/a>\u00a0<\/h3>\n\n\n\n<p>\u9019\u5834 Google DeepMind \u79d1\u5b78\u5bb6\u7d00\u61f7\u65b0\u535a\u58eb\u7684\u6f14\u8b1b\u975e\u5e38\u8b9a\uff0c\u6211\u505a\u4e86\u4e00\u500b<a href=\"https:\/\/ihower.tw\/notes\/%E6%8A%80%E8%A1%93%E7%AD%86%E8%A8%98-AI\/2023\/The+Large+Language+Model+Revolution\" rel=\"noreferrer noopener\" target=\"_blank\">\u622a\u5716\u7b46\u8a18<\/a>\u53ef\u4ee5\u5feb\u901f\u770b\u770b&nbsp;\uff0c\u4f46\u6211\u975e\u5e38\u63a8\u85a6\u53ef\u4ee5\u82b1\u6642\u9593\u770b\u770b\u3002<\/p>\n\n\n\n<p>\u6f14\u8b1b\u524d\u9762\u8b1b\u9ede AI \u6b77\u53f2\u548c LLM \u5c07\u6703\u662f\u9769\u547d\uff0c\u63a5\u8457\u63d0\u5230 RAG \u8ddf\u5de5\u5177\u589e\u5f37\u3002\u7136\u5f8c\u8b1b\u4e86\u6211\u89ba\u5f97\u6700\u6709\u6536\u7a6b\u7684 Reasoning \u63a8\u7406\u3002<br>\u9019\u6642\u5019\u6211\u624d\u767c\u73fe\u6211\u6709\u773c\u4e0d\u8b58\u6cf0\u5c71\uff0c\u539f\u4f86 Ed Chi \u5c31\u662f\u8457\u540d&nbsp;<a href=\"https:\/\/arxiv.org\/abs\/2201.11903\" rel=\"noreferrer noopener\" target=\"_blank\">CoT paper<\/a>&nbsp;\u7684\u4f5c\u8005\u4e4b\u4e00\uff0c\u7531 paper \u4f5c\u8005\u89aa\u81ea\u89e3\u8aaa\u679c\u7136\u66f4\u662f\u7cbe\u5f69\u6709\u4f86\u9f8d\u53bb\u8108\u3002<\/p>\n\n\n\n<p>\u53e6\u5916\u4e00\u500b\u5f69\u86cb\u662f\u8b1b\u8005\u591a\u6b21\u63d0\u5230\u4ed6\u540c\u4e8b Denny (\u4e5f\u662f CoT paper \u4f5c\u8005) \u6709\u4e00\u5834\u8b1b Teach language models to reason\uff0c\u9019\u5834<a href=\"http:\/\/dennyzhou.github.io\/Teach-LLMs-to-Reason-KDD-2023.pdf\" rel=\"noreferrer noopener\" target=\"_blank\">\u6295\u5f71\u7247<\/a>\u5167\u5bb9\u4e5f\u5f88\u8b9a\uff0c\u53ef\u60dc\u4f3c\u4e4e\u6c92\u6709\u9304\u5f71\u3002<\/p>\n\n\n\n<p>&#8212;-<\/p>\n\n\n\n<p><br>\u4ee5\u4e0a\u5c31\u662f\u672c\u9031\u5167\u5bb9\uff0c\u5e0c\u671b\u4f60\u6703\u559c\u6b61\u3002\u6700\u5f8c\u9084\u662f\u4e0d\u514d\u4fd7\u63a8\u4e00\u4e0b\u6211\u7684\u7dda\u4e0a\u76f4\u64ad\u8ab2\u7a0b&nbsp;<a href=\"http:\/\/s.accupass.com\/vkaPBg\" target=\"_blank\" rel=\"noreferrer noopener\">LLM \u61c9\u7528\u958b\u767c\u5de5\u4f5c\u574a<\/a>&nbsp;\u6b63\u5728\u71b1\u92b7\u4e2d\uff0c\u770b\u5230\u975e\u5e38\u591a\u67096\u5e74\u7d93\u9a57\u4ee5\u4e0a\u7684\u8cc7\u6df1\u8edf\u9ad4\u5de5\u7a0b\u5e2b\u4f86\u5831\u540d\uff0c\u8b93\u6211\u611f\u5230\u975e\u5e38\u69ae\u5e78\uff0c\u8b93\u6211\u5011\u5728\u8ffd\u6c42 AI \u5967\u79d8\u7684\u9053\u8def\u4e0a\u7e7c\u7e8c\u52aa\u529b\u524d\u9032\u5427!<\/p>\n\n\n\n<figure class=\"wp-block-image\"><a href=\"http:\/\/s.accupass.com\/vkaPBg\" target=\"_blank\" rel=\"noreferrer noopener\"><img decoding=\"async\" src=\"https:\/\/gallery.eomail1.com\/476855be-63fc-11ee-ad4b-b75b2c5ce28f%2F1697616794530-ac-ihower-llm.png\" alt=\"476855be-63fc-11ee-ad4b-b75b2c5ce28f%2F1697616794530-ac-ihower-llm.png\"\/><\/a><\/figure>\n\n\n\n<p>\u2013 ihower<br><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hello! \u4f60\u597d&nbsp; \u6211\u662f ihower\uff0c\u4ee5\u4e0b\u662f\u672c\u9031 AI Engineer \u96fb\u5b50\u5831\u5167\u5bb9\u3002 Poe  &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/ihower.tw\/blog\/11814-aie-poe-llms\" class=\"more-link\">\u95b1\u8b80\u5168\u6587<span class=\"screen-reader-text\">\u3008\u611b\u597d AI Engineer \u9031\u5831 \ud83d\ude80 Poe \u7684 LLM \u6a21\u578b\u6392\u540d #02\u3009<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[91],"tags":[],"class_list":["post-11814","post","type-post","status-publish","format-standard","hentry","category-aie","entry"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p1q6tG-34y","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/11814","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/comments?post=11814"}],"version-history":[{"count":7,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/11814\/revisions"}],"predecessor-version":[{"id":13032,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/11814\/revisions\/13032"}],"wp:attachment":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/media?parent=11814"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/categories?post=11814"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/tags?post=11814"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}