{"id":12422,"date":"2024-08-18T22:37:25","date_gmt":"2024-08-18T14:37:25","guid":{"rendered":"https:\/\/ihower.tw\/blog\/?p=12422"},"modified":"2025-07-19T19:26:30","modified_gmt":"2025-07-19T11:26:30","slug":"aie-building-with-llms","status":"publish","type":"post","link":"https:\/\/ihower.tw\/blog\/12422-aie-building-with-llms","title":{"rendered":"\u611b\u597d AI Engineer \u96fb\u5b50\u5831 \ud83d\ude80\u00a0\u5efa\u69cb LLMs \u61c9\u7528\u7684\u6230\u7565\u3001\u904b\u71df\u548c\u6230\u8853\u7d93\u9a57\u5206\u4eab #16"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" data-attachment-id=\"12423\" data-permalink=\"https:\/\/ihower.tw\/blog\/12422-aie-building-with-llms\/year-learned\" data-orig-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/08\/year-learned.jpeg\" data-orig-size=\"1024,1024\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"year-learned\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/08\/year-learned-300x300.jpeg\" data-large-file=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/08\/year-learned.jpeg\" src=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/08\/year-learned.jpeg\" alt=\"\" class=\"wp-image-12423\" style=\"width:554px;height:auto\" srcset=\"https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/08\/year-learned.jpeg 1024w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/08\/year-learned-300x300.jpeg 300w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/08\/year-learned-150x150.jpeg 150w, https:\/\/ihower.tw\/blog\/wp-content\/uploads\/2024\/08\/year-learned-768x768.jpeg 768w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Hello! \u4f60\u597d&nbsp;\ud83d\udc4b<\/p>\n\n\n\n<p>\u6211\u662f ihower\uff0c\u9019\u671f\u7d2f\u7a4d\u4e86\u4e0d\u5c11\u7cbe\u5f69\u5167\u5bb9\u5206\u4eab\u7d66\u5927\u5bb6\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udd1d<a href=\"https:\/\/applied-llms.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">What We\u2019ve Learned From A Year of Building with LLMs<\/a><\/h3>\n\n\n\n<p>\u9019\u5305\u62ec\u4f5c\u8005\u5011\u7684&nbsp;<a href=\"https:\/\/applied-llms.org\/\" rel=\"noreferrer noopener\" target=\"_blank\">Blog \u9577\u6587<\/a>\u3001\u5728 AI Engineer World&#8217;s Fair \u5927\u6703\u7684<a href=\"https:\/\/www.youtube.com\/watch?v=qBHfQT3YtyY\" rel=\"noreferrer noopener\" target=\"_blank\">\u6f14\u8b1b\u5f71\u7247<\/a>\uff0c\u4ee5\u53ca\u6211\u7684<a href=\"https:\/\/ihower.tw\/watch\/aief-2024-what-we-learned-from-a-year-of-building-with-llms\/\" rel=\"noreferrer noopener\" target=\"_blank\">\u622a\u5716\u7248\u672c<\/a>\u3002<\/p>\n\n\n\n<p>\u9019\u662f\u7531\u516d\u4f4d\u5927\u795e\u4e00\u8d77\u5beb\u7684 What We Learned From A Year of Building With LLMs (\u6211\u5011\u5f9e\u4e00\u5e74\u4f7f\u7528\u5927\u578b\u8a9e\u8a00\u6a21\u578b\u7684\u958b\u767c\u4e2d\u5b78\u5230\u4e86\u4ec0\u9ebc) \u8cc7\u8a0a\u91cf\u5f88\u9ad8\uff0c\u4e7e\u8ca8\u6eff\u6eff\u3002\u628a\u958b\u767c LLM-based AI \u7522\u54c1\u7684\u7d93\u9a57\uff0c\u5206\u6210 \u6230\u8853\u3001\u71df\u904b\u548c\u6230\u7565\u5c64\u9762\uff0c\u4ee5\u4e0b\u6458\u8981\u7bc0\u9304:&nbsp;<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>\u6230\u8853\u4e0a:&nbsp;<\/p>\n\n\n\n<p>&#8211; \u55ae\u4e00\u5c0f prompt \u80fd\u5920\u505a\u597d\u4e00\u4ef6\u4e8b\uff0c\u800c\u4e14\u53ea\u505a\u4e00\u4ef6\u4e8b<br>&#8211; \u504f\u597d\u4f7f\u7528 RAG \u800c\u975e\u5fae\u8abf\u4f86\u7372\u53d6\u65b0\u77e5\u8b58<br>&#8211; \u9010\u6b65\u3001\u591a\u56de\u5408\u7684\u300c\u6d41\u7a0b\u300d\u53ef\u4ee5\u5e36\u4f86\u5de8\u5927\u7684\u63d0\u5347<br>&#8211; \u512a\u5148\u8003\u616e\u4f7f\u7528\u78ba\u5b9a\u6027\u7684\u5de5\u4f5c\u6d41\u7a0b<br>&#8211; \u5f9e\u771f\u5be6\u7684\u8f38\u5165\/\u8f38\u51fa\u7bc4\u4f8b\u4e2d\u5275\u5efa\u4e00\u4e9b\u57fa\u65bc assert \u65b7\u8a00\u7684\u55ae\u5143\u6e2c\u8a66<\/p>\n\n\n\n<p>\u71df\u904b\u4e0a:<\/p>\n\n\n\n<p>&#8211; \u6240\u6709\u4eba\u90fd\u61c9\u7dca\u5bc6\u95dc\u6ce8\u6578\u64da\uff0c\u6bcf\u9031\u82b1\u5e7e\u500b\u5c0f\u6642\u67e5\u770b\u8f38\u5165\u548c\u8f38\u51fa\uff0c\u4ee5\u66f4\u597d\u5730\u4e86\u89e3\u6578\u64da\u5206\u4f48\uff1a\u5176\u6a21\u5f0f\u3001\u908a\u7de3\u60c5\u6cc1\u4ee5\u53ca\u6a21\u578b\u7684\u5c40\u9650\u6027<br>&#8211;&nbsp;\u62bd\u6a23\u67e5\u770b\u6bcf\u5929 LLM \u61c9\u7528\u7684\u8f38\u5165\u548c\u8f38\u51fa\u7d50\u679c<br>&#8211; \u5c07\u63d0\u793a\u9077\u79fb\u5230\u4e0d\u540c\u6a21\u578b\u662f\u4e00\u4ef6\u9ebb\u7169\u4e8b<br>&#8211; \u7121\u60c5\u5730\u8003\u616e\u9700\u6c42\u512a\u5148\u7b49\u7d1a\uff0c\u6211\u5011\u5fc5\u9808\u63a5\u53d7\u7b2c\u4e00\u500b\u7248\u672c\u4e0d\u6703\u662f\u5b8c\u7f8e\u7684\uff0c\u53ea\u9700\u767c\u5e03\u4e26\u8fed\u4ee3<br>&#8211; \u6839\u64da\u4f7f\u7528\u60c5\u5883\u6821\u6e96\u4f60\u7684\u98a8\u96aa\u627f\u53d7\u5ea6<br>&#8211; \u4ee5\u4e0b\u662f\u69cb\u5efa AI \u7522\u54c1\u904e\u7a0b\u4e2d\u6240\u9700\u89d2\u8272\u985e\u578b\u53ca\u5176\u9700\u6c42\u6642\u9593\u7684\u5927\u81f4\u9032\u5c55<br>&nbsp; * \u9996\u5148\uff0c\u5c08\u6ce8\u65bc\u5efa\u7acb\u7522\u54c1<br>&nbsp; * \u900f\u904e\u5100\u5668\u5316\u60a8\u7684\u7cfb\u7d71\u4e26\u6536\u96c6\u6578\u64da\u4f86\u5efa\u7acb\u6b63\u78ba\u7684\u57fa\u790e\u3002\u6839\u64da\u6578\u64da\u7684\u985e\u578b\u548c\u898f\u6a21\uff0c\u60a8\u53ef\u80fd\u9700\u8981\u5e73\u53f0\u548c\/\u6216\u6578\u64da\u5de5\u7a0b\u5e2b\u3002\u60a8\u9084\u5fc5\u9808\u6709\u67e5\u8a62\u548c\u5206\u6790\u9019\u4e9b\u6578\u64da\u7684\u7cfb\u7d71\u4f86\u8abf\u8a66\u554f\u984c<br>&nbsp; * \u6700\u7d42\u6703\u60f3\u8981\u512a\u5316\u4f60\u7684 AI \u7cfb\u7d71\u3002\u9019\u4e0d\u4e00\u5b9a\u6d89\u53ca\u8a13\u7df4\u6a21\u578b\u3002\u57fa\u672c\u6b65\u9a5f\u5305\u62ec\u8a2d\u8a08\u6307\u6a19\u3001\u5efa\u7acb\u8a55\u4f30\u7cfb\u7d71\u3001\u9032\u884c\u5be6\u9a57\u3001\u512a\u5316 RAG \u6aa2\u7d22\u3001\u8abf\u8a66\u96a8\u6a5f\u7cfb\u7d71\u7b49\u7b49\u3002<\/p>\n\n\n\n<p>\u6230\u7565\u4e0a:<\/p>\n\n\n\n<p>&#8211; \u5728\u9054\u5230\u7522\u54c1\u5e02\u5834\u5951\u5408\u5ea6 (PMF) \u4e4b\u524d\uff0c\u4e0d\u8981\u4f7f\u7528 GPU<br>&nbsp; * \u5f9e\u96f6\u958b\u59cb\u8a13\u7df4\uff08\u5e7e\u4e4e\uff09\u5f9e\u4f86\u6c92\u6709\u610f\u7fa9<br>&nbsp; * \u5728\u8b49\u660e\u6709\u5fc5\u8981\u4e4b\u524d\uff0c\u4e0d\u8981\u9032\u884c\u5fae\u8abf<br>&nbsp; * \u5f9e\u63a8\u7406 API \u958b\u59cb\uff0c\u4f46\u4e0d\u8981\u5bb3\u6015\u81ea\u6211\u8a17\u7ba1<br>&#8211; \u6a21\u578b\u4e0d\u662f\u7522\u54c1\uff1b\u570d\u7e5e\u5b83\u7684\u7cfb\u7d71\u624d\u662f<br>&nbsp; * \u6a21\u578b\u53ef\u80fd\u662f\u7cfb\u7d71\u4e2d\u6700\u4e0d\u8010\u7528\u7684\u7d44\u4ef6<br>&nbsp; * \u5c07\u4f60\u7684\u52aa\u529b\u96c6\u4e2d\u5728\u80fd\u63d0\u4f9b\u6301\u4e45\u50f9\u503c\u7684\u4e8b\u60c5\u4e0a: &nbsp;Evaluation, Guardrails, Caching, \u6578\u64da\u98db\u8f2a<br>&#8211; LLM \u9a45\u52d5\u7684\u61c9\u7528\u7a0b\u5f0f\u975e\u5e38\u8106\u5f31\u3002\u5b83\u5011\u9700\u8981\u5927\u91cf\u7684\u5b89\u5168\u9632\u8b77\u548c\u9632\u79a6\u6027\u5de5\u7a0b<br>&nbsp; * \u7576\u7bc4\u570d\u56b4\u683c\u9650\u5b9a\u6642\uff0c\u9019\u4e9b\u61c9\u7528\u7a0b\u5f0f\u53ef\u4ee5\u975e\u5e38\u6709\u7528<br>&nbsp; * \u60f3\u50cf\u57fa\u65bcLLM\u7684\u61c9\u7528\u7a0b\u5f0f\u5b8c\u5168\u53d6\u4ee3\u5de5\u4f5c\u6d41\u7a0b\u6216\u4ee3\u66ff\u67d0\u500b\u8077\u4f4d\u529f\u80fd\u53ef\u80fd\u5f88\u6709\u5438\u5f15\u529b\uff0c\u4f46\u76ee\u524d\u6700\u6709\u6548\u7684\u7bc4\u5f0f\u662f\u4eba\u6a5f\u6df7\u5408<br>&#8211; \u5efa\u7acb LLMOps\uff0c\u4f46\u8981\u70ba\u6b63\u78ba\u7684\u7406\u7531\u800c\u5efa\u7acb\uff1a\u66f4\u5feb\u7684\u8fed\u4ee3<br>&#8211; \u53cd\u8986\u6539\u9032\uff0c\u6210\u5c31\u5353\u8d8a<br>&#8211; \u5f9e\u63d0\u793a\u3001\u8a55\u4f30\u548c\u6578\u64da\u6536\u96c6\u958b\u59cb<br>&nbsp; * \u63d0\u793a\u5de5\u7a0b\u512a\u5148<br>&nbsp; * \u5efa\u7acb\u8a55\u4f30\u4e26 \u555f\u52d5\u6578\u64da\u98db\u8f2a<\/p>\n\n\n\n<p>\u88dc\u5145(2024\/8): \u770b\u5230 <a href=\"https:\/\/www.dylandavis.net\/2024\/07\/tldr-1-year-of-building-with-llms\/\">Dylan \u7684 TLDR \u7248\u672c<\/a>\u4e5f\u5f88\u4e0d\u932f<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udc4d<a href=\"https:\/\/ihower.tw\/watch\/how-to-think-about-ai-applications\/\" target=\"_blank\" rel=\"noreferrer noopener\">How to think about AI application development<\/a><\/h3>\n\n\n\n<p>\u9019\u662f\u4e00\u5834\u7531 Anton Troynikov (Founder of Chroma) \u5206\u4eab\u95dc\u65bc AI \u61c9\u7528\u958b\u767c\u7684\u4e00\u4e9b\u60f3\u6cd5\uff0c\u89ba\u5f97\u975e\u5e38\u767c\u4eba\u7701\u601d\uff0c\u6211\u7279\u7ffb\u8b6f\u88fd\u4f5c\u4e86\u4e2d\u82f1\u7248\u7db2\u9801\uff0c\u4ee5\u4e0b\u662f\u6211\u7684\u5fc3\u5f97\u6458\u8981:&nbsp;<\/p>\n\n\n\n<p>&#8211; buzzwords \u662f\u601d\u60f3\u6bba\u624b\uff0c\u5305\u62ec RAG, Agent \u7b49\u90fd\u662f<br>&nbsp; * RAG \u505a\u70ba\u6982\u5ff5\u6c92\u6709\u7528\uff0c\u5c31\u50cf\u6211\u5011\u73fe\u5728\u5df2\u7d93\u4e0d\u6703\u7a31\u547c\u4e00\u500b\u7db2\u7ad9\u662f &#8220;\u8cc7\u6599\u5eab\u589e\u5f37\u7684\u7db2\u9801&#8221; (\u7de8\u6309: \u56e0\u70ba\u5c0d\u6211\u5011\u5c08\u696d\u958b\u767c\u8005\u4f86\u8aaa\uff0c\u4e00\u500b\u8edf\u9ad4\u61c9\u7528\u901a\u5e38\u6703\u642d\u914d\u8cc7\u6599\u5eab\uff0c\u5f88\u6b63\u5e38\u554a)<br>&nbsp; * Agent \u53ea\u662f\u5728 loop \u4e2d\u591a\u6b21\u547c\u53eb LLM<br>&#8211; \u505a Chatbot \u5c31\u50cf\u53e4\u65e9\u6642\u4ee3\u7684\u975c\u614b\u7db2\u9801\uff0c\u53ea\u662f\u7528\u65b0\u7684\u65b9\u5f0f\u5448\u73fe LLM \u88e1\u9762\u7684\u8cc7\u6599\u800c\u5df2\u3002\u4e0d\u8981\u4ee5\u70ba\u9019\u6ce2 AI \u6700\u6709\u50f9\u503c\u7684\u61c9\u7528\u5c31\u662f\u505a chatbot (\u7de8\u6309: \u76ee\u524d\u5404\u7a2e agent, prompts \u6307\u4ee4\u5927\u5168\uff0c\u771f\u7684\u5f88\u50cf\u7576\u5e74Web\u8208\u8d77\u6642\u7684\u578b\u9304\u7db2\u7ad9)<br>&#8211; LLM \u662f\u53ef\u4ee5\u8655\u7406\u975e\u7d50\u69cb\u5316\u8cc7\u8a0a\u7684\u7cfb\u7d71\uff0c\u4ee5\u524d\u7121\u6cd5\u53ea\u7528\u5e38\u8b58\u548c API \u53bb\u9032\u884c\uff0c\u73fe\u5728\u53ef\u4ee5\u8fa6\u5230\u4e86<br>&#8211; \u8edf\u9ad4\u7684\u50f9\u503c\u5728\u65bc\u81ea\u52d5\u5316\u6709\u50f9\u503c\u7684\u6d3b\u52d5\uff0cAI \u53ef\u4ee5\u5e6b\u52a9\u6211\u5011\u81ea\u52d5\u5316\u4ee5\u524d\u7121\u6cd5\u81ea\u52d5\u5316\u7684\u4e8b\u60c5<br>&#8211; \u4f60\u53ea\u9700\u8981 LLM API<br>&#8211; \u9019\u5169\u5e74\u4f86\u9019\u6280\u8853\u88ab\u5ba3\u50b3\u6210 &#8220;\u751f\u6210\u5f0f&#8221; \u53ef\u7528\u4f86\u5e6b\u52a9\u6211\u5011\u5beb\u6587\u7ae0\u751f\u6210\u6587\u5b57\uff0c\u800c\u4e0d\u662f\u5f37\u8abf\u8655\u7406\u8cc7\u8a0a\uff0c\u9019\u6982\u5ff5\u662f\u6709\u5bb3\u7684<br>&#8211; \u65b0\u7684 AI \u61c9\u7528\uff0c\u76f8\u5c0d\u65bc\u50b3\u7d71\u8edf\u9ad4\u958b\u767c\uff0c\u6709\u65b0\u7684\u7a0b\u5f0f\u8a2d\u8a08\u65b9\u5f0f\uff0c\u5305\u62ec<br>&nbsp; * Eval \u8a55\u4f30\uff0c\u76f8\u5c0d\u65bc\u55ae\u5143\u6e2c\u8a66\uff0c\u4f46\u4e0d\u662f pass \u6216 failed \u4e86\uff0c\u800c\u662f\u95dc\u65bc\u6a5f\u7387<br>&nbsp; * Retrieval \u6aa2\u7d22\uff0c\u76f8\u5c0d\u65bc\u8cc7\u6599\u5eab\uff0c\u65b0\u7684\u65b9\u5f0f\u662f\u5411\u91cf\u5132\u5b58<br>&nbsp; * \u65b0\u7684\u958b\u767c\u8fed\u4ee3\u65b9\u5f0f<br>&nbsp; * \u964d\u4f4e\u7684\u9580\u6abb\uff0c\u6bcf\u500b\u4eba\u90fd\u53ef\u4ee5\u5efa\u69cb\u81ea\u52d5\u5316<br>&#8211; LLM \u5275\u9020\u4e86\u65b0\u7684\u62bd\u8c61\u5c64\u548c\u5c08\u696d<br>&#8211; \u53eb\u505a Prompt Engineer \u4ed6\u4e5f\u89ba\u5f97\u4e0d\u597d\uff0c\u56e0\u70ba\u5de5\u4f5c\u4e0d\u53ea\u6709 Prompt Engineering<br>&#8211; \u53eb\u505a AI Enginner \u53ef\u80fd\u4e5f\u6709\u9ede\u4e0d\u5920\u6e05\u695a\u592a\u5ee3 (\u56e0\u6b64\u6211\u8a8d\u70ba\u52a0\u4e0a Generative \u6703\u66f4\u597d)<br>&#8211; AI \u5de5\u7a0b\u5e2b\u7684\u6578\u91cf\u6703\u9060\u6bd4 ML \u5de5\u7a0b\u5e2b\u591a\uff0c\u800c\u4e14\u751a\u81f3\u4e0d\u9700\u8981\u5b78\u600e\u9ebc\u8a13\u7df4\u6a21\u578b\u4e86<br><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83c\udfaf<a href=\"https:\/\/ihower.tw\/blog\/archives\/12373\" target=\"_blank\" rel=\"noreferrer noopener\">\u7528\u7e41\u9ad4\u4e2d\u6587\u8a55\u6e2c RAG \u7684 Chunking \u5207\u584a\u7b56\u7565<\/a><\/h3>\n\n\n\n<p>\u6211\u5ef6\u7e8c\u4e4b\u524d\u505a\u7684 Embedding \u548c Reranker \u8a55\u6e2c\uff0c\u5be6\u9a57\u4e86 RAG \u7cfb\u7d71\u4e2d\u7684 Chunking \u5207\u584a\u74b0\u7bc0\u3002\u7531\u65bc embedding \u548c LLM \u6a21\u578b\u7684\u9577\u5ea6\u9650\u5236\uff0c\u6211\u5011\u5fc5\u9808\u5c07\u6240\u6709\u6587\u672c\u8cc7\u6599\uff0c\u62c6\u6210\u5c0f\u584a\u5f8c\u518d\u8f49\u6210\u5411\u91cf\u653e\u9032\u5411\u91cf\u8cc7\u6599\u5eab\u3002\u8a73\u7d30\u5167\u5bb9\u8acb\u524d\u5f80<a href=\"https:\/\/ihower.tw\/blog\/archives\/12373\" rel=\"noreferrer noopener\" target=\"_blank\">\u6211 Blog \u6587\u7ae0<\/a>\u3002<br><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udc4a<a href=\"https:\/\/va.landing.ai\/home\" target=\"_blank\" rel=\"noreferrer noopener\">Vision Agent<\/a><\/h3>\n\n\n\n<p>\u9019\u5305\u62ec&nbsp;<a href=\"https:\/\/va.landing.ai\/\" rel=\"noreferrer noopener\" target=\"_blank\">Vision Agent \u7dda\u4e0a\u7248\u672c<\/a>\u3001<a href=\"https:\/\/github.com\/landing-ai\/vision-agent\" rel=\"noreferrer noopener\" target=\"_blank\">\u958b\u6e90\u7684 code<\/a>&nbsp;\u548c<a href=\"https:\/\/www.youtube.com\/watch?v=q1XFm21I-VQ\" rel=\"noreferrer noopener\" target=\"_blank\">&nbsp;Andrew Ng \u7684\u6f14\u8b1b<\/a>&nbsp;(\u63a8\u85a6 Vision Agent \u5f9e 16:35 \u958b\u59cb\u770b)<\/p>\n\n\n\n<p>Andrew Ng \u5728 Snowflake Summit 2024 \u4ecb\u7d39\u4e86\u4ed6\u5011\u5718\u968a\u7684\u4e00\u500b\u65b0\u958b\u6e90\u4f5c\u54c1 Vision Agent<\/p>\n\n\n\n<p>\u6211\u4e00\u958b\u59cb\u4ee5\u70ba\u4e0d\u5c31\u662f\u547c\u53eb\u591a\u6a21\u614b\u6a21\u578b\uff0c\u4f8b\u5982 gpt-4o \u5e6b\u4f60\u89e3\u8b80\u5716\u7247\uff0c\u9019\u5927\u5bb6\u5df2\u7d93\u6703\u5566\uff0c\u8a8d\u771f\u770b\u4e00\u4e0b\u4e0d\u662f!<br>\u9019\u500b Vision Agent \u662f\u6839\u64da\u4f60\u7684 prompt \u6307\u793a\uff0c\u5beb\u51fa\u7279\u5b9a\u9700\u6c42\u7684\u5f71\u50cf\u8fa8\u8b58\u7a0b\u5f0f\u78bc\uff0c\u4f8b\u5982:<\/p>\n\n\n\n<p>1. \u8a08\u7b97\u7279\u5b9a\u5169\u500b\u7269\u54c1\u7684\u8ddd\u96e2<br>2. \u5075\u6e2c\u662f\u5426\u767c\u751f\u67d0\u500b\u4e8b\u4ef6\uff0c\u4f8b\u5982\u5224\u65b7 CCTV \u5f71\u50cf\u4e2d\u662f\u5426\u6709\u8eca\u798d<br>3. \u8a08\u7b97\u6709\u591a\u5c11\u67d0\u67d0\u7269\u54c1\uff0c\u4f8b\u5982\u591a\u5c11\u4eba\u6234\u53e3\u7f69<\/p>\n\n\n\n<p>\u9019\u6709\u4ec0\u9ebc\u597d\u8655? \u5c31\u662f\u4e00\u4f46 code \u5beb\u51fa\u4f86\u4e4b\u5f8c\uff0c\u9019\u500b\u4efb\u52d9\u5c31\u4e0d\u9700\u8981\u547c\u53eb\u591a\u6a21\u614b\u6a21\u578b\u4e86\u3002\u4f8b\u5982 CCTV \u76e3\u8996\u5668\u5834\u666f\uff0c\u4f60\u4e0d\u9700\u8981\u4e00\u76f4\u547c\u53eb\u591a\u6a21\u614b\u6a21\u578b\uff0c\u4e0d\u4f46\u82b1\u9322\u800c\u4e14\u901f\u5ea6\u8f03\u6162\u3002\u6211\u5011\u53ea\u9700\u8981\u547c\u53eb\u5beb\u597d\u7684\u8996\u89ba\u8fa8\u8b58\u7a0b\u5f0f\u5373\u53ef\uff0c\u6e96\u78ba\u7387\u4e5f\u6bd4\u8f03\u7a69\u5b9a\u3002<\/p>\n\n\n\n<p>\u6211\u89ba\u5f97\u53b2\u5bb3\u7684\u5730\u65b9\u5c31\u662f\u9019\u500b Vision Agent \u5167\u5efa\u5beb\u597d\u4e86\u5f88\u591a\u8996\u89ba\u8fa8\u8b58\u7684\u5de5\u5177\u7a0b\u5f0f\uff0c\u56e0\u6b64\u4ed6\u6703\u5229\u7528\u9019\u4e9b\u5de5\u5177\u4f86\u5beb code\u3002\u5982\u679c\u4e0d\u662f\u5c08\u9580\u505a\u8996\u89ba\u8fa8\u8b58\u7684\u5c08\u5bb6\uff0c\u5be6\u5728\u662f\u4e0d\u6703\u719f\u6089\u9019\u4e9b\u5de5\u5177\u554a\u3002\u800c\u73fe\u5728\u6211\u900f\u904e\u9019\u500b Vision Agent\uff0c\u5c31\u53ef\u4ee5\u5feb\u901f\u5beb\u51fa\u4f86\u4e86!!<\/p>\n\n\n\n<p>\u9019\u4e9b\u4e0d\u660e\u89ba\u53b2\u7684\u5167\u5efa\u5f71\u50cf\u8fa8\u8b58\u5de5\u5177\u5305\u62ec(\u6211\u5f9e source code \u6316\u51fa\u4f86\u7684):<\/p>\n\n\n\n<p>1. owl_v2: \u9019\u662f\u4e00\u500b\u7269\u9ad4\u6aa2\u6e2c\u5de5\u5177,\u53ef\u4ee5\u6839\u64da\u6587\u672c\u63d0\u793a\u6aa2\u6e2c\u548c\u8a08\u6578\u5716\u50cf\u4e2d\u7684\u591a\u500b\u7269\u9ad4\u3002\u5b83\u8fd4\u56de\u6a19\u6e96\u5316\u5750\u6a19\u7684\u908a\u754c\u6846\u5217\u8868,\u5305\u542b\u6a19\u7c64\u540d\u7a31\u548c\u76f8\u95dc\u7684\u6982\u7387\u5206\u6578\u3002<br>2. grounding_sam: \u9019\u662f\u4e00\u500b\u7269\u9ad4\u5206\u5272\u5de5\u5177,\u53ef\u4ee5\u6839\u64da\u6587\u672c\u63d0\u793a\u5206\u5272\u5716\u50cf\u4e2d\u7684\u591a\u500b\u7269\u9ad4\u3002\u5b83\u8fd4\u56de\u908a\u754c\u6846\u3001\u6a19\u7c64\u540d\u7a31\u3001\u906e\u7f69\u6587\u4ef6\u540d\u548c\u76f8\u95dc\u7684\u6982\u7387\u5206\u6578\u3002<br>3. extract_frames: \u5f9e\u8996\u983b\u6587\u4ef6\u6216YouTube\u93c8\u63a5\u4e2d\u63d0\u53d6\u5e40\u3002\u5b83\u8fd4\u56de\u4e00\u500b\u5143\u7d44\u5217\u8868,\u6bcf\u500b\u5143\u7d44\u5305\u542b\u4e00\u500b\u5e40(numpy\u6578\u7d44)\u548c\u5176\u6642\u9593\u6233\u3002<br>4. ocr: \u5f9e\u5716\u50cf\u4e2d\u63d0\u53d6\u6587\u672c\u3002\u5b83\u8fd4\u56de\u6aa2\u6e2c\u5230\u7684\u6587\u672c\u3001\u6a19\u6e96\u5316\u5750\u6a19\u7684\u908a\u754c\u6846\u548c\u7f6e\u4fe1\u5ea6\u5206\u6578\u7684\u5217\u8868\u3002<br>5. clip: \u4f7f\u7528\u7d66\u5b9a\u7684\u985e\u5225\u6216\u6a19\u7c64\u5217\u8868\u5c0d\u5716\u50cf\u6216\u88c1\u526a\u7684\u6aa2\u6e2c\u7d50\u679c\u9032\u884c\u5206\u985e\u3002\u5b83\u8fd4\u56de\u8f38\u5165\u985e\u5225\u5217\u8868\u53ca\u5176\u57fa\u65bc\u5716\u50cf\u5167\u5bb9\u7684\u6982\u7387\u5206\u6578\u3002<br>6. vit_image_classification: \u5c0d\u5716\u50cf\u9032\u884c\u5206\u985e\u3002\u5b83\u8fd4\u56de\u985e\u5225\u5217\u8868\u53ca\u5176\u57fa\u65bc\u5716\u50cf\u5167\u5bb9\u7684\u6982\u7387\u5206\u6578\u3002<br>7. vit_nsfw_classification: \u5c07\u5716\u50cf\u5206\u985e\u70ba&#8221;nsfw&#8221;\u6216&#8221;normal&#8221;\u3002\u5b83\u8fd4\u56de\u9810\u6e2c\u7684\u6a19\u7c64\u53ca\u5176\u6982\u7387\u5206\u6578\u3002<br>8. loca_zero_shot_counting: \u8a08\u7b97\u7d66\u5b9a\u5716\u50cf\u4e2d\u4e3b\u8981\u524d\u666f\u7269\u9ad4\u7684\u6578\u91cf,\u7121\u9700\u5176\u4ed6\u4fe1\u606f\u3002<br>9. loca_visual_prompt_counting: \u6839\u64da\u8996\u89ba\u63d0\u793a(\u908a\u754c\u6846)\u8a08\u7b97\u5716\u50cf\u4e2d\u4e3b\u8981\u524d\u666f\u7269\u9ad4\u7684\u6578\u91cf\u3002<br>10. florencev2_roberta_vqa: \u5206\u6790\u5716\u50cf\u5167\u5bb9,\u751f\u6210\u8a73\u7d30\u63cf\u8ff0,\u4e26\u5617\u8a66\u56de\u7b54\u7d66\u5b9a\u7684\u554f\u984c\u3002<br>11. florencev2_image_caption: \u6839\u64da\u5716\u50cf\u5167\u5bb9\u751f\u6210\u5716\u50cf\u8aaa\u660e\u6216\u63cf\u8ff0\u3002<br>12. florencev2_object_detection: \u7121\u9700\u6587\u672c\u63d0\u793a\u6216\u95be\u503c\u5373\u53ef\u6aa2\u6e2c\u5716\u50cf\u4e2d\u7684\u5e38\u898b\u7269\u9ad4\u3002<br>13. detr_segmentation: \u7121\u9700\u6587\u672c\u63d0\u793a\u5373\u53ef\u5206\u5272\u5716\u50cf\u4e2d\u7684\u5e38\u898b\u7269\u9ad4\u3002<br>14. depth_anything_v2: \u5f9e\u7d66\u5b9a\u7684RGB\u5716\u50cf\u751f\u6210\u6df1\u5ea6\u5716\u50cf\u3002<br>15. generate_soft_edge_image: \u751f\u6210\u8edf\u908a\u7de3\u5716\u50cf(HED)\u3002<br>16. dpt_hybrid_midas: \u5f9e\u7d66\u5b9a\u7684RGB\u5716\u50cf\u751f\u6210\u6cd5\u7dda\u8cbc\u5716\u3002<br>17. generate_pose_image: \u5f9e\u7d66\u5b9a\u7684RGB\u5716\u50cf\u751f\u6210\u958b\u653e\u5f0f\u59ff\u614b\u9aa8\u67b6\/\u68d2\u72c0\u5716\u50cf\u3002<br>18. closest_mask_distance: \u8a08\u7b97\u5169\u500b\u906e\u7f69\u4e4b\u9593\u7684\u6700\u8fd1\u8ddd\u96e2\u3002<br>19. closest_box_distance: \u8a08\u7b97\u5169\u500b\u908a\u754c\u6846\u4e4b\u9593\u7684\u6700\u8fd1\u8ddd\u96e2\u3002<br>20. save_json: \u5c07\u6578\u64da\u4fdd\u5b58\u70baJSON\u6587\u4ef6\u7684\u5be6\u7528\u51fd\u6578\u3002<br>21. load_image: \u5f9e\u7d66\u5b9a\u6587\u4ef6\u8def\u5f91\u52a0\u8f09\u5716\u50cf\u7684\u5be6\u7528\u51fd\u6578\u3002<br>22. save_image: \u5c07\u5716\u50cf\u4fdd\u5b58\u5230\u6587\u4ef6\u8def\u5f91\u7684\u5be6\u7528\u51fd\u6578\u3002<br>23. save_video: \u5c07\u5e40\u5217\u8868\u4fdd\u5b58\u70bamp4\u8996\u983b\u6587\u4ef6\u7684\u5be6\u7528\u51fd\u6578\u3002<br>24. overlay_bounding_boxes: \u5728\u5716\u50cf\u4e0a\u986f\u793a\u908a\u754c\u6846\u7684\u5be6\u7528\u51fd\u6578\u3002<br>25. overlay_segmentation_masks: \u986f\u793a\u5206\u5272\u906e\u7f69\u7684\u5be6\u7528\u51fd\u6578\u3002<br>26. overlay_heat_map: \u5728\u5716\u50cf\u4e0a\u986f\u793a\u71b1\u5716\u7684\u5be6\u7528\u51fd\u6578\u3002<br>27. template_match: \u6aa2\u6e2c\u7d66\u5b9a\u5716\u50cf\u4e2d\u6a21\u677f\u7684\u6240\u6709\u5be6\u4f8b\u3002\u8fd4\u56de\u6aa2\u6e2c\u5230\u7684\u6a21\u677f\u4f4d\u7f6e\u548c\u76f8\u61c9\u7684\u76f8\u4f3c\u5ea6\u5206\u6578\u3002<\/p>\n\n\n\n<p>\u9019\u4e9b\u5de5\u5177\u51fd\u5f0f\u6db5\u84cb\u4e86\u5ee3\u6cdb\u7684\u8a08\u7b97\u6a5f\u8996\u89ba\u4efb\u52d9,\u5305\u62ec\u7269\u9ad4\u6aa2\u6e2c\u3001\u5206\u5272\u3001\u5716\u50cf\u5206\u985e\u3001\u6587\u672c\u8b58\u5225\u3001\u5716\u50cf\u63cf\u8ff0\u751f\u6210\u7b49,\u4ee5\u53ca\u4e00\u4e9b\u8f14\u52a9\u529f\u80fd\u5982\u5716\u50cf\u52a0\u8f09\u3001\u4fdd\u5b58\u548c\u53ef\u8996\u5316<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83d\udea7<a href=\"https:\/\/arxiv.org\/abs\/2407.01502\" target=\"_blank\" rel=\"noreferrer noopener\">AI Agents That Matter<\/a><\/h3>\n\n\n\n<p>\u6709\u4e9b AI Agent \u7684 benchmark \u8868\u73fe\u597d\uff0c\u662f\u56e0\u70ba\u4e0d\u8a08\u63a8\u8ad6\u6210\u672c\u8dd1\u51fa\u4f86\u7684\uff0c\u4e0d\u662f\u771f\u7684\u5be6\u7528!<\/p>\n\n\n\n<p>\u4e0a\u500b\u6708\u666e\u6797\u65af\u9813\u5927\u5b78\u6709\u7bc7 paper: AI Agents That Matter \u5c31\u5728\u8b1b: &nbsp;\u8ffd\u6c42\u6700\u5927\u6e96\u78ba\u6027\u53ef\u80fd\u6703\u5c0e\u81f4\u7121\u9650\u5236\u7684\u6210\u672c\uff0c\u56e0\u6b64\u5f88\u591a AI Agent \u6392\u884c\u699c\u4e26\u6c92\u6709\u5be6\u7528\u610f\u7fa9\uff0c\u56e0\u70ba\u6c92\u6709\u8003\u616e\u63a8\u8ad6\u6210\u672c\u3002\uff08\u4f5c\u8005\u65e9\u5148\u4e5f\u5beb\u4e86\u4e00\u7bc7&nbsp;<a href=\"https:\/\/www.aisnakeoil.com\/p\/ai-leaderboards-are-no-longer-useful\" rel=\"noreferrer noopener\" target=\"_blank\">Blog:&nbsp;AI leaderboards are no longer useful. It&#8217;s time to switch to Pareto curves<\/a>)<\/p>\n\n\n\n<p>\u4f8b\u5982\u540c\u4e00\u500b\u984c\u76ee\uff0c\u53cd\u8986\u547c\u53eb LLM \u4e26\u9032\u884c\u591a\u6578\u6295\u7968\uff0c\u53ef\u4ee5\u5728 GSM-8K\u3001MATH\u3001Chess \u548c MMLU \u7b49\u57fa\u6e96\u6e2c\u8a66\u4e2d\uff0c\u986f\u8457\u63d0\u9ad8\u6e96\u78ba\u6027\u3002(\u7de8\u6309: \u4f8b\u5982\u524d\u4e00\u9663\u5b50\u7684\u8ad6\u6587 More Agents Is All You Need \u6216 Mixture-of-Agents \u9019\u5169\u7bc7\u7684\u4f5c\u6cd5)\uff0c\u6211\u5011\u61c9\u8a72\u8981\u540c\u6642\u6700\u4f73\u5316\u6e96\u78ba\u6027\u548c\u6210\u672c\uff0c\u627e\u5230\u6700\u4f73\u5e73\u8861\u9ede\u3002<\/p>\n\n\n\n<p>\u4f5c\u8005\u7528\u7c21\u55ae\u7684\u57fa\u672c\u7b56\u7565 Retry, Warming, Escalation\uff0c\u5c31\u53ef\u4ee5\u6253\u81c9\u4e00\u4e9b\u8907\u96dc\u7684\u4ee3\u7406\u67b6\u69cb\uff0c\u4e0d\u4f46\u66f4\u6e96\u9084\u66f4\u4fbf\u5b9c\u3002Retry \u5c31\u662f\u932f\u4e86\u91cd\u8a66\u4e00\u6b21\uff0cWarming \u4e5f\u662f\u91cd\u8a66\u4f46\u6eab\u5ea6\u52a0 0.5\u3001Escalation \u5247\u662f\u932f\u4e86\u5c31\u63db\u4e00\u500b\u66f4\u53b2\u5bb3\u7684\u6a21\u578b\u3002 &nbsp;<\/p>\n\n\n\n<p>\u4f5c\u8005\u5efa\u8b70\u4e4b\u5f8c\u767c\u660e\u65b0 Agent \u67b6\u69cb\u7684\u4eba\uff0c\u61c9\u8a72\u8981\u5305\u62ec\u9019\u4e9b\u57fa\u672c\u7b56\u7565\u7576\u4f5c baseline \u57fa\u6e96\u3002\u9644\u5716\u5c31\u662f\u8a55\u6e2c HumanEval\uff0c\u767c\u73fe\u57fa\u672c\u7b56\u7565\u6548\u679c\u5c31\u8ddf\u8907\u96dc\u7684 LATS, LDB, Reflexion \u4e00\u6a23\u597d\uff0c\u4f46\u662f\u6210\u672c\u66f4\u4fbf\u5b9c<\/p>\n\n\n\n<p>\u53e6\u4e00\u500b\u6848\u4f8b\u662f: \u4f7f\u7528 RAG \u6216\u662f\u7528\u6a21\u578b\u9577\u4e0a\u4e0b\u6587\u4f86\u505a QA\uff0c\u4e5f\u662f\u6700\u8fd1\u5e38\u898b\u7684\u8a0e\u8ad6\u3002\u4f8b\u5982 NovelQA \u662f\u500b\u5c08\u9580 benchmark \u6a21\u578b\u5728\u8d85\u904e 200k tokens \u7684 QA \u80fd\u529b\uff0c\u800c\u4f5c\u8005\u7528 RAG \u7684\u65b9\u5f0f\u505a\uff0c\u6e96\u78ba\u7387\u5176\u5be6\u8ddf\u7528\u6a21\u578b\u9577\u4e0a\u4e0b\u6587\u5dee\u4e0d\u591a\uff0c\u4f46\u662f\u6210\u672c\u53ea\u6709\u4e00\u534a\u3002<\/p>\n\n\n\n<p>\u958b\u767c\u6a21\u578b\u7684\u4e0a\u6e38\u79d1\u5b78\u5bb6\uff0c\u7576\u7136\u4e3b\u8981\u5728\u4e4e\u6a21\u578b\u672c\u8eab\u7684\u8a55\u6e2c\u8868\u73fe\u3002\u4f46\u662f\u4f5c\u70ba\u4e0b\u6e38\u4f7f\u7528\u6a21\u578b\u7684\u5de5\u7a0b\u5e2b\uff0c\u6211\u66f4\u5728\u4e4e\u7684\u7cfb\u7d71\u7d44\u5408\u51fa\u4f86\u5f8c\u7684\u6e96\u78ba\u6027\u8207\u6210\u672c\u7684\u5e73\u8861\u3002<\/p>\n\n\n\n<p>\u7d50\u8ad6: \u8eab\u70ba\u4e00\u500b\u5de5\u7a0b\u5e2b\uff0c\u6c92\u6709\u8003\u616e\u6210\u672c\u7684 AI Agent \u67b6\u69cb\u662f\u6c92\u6709\u610f\u7fa9\u7684\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\ud83e\uddd1\u200d\ud83c\udf73<a href=\"https:\/\/maggieappleton.com\/home-cooked-software\" target=\"_blank\" rel=\"noreferrer noopener\">\u5bb6\u5e38\u8edf\u9ad4\u548c\u8349\u6839\u958b\u767c\u8005<\/a><\/h3>\n\n\n\n<p>\u5927\u8a9e\u8a00\u6a21\u578b\u5c07\u5e36\u4f86 \u201c\u5bb6\u5e38\u8edf\u9ad4\u548c\u8349\u6839\u958b\u767c\u8005&#8221; \u7684\u9ec3\u91d1\u65b0\u6642\u4ee3! \u770b\u4e86\u4e00\u5834 Local-First Conf \u7684\u6f14\u8b1b\uff0c\u8b1b\u8005 Maggie \u63d0\u51fa\u4e86\u4e00\u500b\u6709\u610f\u7fa9\u7684\u89c0\u9ede:<\/p>\n\n\n\n<p>&#8211; \u5bb6\u5e38\u8edf\u9ad4(home-cooked software): &nbsp; \u7d66\u81ea\u5df1\u3001\u670b\u53cb\u548c\u5bb6\u4eba\u4f7f\u7528\u7684\u5c0f\u61c9\u7528\u7a0b\u5f0f\uff0c\u6c92\u6709\u8981\u5275\u696d\uff0c\u800c\u662f\u51fa\u65bc\u5c0d\u5468\u570d\u4eba\u7684\u95dc\u5fc3\u548c\u611b\uff0c\u5e6b\u52a9\u4ed6\u5011\u89e3\u6c7a\u5c0f\u554f\u984c\uff0c\u5c31\u50cf\u4ed6\u70ba\u4ed6\u5011\u505a\u4e86\u4e00\u9813\u5bb6\u5e38\u83dc\u4e00\u6a23\u3002<br>&#8211; \u8349\u6839\u958b\u767c\u8005(barefoot developers): \u624e\u6839\u65bc\u793e\u5340\uff0c\u4e86\u89e3\u5468\u570d\u4eba\u5011\u7684\u9700\u6c42\u548c\u554f\u984c\u3002\u4ed6\u5011\u6709\u9818\u57df\u5c08\u696d\u3001\u5177\u5099\u6280\u8853\u654f\u611f\u5ea6\u3001\u5584\u65bc\u89e3\u6c7a\u554f\u984c\uff0c\u4f46\u6c92\u6709\u8981\u6210\u70ba\u5168\u8077\u7a0b\u5f0f\u8a2d\u8a08\u5e2b\u3002<\/p>\n\n\n\n<p>\u751f\u6210\u5f0f AI \u6642\u4ee3\u964d\u4f4e\u4e86\u5beb\u7a0b\u5f0f\u9580\u6abb\uff0c\u4e4b\u5f8c\u5c07\u6703\u6709\u66f4\u591a &#8220;\u8349\u6839&#8221;\u958b\u767c\u8005\uff0c\u505a\u51fa\u66f4\u591a &#8220;\u5bb6\u5e38\u8edf\u9ad4&#8221;!<br>\u8b1b\u8005\u4e5f\u9810\u671f\u5c08\u696d\u958b\u767c\u4eba\u54e1\u7684\u6578\u91cf\u5728\u672a\u4f86\u5e7e\u5e74\u5c07\u6703\u589e\u9577\uff0c\u800c\u8349\u6839\u958b\u767c\u8005\u7684\u6578\u91cf\u66f4\u5c07\u6703\u6307\u6578\u589e\u9577!&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\u2728<a href=\"https:\/\/ihower.tw\/notes\/%E6%8A%80%E8%A1%93%E7%AD%86%E8%A8%98-AI\/2024\/Claude+artifacts+system+prompt\" target=\"_blank\" rel=\"noreferrer noopener\">Claude Artifacts \u7684 system prompt<\/a><\/h3>\n\n\n\n<p>Claude app \u65b0\u63a8\u51fa\u7684&nbsp;<a href=\"https:\/\/www.anthropic.com\/news\/claude-3-5-sonnet\" rel=\"noreferrer noopener\" target=\"_blank\">Artifacts<\/a>&nbsp;\u529f\u80fd\u771f\u7684\u662f\u8d85\u8b9a\u5f88\u597d\u7528\u7684\u4ecb\u9762\u8a2d\u8a08\uff0c\u53ef\u4ee5\u5f88\u65b9\u4fbf\u9810\u89bd\u8f38\u51fa\u7d50\u679c (\u53ef\u770b\u6211\u7684&nbsp;<a href=\"https:\/\/www.facebook.com\/watch\/?v=1253871292686979\" rel=\"noreferrer noopener\" target=\"_blank\">react \u793a\u7bc4\u5f71\u7247<\/a>)\u3002\u8eab\u70ba LLM hacker\uff0c\u7576\u7136\u662f\u8981\u628a system prompt \u5f04\u51fa\u4f86\u7814\u7a76\u7814\u7a76\uff0c&lt;del&gt;\u770b\u770b\u4eba\u5bb6\u662f\u600e\u9ebc\u4e0b prompt \u505a\u51fa\u4f86\u7684&lt;\/del&gt; \u5fb9\u5e95\u5b78\u6703 Artifacts \u9019\u500b\u529f\u80fd\u7684\u7528\u6cd5\uff0c\u5149\u9019\u500b prompt \u53ef\u5c31\u8017\u8cbb\u4e86 5k tokens \u81a9\uff0c\u5305\u62ec:&nbsp;<\/p>\n\n\n\n<p>* \u5b9a\u7fa9\u4e86 Artifacts \u662f\u4ec0\u9ebc\u3001\u4ec0\u9ebc\u6642\u5019\u4e0d\u8981\u7528\u3001\u5982\u4f55\u7528<br>* \u5b9a\u7fa9 Artifacts \u7684\u8f38\u51fa XML \u7d50\u69cb\u5305\u62ec ant_thinking \u548c ant_artifact\uff0c\u5f8c\u8005\u5b9a\u7fa9\u9019\u662f\u4ec0\u9ebc type \u7684\u6587\u4ef6\uff0c\u6709\u652f\u63f4 code, markdown, html, svg \u8ddf react<br>* ant_thinking \u9019\u500b CoT \u904e\u7a0b\uff0c\u4e3b\u8981\u7528\u4f86\u5224\u65b7 \u7528\u6236\u7684\u554f\u984c\u662f\u5426\u9069\u5408\u7528 Artifacts\uff0c\u4ee5\u53ca\u5982\u679c\u8981\u7528\uff0c\u9019\u662f\u65b0\u7684 Artifacts \u9084\u662f\u5ef6\u7e8c\u7684\u4fee\u6539<br>* \u6bcf\u4efd Artifacts \u6703\u6709\u81ea\u5df1\u7684 ID\uff0c\u5982\u679c\u662f\u5ef6\u7e8c\u7684\u4fee\u6539\uff0c\u5c31\u6703\u7528\u76f8\u540c\u7684 ID \u4ee5\u4fdd\u6301\u9023\u7e8c\u6027<br>* \u5f88\u591a examples \u7bc4\u4f8b&#8230;..<br><\/p>\n\n\n\n<p>&#8212;-<\/p>\n\n\n\n<p>\u6700\u5f8c\u63a8\u85a6\u4e00\u500b\u53ef\u4ee5\u8207 OpenAI \u6280\u8853\u5718\u968a\u76f4\u63a5\u5408\u4f5c\u7684\u96e3\u5f97\u8077\u7f3a: HelperAI \u6b63\u5728\u5c0b\u627eAI\u5168\u7aef\u5de5\u7a0b\u5e2b\uff0c\u6253\u9020\u4e0b\u4e00\u500b\u4e16\u4ee3\u7684\u5546\u6a5f\u5a92\u5408AI Agent\uff01<\/p>\n\n\n\n<p>HelperAI \u662fYC\u3001\u4e09\u661f\u3001\u5bcc\u862d\u514b\u6797\u6295\u8cc7\u7684AI Agent\u516c\u53f8\uff0c\u6b63\u5728\u958b\u767c\u300cAI\u5546\u6a5f\u5a92\u5408\u300d\u5e73\u53f0\uff0c\u76ee\u6a19\u5e6b\u52a9\u5168\u7403\u6578\u5343\u842c\u4e2d\u5c0f\u4f01\u696d\u6253\u9020AI\u4ee3\u7406\u4eba\u9032\u884c\u5546\u6a5f\u5a92\u5408\uff0c\u5be6\u73fe\u300cAutonomous Company\u300d\u7684\u9858\u666f\uff01\u8a73\u60c5<a href=\"https:\/\/www.yourator.co\/companies\/chainsight\/jobs\/36215\" rel=\"noreferrer noopener\" target=\"_blank\">\u8acb\u898b Yourator \u8077\u7f3a<\/a>\u3002&nbsp;<\/p>\n\n\n\n<p>\u2013 ihower<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hello! \u4f60\u597d&nbsp;\ud83d\udc4b \u6211\u662f ihower\uff0c\u9019\u671f\u7d2f\u7a4d\u4e86\u4e0d\u5c11\u7cbe\u5f69\u5167\u5bb9\u5206\u4eab\u7d66\u5927\u5bb6\u3002 \ud83d\udd1dWhat We\u2019v &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/ihower.tw\/blog\/12422-aie-building-with-llms\" class=\"more-link\">\u95b1\u8b80\u5168\u6587<span class=\"screen-reader-text\">\u3008\u611b\u597d AI Engineer \u96fb\u5b50\u5831 \ud83d\ude80\u00a0\u5efa\u69cb LLMs \u61c9\u7528\u7684\u6230\u7565\u3001\u904b\u71df\u548c\u6230\u8853\u7d93\u9a57\u5206\u4eab #16\u3009<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[91],"tags":[],"class_list":["post-12422","post","type-post","status-publish","format-standard","hentry","category-aie","entry"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p1q6tG-3em","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12422","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/comments?post=12422"}],"version-history":[{"count":5,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12422\/revisions"}],"predecessor-version":[{"id":13017,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/posts\/12422\/revisions\/13017"}],"wp:attachment":[{"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/media?parent=12422"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/categories?post=12422"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ihower.tw\/blog\/wp-json\/wp\/v2\/tags?post=12422"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}