{"id":655633,"date":"2025-11-14T17:16:01","date_gmt":"2025-11-14T09:16:01","guid":{"rendered":"http:\/\/puo.cn\/?p=655633"},"modified":"2025-11-14T17:16:02","modified_gmt":"2025-11-14T09:16:02","slug":"2h4g%e7%9a%84vps%e9%80%82%e5%90%88%e9%85%8d%e7%bd%ae%e4%bb%80%e4%b9%88%e6%a0%b7%e7%9a%84%e8%bd%bb%e9%87%8f%e5%8c%96%e6%a8%a1%e5%9e%8b%e5%91%a2","status":"publish","type":"post","link":"http:\/\/puo.cn\/?p=655633","title":{"rendered":"2h4g\u7684vps\u9002\u5408\u914d\u7f6e\u4ec0\u4e48\u6837\u7684\u8f7b\u91cf\u5316\u6a21\u578b\u5462"},"content":{"rendered":"

 <\/p>\n

\u5bf9\u4e8e **2\u6838CPU\u30014GB\u5185\u5b58\u30015M\u5e26\u5bbd** \u7684\u963f\u91cc\u4e91VPS\uff0c**\u53ef\u4ee5\u90e8\u7f72\u4e00\u4e9b\u6781\u5c0f\u578b\u7684\u8f7b\u91cf\u5316\u6a21\u578b**\uff0c\u4f46\u9700\u6ee1\u8db3\u4ee5\u4e0b\u6761\u4ef6\uff1a
\n1. **\u53c2\u6570\u91cf\u22641B**\uff08\u6700\u597d\u22640.5B\uff09\uff0c\u4ee5\u51cf\u5c11\u5185\u5b58\u5360\u7528\uff1b
\n2. \u4f7f\u7528 **INT4\/FP4\u91cf\u5316** \u6280\u672f\uff0c\u8fdb\u4e00\u6b65\u538b\u7f29\u5185\u5b58\u9700\u6c42\uff1b
\n3. \u9009\u62e9 **\u5bf9\u8bdd\u4f18\u5316\u578b\u6a21\u578b**\uff08\u800c\u975e\u7eaf\u6587\u672c\u5206\u7c7b\u6a21\u578b\uff09\uff0c\u786e\u4fdd\u5b9e\u7528\u6027\u3002<\/p>\n

### **\u63a8\u8350\u53ef\u90e8\u7f72\u7684\u5c0f\u6a21\u578b\u6e05\u5355**
\n\u4ee5\u4e0b\u662f\u7b26\u5408\u914d\u7f6e\u8981\u6c42\u3001\u4e14\u5177\u5907\u4e00\u5b9a\u5bf9\u8bdd\u80fd\u529b\u7684\u6a21\u578b\uff08\u6309\u5185\u5b58\u5360\u7528\u6392\u5e8f\uff09\uff1a<\/p>\n

\"20251115011444199\"<\/p>\n

### **\u90e8\u7f72\u6ce8\u610f\u4e8b\u9879**
\n1. **\u91cf\u5316\u662f\u5173\u952e**\uff1a\u5fc5\u987b\u4f7f\u7528INT4\/FP4\u91cf\u5316\uff08\u5982\u901a\u8fc7 `ggml` \u6216 `transformers` \u5e93\u8f6c\u6362\uff09\uff0c\u5426\u5219FP16\u7cbe\u5ea6\u7684\u6a21\u578b\u4f1a\u76f4\u63a5\u5360\u6ee1\u5185\u5b58\u3002
\n2. **\u907f\u514d\u957f\u5bf9\u8bdd**\uff1a\u5c0f\u6a21\u578b\u7684**KV\u7f13\u5b58**\uff08\u5b58\u50a8\u5386\u53f2\u4e0a\u4e0b\u6587\uff09\u4f1a\u5feb\u901f\u6d88\u8017\u5185\u5b58\uff0c\u5efa\u8bae\u9650\u5236\u5bf9\u8bdd\u8f6e\u6570\uff08\u5982\u226410\u8f6e\uff09\u3002
\n3. **\u5de5\u5177\u9009\u62e9**\uff1a\u63a8\u8350\u4f7f\u7528 **Ollama**\uff08\u4e00\u952e\u90e8\u7f72\u91cf\u5316\u6a21\u578b\uff09\u6216 **Text Generation WebUI**\uff08\u81ea\u5b9a\u4e49\u91cf\u5316\u53c2\u6570\uff09\uff0c\u7b80\u5316\u90e8\u7f72\u6d41\u7a0b\u3002
\n4. **\u6027\u80fd\u9884\u671f**\uff1a2\u6838CPU\u7684\u63a8\u7406\u901f\u5ea6\u8f83\u6162\uff08\u59820.5B\u6a21\u578b\u751f\u6210\u4e00\u53e5\u8bdd\u53ef\u80fd\u97001-3\u79d2\uff09\uff0c\u9002\u5408\u8f7b\u5ea6\u6d4b\u8bd5\uff0c\u4e0d\u9002\u5408\u9ad8\u5e76\u53d1\u6216\u590d\u6742\u4efb\u52a1\u3002<\/p>\n

### **\u7ed3\u8bba**
\n\u4f60\u7684VPS**\u53ef\u4ee5\u90e8\u7f720.5B-1.8B\u7684\u8f7b\u91cf\u5316\u6a21\u578b**\uff08\u5982Qwen1.5-0.5B\u6216Mistral Tiny\uff09\uff0c\u4f46\u9700\u4e25\u683c\u9075\u5faa\u91cf\u5316\u3001\u9650\u5236\u5bf9\u8bdd\u957f\u5ea6\u7b49\u4f18\u5316\u63aa\u65bd\u3002\u82e5\u8ffd\u6c42\u66f4\u597d\u7684\u4e2d\u6587\u6548\u679c\uff0c\u4f18\u5148\u9009\u62e9**Qwen1.5-0.5B**\uff1b\u82e5\u9700\u8981\u5e73\u8861\u6027\u80fd\u548c\u6548\u679c\uff0c\u53ef\u9009**Mistral Tiny**\u3002<\/p>\n

\u82e5\u60f3\u5c1d\u8bd5\u66f4\u5c0f\u7684\u6a21\u578b\uff08\u5982<0.5B\uff09\uff0c\u53ef\u5173\u6ce8 **DistilGPT-2**\uff080.3B\uff09\u6216 **Alpaca-7B**\uff08\u867d\u540d\u4e3a7B\uff0c\u4f46\u6709\u84b8\u998f\u72480.3B\uff09\uff0c\u4f46\u8fd9\u4e9b\u6a21\u578b\u7684\u5bf9\u8bdd\u80fd\u529b\u8f83\u5f31\uff0c\u66f4\u9002\u5408\u7279\u5b9a\u4efb\u52a1\uff08\u5982\u6587\u672c\u751f\u6210\uff09\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"

  \u5bf9\u4e8e **2\u6838CPU\u30014GB\u5185\u5b58\u30015M\u5e26\u5bbd** \u7684\u963f\u91cc\u4e91VPS\uff0c**\u53ef\u4ee5\u90e8\u7f72\u4e00\u4e9b\u6781\u5c0f\u578b\u7684\u8f7b\u91cf\u5316\u6a21\u578b**\uff0c\u4f46\u9700\u6ee1\u8db3\u4ee5\u4e0b\u6761\u4ef6\uff1a 1. **\u53c2\u6570\u91cf\u22641B**\uff08\u6700\u597d\u22640.5B\uff09\uff0c\u4ee5\u51cf\u5c11\u5185\u5b58\u5360\u7528\uff1b 2. \u4f7f\u7528 **INT4\/FP4\u91cf\u5316*…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[128],"tags":[847,935,854],"topic":[],"class_list":["post-655633","post","type-post","status-publish","format-standard","hentry","category-128","tag-vps","tag-935","tag-854"],"_links":{"self":[{"href":"http:\/\/puo.cn\/index.php?rest_route=\/wp\/v2\/posts\/655633","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/puo.cn\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/puo.cn\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/puo.cn\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/puo.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=655633"}],"version-history":[{"count":1,"href":"http:\/\/puo.cn\/index.php?rest_route=\/wp\/v2\/posts\/655633\/revisions"}],"predecessor-version":[{"id":655636,"href":"http:\/\/puo.cn\/index.php?rest_route=\/wp\/v2\/posts\/655633\/revisions\/655636"}],"wp:attachment":[{"href":"http:\/\/puo.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=655633"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/puo.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=655633"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/puo.cn\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=655633"},{"taxonomy":"topic","embeddable":true,"href":"http:\/\/puo.cn\/index.php?rest_route=%2Fwp%2Fv2%2Ftopic&post=655633"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}