ETJava Beta | Java    注册   登录
  • 搜索:
  • Continue-AI编程助手本地部署llama3.1+deepseek-coder-v2

    发表于      阅读(1)     博客类别:Crawler     转自:https://www.cnblogs.com/qianchilang/p/18341838
    如有侵权 请联系我们删除  (页面底部联系我们)  

    领先的开源人工智能代码助手。您可以连接任何模型和任何上下文,以在 IDE 内构建自定义自动完成和聊天体验

    推荐以下开源模型:

    聊天:llama3.1-8B
    推理代码:deepseek-coder-v2:16b

    嵌入模型

    • nomic-embed-text
    模型默认存储路径:C:\Users\你的用户名\.ollama\models\blobs
    模型离线下载:https://pan.quark.cn/s/dbc3fdeffc68
    命令行运行:
    ollama run deepseek-coder-v2:16b
    ollama run llama3.1:8b
    ollama pull nomic-embed-text:latest
    VScode搜索:Continue
     
    对话模型示例:
      "models": [
        {
          "title": "Ollama",
          "provider": "ollama",
          "model": "llama3.1:8b"
        }
      ],
        "models": [    
        {
          "model": "gpt-4-turbo-preview",
          "contextLength": 8192,
          "title": "gpt-4-turbo-preview",
          "systemMessage": "You are an expert software developer. You give helpful and concise responses.",
          "apiKey": "you-key",
          "apiBase": "https://api.fe8.cn/v1", 
          "completionOptions": {
            "temperature": 0.7,
            "topP": 0.9,
            "topK": 10,
            "presencePenalty": 0.01,
            "frequencyPenalty": 0.02
          },
          "provider": "openai"
        }
        ],
    设置代码推理:
      "tabAutocompleteModel": {
        "title": "deepseek-coder-v2:16b",
        "provider": "ollama",
        "model": "deepseek-coder-v2:16b"
      },
    设置嵌入:
      "embeddingsProvider": {
        "provider": "ollama",
        "model": "nomic-embed-text"
      },
     

    使用教程:

    轻松理解代码

    VS code: cmd+L (MacOS) / ctrl+L (Windows)

    Tab自动完成代码

     

    重构您正在编码的函数

    VS code: cmd+I (MacOS) / ctrl+I (Windows)

    询问有关您的代码库的问题

    VS Code: @codebase (MacOS) / @codebase (Windows)
     

    快速使用文档作为上下文

    VS code: @docs (MacOS) / @docs (Windows)

    使用斜杠命令开始操作

    在此处了解有关斜杠命令的更多信息
    VS Code: /edit (MacOS) / /edit (Windows)
     

    将类、文件等添加到上下文中

    VS code: @files (MacOS) / @files (Windows)
    在此处了解有关上下文提供程序的更多信息。
     

    了解终端错误

    VS code: cmd+shift+R (MacOS) / ctrl+shift+R (Windows)
     
    官方文档:
    https://github.com/continuedev/continue
    https://docs.continue.dev/setup/overview
    https://ollama.com/blog/continue-code-assistant
    https://docs.continue.dev/setup/select-model