Blog Posts
![AI开发](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fprod-files-secure.s3.us-west-2.amazonaws.com%252Fda864e11-683f-4c2d-a264-16ecdf57fff9%252Ffd2c171f-a706-4a42-94d2-4fd358389777%252FSnipaste_2023-10-30_15-03-58.png%3Ftable%3Dblock%26id%3De6d87ac6-dd5b-48b1-8e18-93f7435fdb4a%26cache%3Dv2&w=3840&q=75)
AI开发
这篇文章介绍了关于AI开发的基础资料,包括开发工具LangChain和LlamaIndex,以及LangGraph框架。还讨论了LLMs微调的挑战和提示工程技术的应用。此外,还介绍了RAG(增强检索)的基本原理和优化方法,以及向量数据库和Agent的相关内容。
LLM
RAG
Prompt
2024/09/02
![LangGraph实战 子图、流响应](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fprod-files-secure.s3.us-west-2.amazonaws.com%252Fda864e11-683f-4c2d-a264-16ecdf57fff9%252F15ea6de7-4463-4ea2-824c-0a3257d0fb1c%252FPixPin_2024-09-11_11-27-06.png%3Ftable%3Dblock%26id%3D1738c66d-44b6-45a1-bfeb-f50062d3efec%26cache%3Dv2&w=3840&q=75)
LangGraph实战 子图、流响应
记录Langgraph使用过程中遇到的问题以及解决方法
LangGraph
2024/09/11
![Chroma使用和服务端docker部署](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fprod-files-secure.s3.us-west-2.amazonaws.com%252Fda864e11-683f-4c2d-a264-16ecdf57fff9%252Fbe80de0b-d9b5-4adb-88c4-855e2e64b4bd%252FPixPin_2024-08-23_10-11-37.png%3Ftable%3Dblock%26id%3D34871ffa-62bc-4995-af00-6faaca757ac8%26cache%3Dv2&w=3840&q=75)
Chroma使用和服务端docker部署
介绍Chroma服务端部署,客户端基本的使用
RAG
Vector Store
2024/08/27
![如何选择大模型(榜单+指标)](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fprod-files-secure.s3.us-west-2.amazonaws.com%252Fda864e11-683f-4c2d-a264-16ecdf57fff9%252F5199fe50-8ede-4909-842f-2e29cb4f18ad%252FPixPin_2024-06-03_13-49-11.png%3Ftable%3Dblock%26id%3D4ab81ed7-7622-4ef1-9fc6-1e1ae4edbd99%26cache%3Dv2&w=3840&q=75)
如何选择大模型(榜单+指标)
在选择大模型之前,需要明确自己对语言、通识、推理、数学、代码、长文本和工具等七大能力的偏好。评测指标包括MMLU、C Eval、ARC-C、BBH、GSM8K、MBPP、Human Eval、L-Eval和T-Eval。常用榜单包括OpenCompass司南榜单、Huggingface榜单和MTEB榜单。
LLM
2024/06/25
![LLM部署(docker+fastchat+vllm+embedding) 支持工具调用](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fprod-files-secure.s3.us-west-2.amazonaws.com%252Fda864e11-683f-4c2d-a264-16ecdf57fff9%252F1012be8b-0f81-4c59-8bcb-6b985bf822a2%252FPixPin_2024-06-03_17-44-52.png%3Ftable%3Dblock%26id%3D6e4516ff-0701-4009-9841-b0f023ca43a6%26cache%3Dv2&w=3840&q=75)
LLM部署(docker+fastchat+vllm+embedding) 支持工具调用
该文档介绍了关于LLM模型部署的内容,包括模型选择、模型下载、模型部署方案以及模型使用和加速方法。推荐的部署方案是使用docker部署,同时提供了本地环境部署的方法。模型加速方面介绍了vllm和flash-attention两种方法。
LLM
2024/08/23
![Prompt编写](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fprod-files-secure.s3.us-west-2.amazonaws.com%252Fda864e11-683f-4c2d-a264-16ecdf57fff9%252F51958e21-6ba8-47b4-8475-da7a466e4925%252F%2525E6%252597%2525A0%2525E6%2525A0%252587%2525E9%2525A2%252598.png%3Ftable%3Dblock%26id%3Dad71285d-325f-42ad-a6f9-28e6cf90571c%26cache%3Dv2&w=3840&q=75)
Prompt编写
该文档是关于Prompt编写指南的,介绍了26种技巧与效果,以及进阶的CoT、类推提示法、PoT、ToT和GoT等方法,用于提升大模型的推理能力。
LLM
Prompt
2024/08/08
![修改FastChat使支持工具调用(LangGraph适配FastChat)](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fprod-files-secure.s3.us-west-2.amazonaws.com%252Fda864e11-683f-4c2d-a264-16ecdf57fff9%252F6a3e2a85-b007-4e34-9ba3-66792f5a8e7c%252F%2525E6%252597%2525A0%2525E6%2525A0%252587%2525E9%2525A2%252598.png%3Ftable%3Dblock%26id%3Dc8a30e22-25df-414c-aa1d-2582622256e5%26cache%3Dv2&w=3840&q=75)
修改FastChat使支持工具调用(LangGraph适配FastChat)
本文介绍了如何修改FastChat以支持工具调用和LangGraph适配FastChat的问题。针对
with_structured_output
方法返回None的问题,提供了两种解决方案:使用chain替换该方法或继承ChatOpenAI并重写该方法。对于LangGraph的create_react_agent
不能调用工具的问题,也提供了两种解决方案:修改FastChat接口以支持tools参数或替换create_react_agent
方法。LLM
LangChain
LangGraph
2024/06/20
![LLM Knowledge Base](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fprod-files-secure.s3.us-west-2.amazonaws.com%252Fda864e11-683f-4c2d-a264-16ecdf57fff9%252F3a0c8bf5-0eb9-4018-a871-084430dace0f%252F1713164766995wqeqweq.png%3Ftable%3Dblock%26id%3Dad6de748-8932-498a-84ba-5f5432b43885%26cache%3Dv2&w=3840&q=75)
LLM Knowledge Base
需要关注的LLM 相关知识或论文
LLM
Knowledge
2024/06/15
![K8S+Rancher搭建](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fs3-us-west-2.amazonaws.com%252Fsecure.notion-static.com%252Ff3fe4ddb-ef26-452d-b0c5-54cb0137e847%252Fkkk.png%3Ftable%3Dblock%26id%3Defa53000-b650-4171-804f-d2d7261ab846%26cache%3Dv2&w=3840&q=75)
K8S+Rancher搭建
K8S 搭建
K8S
Rancher
2024/06/15
![Airflow使用](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fs3-us-west-2.amazonaws.com%252Fsecure.notion-static.com%252F909960a5-d567-422c-9bae-7fca7a4c33c3%252Fv2-88f17fef4cc15af76157f1b916de355a_1440w.jpg%3Ftable%3Dblock%26id%3Ddb974ca7-8565-4823-b420-12b1b204e0a9%26cache%3Dv2&w=3840&q=75)
Airflow使用
Airflow使用心得
Install
Airflow
2024/06/15
![企业级知识库选择](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fs3-us-west-2.amazonaws.com%252Fsecure.notion-static.com%252Fdc41d4ea-c6ed-4575-b413-a5c4f276f7eb%252FSnipaste_2022-10-20_11-15-07.png%3Ftable%3Dblock%26id%3Dbe4929d1-01c0-4c1c-b553-33639fdd40e7%26cache%3Dv2&w=3840&q=75)
企业级知识库选择
知识库选择
Knowledge
2024/06/15
![QQ Bot+notion实现随手记](/_next/image?url=https%3A%2F%2Fwww.notion.so%2Fimage%2Fhttps%253A%252F%252Fs3-us-west-2.amazonaws.com%252Fsecure.notion-static.com%252Fd505ac27-153f-4f17-965d-8775a0bd209e%252FiShot2022-10-15_15.37.17.png%3Ftable%3Dblock%26id%3D224be3c3-178a-49f0-af8e-1528acf9aa94%26cache%3Dv2&w=3840&q=75)
QQ Bot+notion实现随手记
小玩具
Notion
Script
2024/06/15