In the field of artificial intelligence and natural language processing, utilizing powerful tools and frameworks to interact with locally deployed models is a common and important task. Today, I will share how to use the LangChain framework to access models deployed locally on the RK3588. Background Knowledge Introduction to LangChain LangChain is a powerful Python … Read more
Source: PaperWeekly This article is approximately 4300 words long and is recommended for a reading time of over 10 minutes. AutoAgent is an open-source AI assistant operating system designed to lower the technical barriers for creating AI assistants. The University of Hong Kong recently launched the open-source project AutoAgent, developed by Professor Huang Chao’s laboratory. … Read more
Introduction: J.A.R.V.I.S from Iron Man In the movie Iron Man, J.A.R.V.I.S is an impressive AI assistant. As Tony’s capable aide, he is both reliable and intelligent, capable of connecting to any computer terminal, controlling Tony’s Iron Man suit, and discussing action plans with Tony. The success of J.A.R.V.I.S lies in his highly intelligent AI system, … Read more
A Brief Overview of Meta’s Multi-Token Attention Meta’s new attention mechanism, MTA (Multi-Token Attention), enhances the model’s ability to perceive the locations of key information by incorporating convolution, allowing the model to attend to more information across tokens and attention heads during the attention computation phase. Traditional multi-head attention can split multiple heads to focus … Read more
© Author | Wen Jiaxin Affiliation | Master’s Student at Tsinghua UniversityWhat form should large models take for inference? Is natural language the best way to represent the reasoning path?In September 2024, OpenAI sounded the horn for a reasoning revolution with the o1 model, refreshing cognitive boundaries with astonishing chain lengths of thought. In this … Read more
Last night, while lying in bed scrolling through Moments, a quirky thought popped into my head: what if I could use Python to analyze my Moments and see who I resonate with the most? That would be so interesting! Without hesitation, I jumped up and started tinkering with the code. Don’t laugh, this isn’t just … Read more
In recent years, with the advancements in artificial intelligence, big data, and other technologies, the smart wearable industry has developed rapidly. At the same time, the alignment between smart wearable devices and user needs has also improved quickly, not only enhancing user experience but also giving rise to more application scenarios. As a portable smart … Read more
In recent years, with advancements in artificial intelligence, big data, and other technologies, the smart wearable industry has rapidly developed. Meanwhile, the alignment of smart wearable devices with user needs has also quickly improved, not only enhancing user experience but also giving rise to more application scenarios. As a portable smart wearable device, smartwatches have … Read more
Introduction LoRA (Low-Rank Adaptation of Large Language Models) is a very practical fine-tuning framework for large models. Before the emergence of LoRA, I used to manually modify parameters, optimizers, or layer counts to “refine” models, which was extremely blind. However, the LoRA technique allows for quick fine-tuning of parameters. If the results after LoRA fine-tuning … Read more
Introduction: In China’s “Artificial Intelligence Standardization White Paper (2018)”, a definition of artificial intelligence is given: “Artificial intelligence is the theory, methods, technologies, and application systems that utilize digital computers or machines controlled by digital computers to simulate, extend, and enhance human intelligence, perceive the environment, acquire knowledge, and use knowledge to achieve optimal results.”“ … Read more