Chat with Open Large Language Models

🐦Raven-RWKV

国产精品。

1
2
3
4
5
6
7
8
git lfs install
git clone https://huggingface.co/spaces/BlinkDL/Raven-RWKV-7B
cd Raven-RWKV-7B
python -m venv .
source bin/activate
pip install -r requirements.txt
aria2c https://huggingface.co/BlinkDL/rwkv-4-raven/resolve/main/RWKV-4-Raven-14B-v9-Eng99%25-Other1%25-20230412-ctx8192.pth
python -i app.py

需要对app.py做修改。

GPT4ALL

1
2
3
4
5
6
git clone https://github.com/nomic-ai/nomic
cd nomic/
pip install .[GPT4All]
pip install nomic
pip install --force-reinstall "bin/peft-0.3.0.dev0-py3-none-any.whl"
pip install --force-reinstall "bin/transformers-4.28.0.dev0-py3-none-any.whl"

Change the file nomic/gpt4all/gpt4all.py.

1
2
3
4
5
6
7
8
from nomic.gpt4all.gpt4all import GPT4AllGPU
m = GPT4AllGPU('llama-7b-hf')
config = {'num_beams': 2,
          'min_new_tokens': 10,
          'max_length': 100,
          'repetition_penalty': 2.0}
out = m.generate('write me a story about a lonely computer', config)
print(out)

However, I have inadequate GPU.

🦙🌲 Alpaca-LoRA at huggingface

llama.cpp rules

Hacker News上大家的分享

https://news.ycombinator.com/item?id=35474145

rwkv.cpp rules

1
2
3
4
5
6
cmake -DBUILD_SHARED_LIBS=ON .
cmake --build . --config Release
python quantize.py rwkv.cpp-14B.bin rwkv.cpp-14B-Q4_1.bin 3
python quantize.py rwkv.cpp-14B.bin rwkv.cpp-14B-Q4_0.bin 2
python quantize.py rwkv.cpp-14B.bin rwkv.cpp-14B-Q4_1_O.bin 4

Full model (FP32), load in 15 s
Tell me more about the evolution of the eye
Response: The evolution of the eye is a fascinating topic that has been studied by scientists for many years. It is believed that the first eyes appeared in animals over 600 million years ago, and they were likely simple in design and function. Over time, the eyes of animals became more complex and specialized, and eventually led to the development of the eyes of humans and other animals today. The evolution of the eye has been influenced by a variety of factors, including changes in the environment, the development of predators and prey, and the need for improved vision in different environments.

Quantized (Q4_1), load in 7 s
tell me more about the evolution of the eye
Response: The evolution of the eye has been a fascinating subject of study in evolutionary biology and animal behavior. The evolution of the eye has been linked to the evolution of behavior and adaptation to the environment. The earliest eyes, which are thought to have evolved in organisms about 600 million years ago, were simple light-detecting organs that could detect the presence of light and darkness. These early eyes had no lens or cornea, but they did have a layer of light-sensitive cells that could detect light. Over time, the evolution of the eye continued to evolve in various directions, leading to the development of more complex eyes in various organisms. The eyes of many organisms today are highly complex, with a variety of structures and cells that work together to detect light and provide information about the environment to the organism. The evolution of the eye has been a fascinating subject of study in evolutionary biology and animal behavior, and it continues to be a subject of research and discussion today.

Quantized (Q4_0), load in 6 s
tell me more about the evolution of the eye
Response: The evolution of the eye is a complex and fascinating story that spans millions of years. The earliest evidence of eyes dates back to the Cambrian Period, over 550 million years ago. At this time, animals were primarily marine and their eyes were small and simple, likely used for detecting light and avoiding predators. Over time, animals developed more complex eyes that could detect color and depth perception. These eyes allowed animals to hunt more efficiently and avoid predators. However, the evolution of the eye was not a simple linear process. Many animals lost their eyes and developed other adaptations to take advantage of their surroundings. For example, insects and birds lost their eyes but developed other sensory organs to take over their sensory abilities. The evolution of the eye is an ongoing process that continues to this day.

Quantized (Q4_1_O), load in 6 s
tell me more about the evolution of the eye
Response: The evolution of the eye is a fascinating topic in biology. The earliest forms of eyes were likely simple light-sensitive spots that were used for light detection. These light-sensitive spots are thought to have evolved in the earliest forms of life, such as single-celled organisms. As more complex organisms evolved, the eye became more complex, with multiple layers of cells and specialized tissues.

RWKV-4-Raven-14B-v8-Eng-20230408-ctx4096

https://github.com/saharNooby/rwkv.cpp/issues/22

模拟一个人的思维需要多少个参数？

一个人，从出生到死亡，80年一刻不停的学习，1 s学1 token，是

$$ N_{token} = 80 \times 365 \times 24 \times 3600 = 2.5 \times 10^{9} $$

就是说，一个人的参数大概就是25亿，就是2.5 B。现在的模型都能达到65 B，远超人类的认知水平了。

[TIL]武大郎卖的是馒头

https://zhuanlan.zhihu.com/p/157303153

作者考据功力深厚。

33万PV达成

As of 2023-04-06.

WSLg Wayland bug

https://github.com/microsoft/wslg/issues/1032

长周期耐用消费品

[TIL]根据 台灣雀巢股份有限公司，一杯(1.8 g)醇品風味咖啡里面含有55.6 mg咖啡因

http://www.chiafeng.com.tw/upload/doc/doc_20171021022119_0.pdf


The unit is in Angstrom.

Quite simple tool powered by 3Dmol.js. Auto-detects bond formation using bond length database from pymatgen.

Feature requests are welcome by submitting an issue at https://github.com/liwt31/liwt31.github.io.

[TIL]如何改EndNote插入文献的字体？

EndNote如何设置插入文献的字体

过去10年浪费了我多少时间啊！

李建华(1956年8月10日–2023年4月28日)

R.I.P.