Qwen
/

Qwen-7B-Chat

Text Generation

Model card Files Files and versions Community

Add support for flash-attention2

#3

by shigureui - opened Aug 3, 2023

base: refs/heads/main

←

from: refs/pr/3

Discussion Files changed

initial commitbfbac778

Create README.md55ab57fb

upload pytorch_model.bin498baa46

add resource files4658aaa8

update readme9f476698

disable hosted inference API946cbc62

update react example8504b36b

update tokenization_qwen.py9882935f

update demo link09644a4f

fix report link5e7f6a3f

update tokenization_qwen.py3f9f12c5

Update README.md1a2571e8

fix flash-attention usage405556da

implement _convert_id_to_token10173d49

Upload wanx_colorful_black.pnge03d77d8

update fast usagef59a0a94

update humaneval scored0db884e

Aug 3, 2023

flash-attention2 rename the flash_attn_unpadded_func

Add support for flash-attention22129890d

Aug 3, 2023

Add support for flash-attention 2.0

Weiguo

Aug 5, 2023

install fail,
NVIDIA-SMI 535.54.03 Driver Version: 535.54.03 CUDA Version: 12.2

shigureui changed pull request status to closed Aug 5, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment