mradermacher/DeepSeek-V3-i1-GGUF
Updated
•
5
oobabooga
oobabooga
AI & ML interests
None yet
Recent Activity
new activity
2 days ago
mradermacher/DeepSeek-V3-GGUF:imatrix quants
liked
a model
3 days ago
mradermacher/DeepSeek-V3-i1-GGUF
Organizations
None yet
oobabooga's activity
imatrix quants
19
#2 opened 4 days ago
by
oobabooga
liked
a
model
3 days ago
Incompatible with tensorrt_llm==0.10.0
2
#1 opened 7 months ago
by
oobabooga
liked
a
dataset
9 months ago
reacted to
abidlabs's
post with ❤️
12 months ago
Post
The next version of Gradio will be significantly more efficient (as well as a bit faster) for anyone who uses Gradio's streaming features. Looking at you chatbot developers
@oobabooga
@pseudotensor
:)
The major change that we're making is that when you stream data, Gradio used to send the entire payload at each token. This is generally the most robust way to ensure all the data is correctly transmitted. We've now switched to sending "diffs" --> so at each time step, we automatically compute the diff between the most recent updates and then only send the latest token (or whatever the diff may be). Coupled with the fact that we are now using SSE, which is a more robust communication protocol than WS (SSE will resend packets if there's any drops), we should have the best of both worlds: efficient *and* robust streaming.
Very cool stuff @aliabid94 ! PR: https://github.com/gradio-app/gradio/pull/7102
The major change that we're making is that when you stream data, Gradio used to send the entire payload at each token. This is generally the most robust way to ensure all the data is correctly transmitted. We've now switched to sending "diffs" --> so at each time step, we automatically compute the diff between the most recent updates and then only send the latest token (or whatever the diff may be). Coupled with the fact that we are now using SSE, which is a more robust communication protocol than WS (SSE will resend packets if there's any drops), we should have the best of both worlds: efficient *and* robust streaming.
Very cool stuff @aliabid94 ! PR: https://github.com/gradio-app/gradio/pull/7102
updated
a
model
about 1 year ago
Human eval results?
4
#2 opened about 1 year ago
by
rombodawg
liked
a
model
about 1 year ago
Merge 100% of the models instead of only parts
3
#1 opened about 1 year ago
by
rombodawg
updated
a
dataset
over 1 year ago
updated
a
model
over 1 year ago
How can I run this?
12
#2 opened almost 2 years ago
by
Matan1905
Latest commits yield poor results with device_map='auto'
5
#8 opened almost 2 years ago
by
oobabooga
Latest commits yield poor results with device_map='auto'
5
#8 opened almost 2 years ago
by
oobabooga
Latest commits yield poor results with device_map='auto'
5
#8 opened almost 2 years ago
by
oobabooga