It would be cool to provide instructions for running this in docker. I tried it yesterday and got it running although it gave an error when trying to use it. I did not look into what was causing it yet though.

Hi

this works great thank you!

WOW

im getting Invalid credentials in Authorization header

not really that familiar with running stuff locally

getting error as "Invalid credentials in Authorization header"

getting error as "Invalid credentials in Authorization header"

Are you sure you did those steps correctly?

1. Create a token with inference permissions: https://huggingface.co/settings/tokens/new?ownUserPermissions=repo.content.read&ownUserPermissions=repo.write&ownUserPermissions=inference.serverless.write&tokenType=fineGrained then copy it to your clipboard
2. Create a new file named .env in the Deepsite folder you cloned and paste your token in it so it should look like this:

HF_TOKEN=THE_TOKEN_YOU_JUST_CREATED

3. Launch the app again

verified steps, it launches but upon prompt I get the same response Invalid credentials in Authorization header

Hi guys, I gonna take a look at this, will keep you updated

@Vrajce @pedrod8 could you try again please ? Should be fixed now. (Please git pull first)

Using with locally running models would be cool too.

I thought it was free, but I get that message

When I click on the button, it tells me Invalid client_id

I've confirmed my token can login via huggingface cli and has inference access - I'm still getting the following error when i go to process any text

@pedrod8 Did you correctly git pull the changes ?

@diguishm could you git pull too and try again please ?

I did everything according to the steps above, it worked the first time. Thank you.

P.S..
Updated the node

it has started working for me now - many thanks!

Using with locally running models would be cool too.

I know right

I used the Dockerfile, set the HF_TOKEN and on first try get the error message: We have not been able to find inference provider information for model deepseek-ai/DeepSeek-V3-0324. Error happens in try catch when calling client.chatCompletionStream.

can i point this to my own deepseek API key and run offline using my own API key nothing to do with huggingface?

can i point this to my own deepseek API key and run offline using my own API key nothing to do with huggingface?

I did so after the previous error with the inference provider but always run into the max token output limit and receive a website that suddenly stops. Wondering how the inference provider approach works differently towards this.. i can not explain myself as deepseek is just limited to max 8k output.

can i point this to my own deepseek API key and run offline using my own API key nothing to do with huggingface?

I did so after the previous error with the inference provider but always run into the max token output limit and receive a website that suddenly stops. Wondering how the inference provider approach works differently towards this.. i can not explain myself as deepseek is just limited to max 8k output.

There is models now well over 1Mill so could easily swap. did you run the docker and set API and .env file?

Deepsite uses deepseek (here online) so this was the base of my test... Here online i receive a full website but locally with my direct deepseek api not. Yeah there are some models with much more output. also deepseek coder v2 with 128k .. but still wondering the differences between deepseek platform api and inference provider - makes no sense.

Can I run it locally without a PRO plan? If so, how do I set it up?

Yes you can use it without being PRO, but you're always concerned about limits (https://huggingface.co/settings/billing)

Thanks.

Can run locally - offline - with OLLAMA server

Hello, I subscribed to the pro option twice and they charged me $10 twice but I still haven't upgraded.

How to add google provider to this project? I want to use gemini 2.5 pro

Hello, after local deployment, here's the message I receive when I execute the request: "Failed to execute 'json' on 'Response': Unexpected end of JSON input."
How can I resolve this issue, please?

Hello, I subscribed to the pro option twice and they charged me $10 twice but I still haven't upgraded.

Very weird we are going to take a look at it (did you subscribe from hf.co/subscribe/pro?)

Hello, I subscribed to the pro option twice and they charged me $10 twice but I still haven't upgraded.

Very weird we are going to take a look at it (did you subscribe from hf.co/subscribe/pro?)

Yes of course via this link: https://huggingface.co/pricing, I was charged $20 for both tests

Can run locally - offline - with OLLAMA server

Which LLM model you use?

i use distilled DeepSeek, and Qwen 2.5 and Gemma 3

However I am sure to make this work i have to do something with code, but have no idea what.

Failed to fetch

i use distilled DeepSeek, and Qwen 2.5 and Gemma 3

However I am sure to make this work i have to do something with code, but have no idea what.

SO can we use it with this local setup or not?

Yeaa I was wondering the same thing, can we actually use a local LLM to run this or not!!!

hi i want to run it locally its my first time trying to run LLM locally can you provide me with step by step how to do it, what i need to install first what tools or software that i need thank you