Alexandre Marques's picture

22 6

Alexandre Marques

alexmarques

·

anmarques

AI & ML interests

None yet

Recent Activity

new activity 6 minutes ago

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8:Having trouble running this model with vLLM not sure why

new activity 25 minutes ago

mistralai/Mistral-Small-3.1-24B-Instruct-2503:Add chat_template to tokenizer_config

updated a model 7 days ago

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

View all activity

Organizations

alexmarques's activity

New activity in RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8 6 minutes ago

Having trouble running this model with vLLM not sure why

#1 opened 4 days ago by

New activity in mistralai/Mistral-Small-3.1-24B-Instruct-2503 25 minutes ago

Add chat_template to tokenizer_config

#58 opened 16 days ago by

New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 5 months ago

KV Cache Quantization - what is the default precision

#2 opened 5 months ago by

New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 7 months ago

Usage of --apply_chat_template in lm_eval benchmarks

#1 opened 9 months ago by

New activity in RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 8 months ago

how many resources were used for quantizing this model?

#4 opened 8 months ago by

New activity in RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16 8 months ago

4k or 128k?

#1 opened 8 months ago by

New activity in RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8 8 months ago

Update README.md

#1 opened 8 months ago by

New activity in RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 9 months ago

Llama-3.1 8B quantization?

#1 opened 9 months ago by

Language Support

#2 opened 9 months ago by

possible problem in description

#3 opened 9 months ago by

New activity in RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16 9 months ago

Weird variable name mistakes in code generation

#1 opened 9 months ago by