internlm/internlm2-math-7b · Apply for community grant: Academic project (gpu)

InternLM org Jan 24

We want to show our math open-sourced LLM InternLM-Math using HF's GPU resources. Here is our github repo: https://github.com/InternLM/InternLM-Math/.

hysts

Jan 24

Hi @InternLM-Math , we have assigned a gpu to this space. Note that GPU Grants are provided temporarily and might be removed after some time if the usage is very low.

To learn more about GPUs in Spaces, please check out https://huggingface.co/docs/hub/spaces-gpus

InternLM-Math

InternLM org Jan 24

Thank you!

unsubscribe

InternLM org Jan 24

@hysts Hi, Please provide A10 GPU Resources

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 724.00 MiB. GPU 0 has a total capacty of 14.58 GiB of which 61.56 MiB is free. Process 456459 has 14.52 GiB memory in use. Of the allocated memory 0 bytes is allocated by PyTorch, and 0 bytes is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

hysts

Jan 24

@unsubscribe OK, I just changed the hardware to a10g-small.