stanrom
/

internlm-xcomposer2-7b-4bit

stanrom commited on May 23

Commit

d90a419

•

1 Parent(s): c82e4e7

Update configuration_internlm_xcomposer2.py

Files changed (1) hide show

configuration_internlm_xcomposer2.py CHANGED Viewed

@@ -108,8 +108,8 @@ class InternLMXcomposer2Config(PretrainedConfig):
  rope_theta=10000,
  rope_scaling=None,
  attn_implementation='eager',
- device='cpu',
- dtype='bfloat16',
  **kwargs,
  ):
  self.vocab_size = vocab_size

  rope_theta=10000,
  rope_scaling=None,
  attn_implementation='eager',
+ # device='cpu',
+ # dtype='bfloat16',
  **kwargs,
  ):
  self.vocab_size = vocab_size