winglian commited on
Commit
280832c
Β·
1 Parent(s): a43bae9

more matrix updates

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -17,13 +17,13 @@
17
  ## Axolotl supports
18
 
19
  | | fp16/fp32 | fp16/fp32 w/ lora | qlora | 4bit-quant | 4bit-quant w/flash attention | flash attention | xformers attention |
20
- |----------|:----------|:------------------|------|------------|------------------------------|----------------|-----------------|
21
- | llama | βœ… | βœ… | βœ… | βœ… | βœ… | βœ… | βœ… |
22
- | Pythia | βœ… | βœ… | ❓ | ❌ | ❌ | ❌ | ❓ |
23
- | cerebras | βœ… | βœ… | ❓ | ❌ | ❌ | ❌ | βœ… |
24
- | mpt | βœ… | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ |
25
- | falcon | βœ… | βœ… | βœ… | ❌ | ❌ | ❌ | βœ… |
26
- | gpt-j | βœ… | βœ… | βœ… | ❌ | ❌ | ❓ | βœ… |
27
 
28
 
29
  ## Quickstart ⚑
 
17
  ## Axolotl supports
18
 
19
  | | fp16/fp32 | fp16/fp32 w/ lora | qlora | 4bit-quant | 4bit-quant w/flash attention | flash attention | xformers attention |
20
+ |----------|:----------|:------------------|-------|------------|------------------------------|-----------------|--------------------|
21
+ | llama | βœ… | βœ… | βœ… | βœ… | βœ… | βœ… | βœ… |
22
+ | Pythia | βœ… | βœ… | βœ… | ❌ | ❌ | ❌ | ❓ |
23
+ | cerebras | βœ… | βœ… | βœ… | ❌ | ❌ | ❌ | βœ… |
24
+ | mpt | βœ… | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ |
25
+ | falcon | βœ… | βœ… | βœ… | ❌ | ❌ | ❌ | βœ… |
26
+ | gpt-j | βœ… | βœ… | βœ… | ❌ | ❌ | ❓ | βœ… |
27
 
28
 
29
  ## Quickstart ⚑