File size: 5,036 Bytes
9f3edac
 
bffbe64
 
9f3edac
 
bffbe64
5e8c231
bffbe64
 
 
 
 
 
 
 
db37306
bffbe64
 
 
 
80f6011
f436955
6d25feb
61061a5
 
628697e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6d25feb
 
 
83dbc50
6d25feb
61061a5
6d25feb
 
 
 
 
 
 
 
83dbc50
6d25feb
61061a5
6d25feb
2c3d005
6d25feb
83dbc50
 
6d25feb
 
 
 
 
 
2c3d005
61061a5
83dbc50
6d25feb
 
bffbe64
9f3edac
6d25feb
 
 
 
 
 
 
 
 
 
 
 
 
9f3edac
6d25feb
 
 
 
 
 
2457e12
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
---
license: apache-2.0
tags:
- MDEL
---

# Model Name
Multi-Domain-Expert-Layers/meow_1b

# Model Description
This model was generated by averaging the weights of the following models 
- [Multi-Domain-Expert-Layers/expert-pubmed_central](https://huggingface.co/Multi-Domain-Expert-Layers/expert-pubmed_central)
- [Multi-Domain-Expert-Layers/expert-freelaw](https://huggingface.co/Multi-Domain-Expert-Layers/expert-freelaw)
- [Multi-Domain-Expert-Layers/expert-github](https://huggingface.co/Multi-Domain-Expert-Layers/expert-github)
- [Multi-Domain-Expert-Layers/expert-uspto](https://huggingface.co/Multi-Domain-Expert-Layers/expert-uspto)
- [Multi-Domain-Expert-Layers/expert-arxiv](https://huggingface.co/Multi-Domain-Expert-Layers/expert-arxiv)
- [theblackcat102/pythia-1b-deduped-sft](https://huggingface.co/theblackcat102/pythia-1b-deduped-sft)
- We also keep a mixture that is primarily one of the above as an expert that can be loaded on demand.

### NOTE: There is a mistake below where we are using a routed expert for pubmed-abstract, but we merged pubmed central

- [Try demo on colab](https://colab.research.google.com/drive/1GgB8H30L5r0N--gexdEweK5f1yJfxMd_?usp=sharing)

## Using the automatic routing:

```
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
#####
Test dynamic routing to expert
##
Switching to expert Github
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
source code for sorting a list :
sort(list, reverse=True) #Warning: this function is not very efficient.

#Warning: This function is not very fast and may be slow in some cases.

#Returns the sorted list of numbers

#Example:

[1, 2, 3, 4, 5, 6, 7, 8, 9, 10]

#Example with reverse=False:

[2, 1, -1, -2, -3, -4, -5, -6, -7, -8, -9, -
##
Switching to expert USPTO-Backgrounds
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Give me a patent for shoes made of water :
Field of the Invention: A shoe that is waterproof and water resistant. 

Description: The shoe is waterproof and resistant to water, but it can be easily washed with soap or water. It also has a rubber-like coating on the bottom to make it waterproof. The rubber-like coating helps the shoe to stay dry when wet.

The rubber-like coating is used in the lining of a shoe to keep the shoe from getting damaged by water. The rubber-coated lining prevents the shoe from being scratched by any sharp objects.

The
##
Switching to expert FreeLaw
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Court case of Nguyen vs. State of California :  The California Supreme Court ruled that the "unreasonable search" clause in the federal constitution is not a violation of the Fourth Amendment, but rather a violation of the Fifth Amendment.

The court said that the "unconstitutional search" clause in Article I, Section 20, of the Constitution, which says that any person may be arrested without a warrant and without a warrant for any purpose, except when there is probable cause to believe that they have committed a crime, is a violation of the 5th Amendment, which says that no person shall be arrested without a *w
##
Switching to expert PubMed-Abstracts
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Medical journal article about ovarian cancer : 

_URL_0_

This is a very common thing in the medical field.  It's called "endometrial cancer" and it's not actually a cancer, but it's a benign tumor that can be removed by a simple surgical procedure.  The reason this is so common is because there are many different types of cancers that can cause this.  There are two main types of cancer that I think are most commonly known as "endometrioid" and "endometroid".  Endometrioid cancer is the one you're talking about here.  

```


## Using the original chat model:

```
Compared to original chat model
##
Switching to expert OrigChat
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
source code for sorting a list :
sort(list, key=lambda x: x[1], reverse=True) #Warning: this code generation is experimental. Please inspect the code for any bugs before executing.
##
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Give me a patent for shoes made of water :
Field of the Invention: The invention relates to a shoe with a sole and an upper, wherein the sole is formed by a first layer of material and the upper is formed by a second layer of material.
##
Setting `pad_token_id` to `eos_token_id`:0 for open-end generation.
Court case of Nguyen vs. State of California :

The court ruled that the state's ban on same-sex marriage was unconstitutional, and that it had to be overturned by a higher court. The ruling came in a lawsuit brought by two gay men who were denied the right to marry because of their sexual orientation.
##
Medical journal article about ovarian cancer :

_URL_0_
```
## WARNING: This model is not an optimal chatbot and was designed to show expertise swapping. The model may create undesirable content, use at your own risk.