sgoel30 commited on
Commit
54651a9
1 Parent(s): 70a84f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -17
README.md CHANGED
@@ -27,23 +27,6 @@ pipeline_tag: fill-mask
27
 
28
  [Masked Diffusion Language Models (MDLMs)](arxiv.org/pdf/2406.07524), introduced by Sahoo et al, provide strong generative capabilities to BERT-style models. In this work, we pre-train and fine-tune ESM-2-150M protein language model (pLM) on the MDLM objective to scaffold functional motifs and unconditionally generate realistic, high-quality membrane protein sequences.
29
 
30
- ## Model Usage
31
-
32
- MeMDLM leverages an internal backbone for generation, which is a fine-tuned version of the ESM-2-150M pLM. This backbone model can be accessed through this repo:
33
-
34
- ```python
35
- from transformers import AutoTokenizer, AutoModelForMaskedLM
36
-
37
- tokenizer = AutoTokenizer.from_pretrained("ChatterjeeLab/MeMDLM")
38
- model = AutoModelForMaskedLM.from_pretrained("ChatterjeeLab/MeMDLM")
39
-
40
- input_sequence = "QMMALTFITYIGCGLSSIFLSVTLVILIQLCAALLLLNLIFLLDSWIALYnTRGFCIAVAVFLHYFLLVSFTWMGLEAFHMYLKFCIVGWGIPAVVVSIVLTISPDNYGidFCWINSNVVFYITVVGYFCVIFLLNVSMFIVVLVQLCRIKKKKQLGDL"
41
-
42
- inputs = tokenizer(input_sequence, return_tensors="pt")
43
- output = model(**inputs)
44
-
45
- filled_protein_seq = tokenizer.decode(output.squeeze()) # contains the output protein sequence with filled mask tokens
46
- ```
47
 
48
  ## Repository Authors
49
  [Shrey Goel](mailto:[email protected]), Undergraduate Student at Duke University <br>
 
27
 
28
  [Masked Diffusion Language Models (MDLMs)](arxiv.org/pdf/2406.07524), introduced by Sahoo et al, provide strong generative capabilities to BERT-style models. In this work, we pre-train and fine-tune ESM-2-150M protein language model (pLM) on the MDLM objective to scaffold functional motifs and unconditionally generate realistic, high-quality membrane protein sequences.
29
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
 
31
  ## Repository Authors
32
  [Shrey Goel](mailto:[email protected]), Undergraduate Student at Duke University <br>