yangheng commited on
Commit
74a5555
1 Parent(s): 41ef429

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +73 -0
README.md CHANGED
@@ -1,3 +1,76 @@
1
  ---
 
 
 
 
 
2
  license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ tags:
5
+ - aspect-based-sentiment-analysis
6
+ - PyABSA
7
  license: mit
8
+ datasets:
9
+ - laptop14
10
+ - restaurant14
11
+ - restaurant16
12
+ - ACL-Twitter
13
+ - MAMS
14
+ - Television
15
+ - TShirt
16
+ - Yelp
17
+ metrics:
18
+ - accuracy
19
+ - macro-f1
20
+
21
  ---
22
+ # Note
23
+ This model is training with 30k+ ABSA samples, see [ABSADatasets](https://github.com/yangheng95/ABSADatasets). Yet the test sets are not included in pre-training, so you can use this model for training and benchmarking on common ABSA datasets, e.g., Laptop14, Rest14 datasets. (Except for the Rest15 dataset!)
24
+
25
+ # DeBERTa for aspect-based sentiment analysis
26
+ The `deberta-v3-base-absa` model for aspect-based sentiment analysis, trained with English datasets from [ABSADatasets](https://github.com/yangheng95/ABSADatasets).
27
+
28
+ ## Training Model
29
+ This model is trained based on the FAST-LCF-BERT model with `microsoft/deberta-v3-base`, which comes from [PyABSA](https://github.com/yangheng95/PyABSA).
30
+ To track state-of-the-art models, please see [PyASBA](https://github.com/yangheng95/PyABSA).
31
+
32
+ ## Usage
33
+ ```python3
34
+ from transformers import AutoTokenizer, AutoModelForSequenceClassification
35
+
36
+ tokenizer = AutoTokenizer.from_pretrained("yangheng/deberta-v3-base-absa-v1.1")
37
+
38
+ model = AutoModelForSequenceClassification.from_pretrained("yangheng/deberta-v3-base-absa-v1.1")
39
+ ```
40
+
41
+ ## Example in PyASBA
42
+ An [example](https://github.com/yangheng95/PyABSA/blob/release/demos/aspect_polarity_classification/train_apc_multilingual.py) for using FAST-LCF-BERT in PyASBA datasets.
43
+
44
+ ## Datasets
45
+ This model is fine-tuned with 180k examples for the ABSA dataset (including augmented data). Training dataset files:
46
+ ```
47
+ loading: integrated_datasets/apc_datasets/SemEval/laptop14/Laptops_Train.xml.seg
48
+ loading: integrated_datasets/apc_datasets/SemEval/restaurant14/Restaurants_Train.xml.seg
49
+ loading: integrated_datasets/apc_datasets/SemEval/restaurant16/restaurant_train.raw
50
+ loading: integrated_datasets/apc_datasets/ACL_Twitter/acl-14-short-data/train.raw
51
+ loading: integrated_datasets/apc_datasets/MAMS/train.xml.dat
52
+ loading: integrated_datasets/apc_datasets/Television/Television_Train.xml.seg
53
+ loading: integrated_datasets/apc_datasets/TShirt/Menstshirt_Train.xml.seg
54
+ loading: integrated_datasets/apc_datasets/Yelp/yelp.train.txt
55
+
56
+ ```
57
+ If you use this model in your research, please cite our paper:
58
+ ```
59
+ @article{YangZMT21,
60
+ author = {Heng Yang and
61
+ Biqing Zeng and
62
+ Mayi Xu and
63
+ Tianxing Wang},
64
+ title = {Back to Reality: Leveraging Pattern-driven Modeling to Enable Affordable
65
+ Sentiment Dependency Learning},
66
+ journal = {CoRR},
67
+ volume = {abs/2110.08604},
68
+ year = {2021},
69
+ url = {https://arxiv.org/abs/2110.08604},
70
+ eprinttype = {arXiv},
71
+ eprint = {2110.08604},
72
+ timestamp = {Fri, 22 Oct 2021 13:33:09 +0200},
73
+ biburl = {https://dblp.org/rec/journals/corr/abs-2110-08604.bib},
74
+ bibsource = {dblp computer science bibliography, https://dblp.org}
75
+ }
76
+ ```