Add BERTopic model

README.md

@@ -0,0 +1,105 @@
+
+---
+tags:
+- bertopic
+library_name: bertopic
+pipeline_tag: text-classification
+---
+
+# short-arxiv-bertopic
+
+This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. 
+BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. 
+
+## Usage 
+
+To use this model, please install BERTopic:
+
+```
+pip install -U bertopic
+```
+
+You can use the model as follows:
+
+```python
+from bertopic import BERTopic
+topic_model = BERTopic.load("etanios/short-arxiv-bertopic")
+
+topic_model.get_topic_info()
+```
+
+## Topic overview
+
+* Number of topics: 38
+* Number of training documents: 9999
+
+<details>
+  <summary>Click here for an overview of all topics.</summary>
+  
+  | Topic ID | Topic Keywords | Topic Frequency | Label | 
+|----------|----------------|-----------------|-------| 
+| -1 | data - learning - model - based - algorithm | 50 | Machine Learning and Data Analysis | 
+| 0 | deep - networks - neural - training - network | 2896 | Advances in Deep Neural Networks for Computer Vision | 
+| 1 | neural - word - model - language - models | 1036 | Neural Language Models | 
+| 2 | regret - bandit - online - algorithm - problem | 755 | Optimization of regret in multi-armed bandit problems | 
+| 3 | policy - reinforcement - reinforcement learning - learning - control | 552 | Reinforcement Learning Policies | 
+| 4 | clustering - clusters - data - means - cluster | 504 | Clustering algorithms and techniques | 
+| 5 | classification - classifiers - class - classifier - ensemble | 463 | Machine Learning Ensembles | 
+| 6 | gradient - stochastic - convex - convergence - optimization | 293 | Optimization techniques for non-convex problems | 
+| 7 | learning - epsilon - distribution - complexity - bounds | 271 | Machine Learning and Complexity | 
+| 8 | matrix - rank - low rank - low - completion | 257 | Matrix Completion and Robust Matrix Completion | 
+| 9 | sparse - dictionary - signal - signals - sensing | 218 | Sparse Coding and Dictionary Learning | 
+| 10 | kernel - kernels - learning - kernel learning - mkl | 185 | Kernel Learning and Multiple Kernels | 
+| 11 | topic - topics - lda - model - topic models | 173 | Topic Modeling and LDA | 
+| 12 | bayesian - structure - bayesian networks - bayesian network - network | 163 | Structure learning of Bayesian networks | 
+| 13 | users - user - recommendation - items - collaborative | 162 | Recommendation Systems: Collaborative Filtering | 
+| 14 | inference - posterior - variational - mcmc - carlo | 157 | Bayesian Inference Techniques | 
+| 15 | feature - selection - feature selection - data - classification | 145 | Data Preparation for Cancer Classification | 
+| 16 | active - active learning - learning - optimization - bayesian optimization | 144 | Active Learning and Optimization | 
+| 17 | lasso - sparse - group - sparsity - regression | 137 | High-dimensional regression with sparsity | 
+| 18 | distributed - ml - communication - machine - data | 126 | Distributed Machine Learning | 
+| 19 | privacy - private - differential privacy - differential - differentially | 117 | Privacy and Data Mining | 
+| 20 | anomaly - detection - anomaly detection - data - anomalies | 99 | Anomaly Detection in Data Sets | 
+| 21 | ranking - rank - items - pairwise - comparisons | 92 | Ranking and Preference Learning | 
+| 22 | metric - metric learning - distance - learning - similarity | 87 | Metric Learning | 
+| 23 | svm - support - support vector - svms - vector | 79 | Efficient and Fast SVM Algorithms | 
+| 24 | hashing - hash - binary - codes - bit | 76 | Large-scale search and indexing using hashing methods | 
+| 25 | graph - graphs - nodes - relational - kernels | 75 | Graph-based Semi-supervised Learning | 
+| 26 | manifold - dimensional - data - manifold learning - embedding | 74 | Manifold Learning and Dimensionality Reduction | 
+| 27 | tensor - decomposition - tensors - rank - tensor decomposition | 74 | Tensor Decomposition and Rank | 
+| 28 | bethe - belief propagation - belief - propagation - bp | 73 | Inference in Graphical Models | 
+| 29 | image - semantic - images - visual - shot | 65 | Zero-shot learning for image recognition | 
+| 30 | gp - gaussian - gaussian process - process - covariance | 65 | Gaussian Processes for Large Data | 
+| 31 | domain - adaptation - domain adaptation - target - source | 64 | Domain Adaptation | 
+| 32 | crowdsourcing - workers - labels - crowd - worker | 56 | Crowdsourced Labeling and Task Assignment | 
+| 33 | causal - variables - data - discovery - cause | 55 | Causal Discovery and Inference | 
+| 34 | label - multi label - multi - labels - multi label classification | 55 | Multi-Label Classification | 
+| 35 | protein - proteins - prediction - structure - amino | 54 | Protein structure prediction and sequence analysis | 
+| 36 | nmf - nonnegative - matrix - nonnegative matrix - factorization | 52 | Nonnegative Matrix Factorization (NMF) |
+  
+</details>
+
+## Training hyperparameters
+
+* calculate_probabilities: False
+* language: None
+* low_memory: False
+* min_topic_size: 10
+* n_gram_range: (1, 1)
+* nr_topics: None
+* seed_topic_list: None
+* top_n_words: 10
+* verbose: True
+
+## Framework versions
+
+* Numpy: 1.23.5
+* HDBSCAN: 0.8.33
+* UMAP: 0.5.4
+* Pandas: 1.5.3
+* Scikit-Learn: 1.2.2
+* Sentence-transformers: 2.2.2
+* Transformers: 4.33.2
+* Numba: 0.56.4
+* Plotly: 5.15.0
+* Python: 3.10.12

config.json

@@ -0,0 +1,14 @@
+{
+  "calculate_probabilities": false,
+  "language": null,
+  "low_memory": false,
+  "min_topic_size": 10,
+  "n_gram_range": [
+    1,
+    1
+  ],
+  "nr_topics": null,
+  "seed_topic_list": null,
+  "top_n_words": 10,
+  "verbose": true
+}

topic_embeddings.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06c49bccfaf2a27c79887001cab7a5c2d4ed5e99c6bb2b6d224bd25dcb7092e2
+size 58456