Adapter bert-base-uncased_sts_stackexchange_pfeiffer for bert-base-uncased
Our adapters from the MultiCQA paper (https://arxiv.org/abs/2010.00980) trained on the different StackExchange forums (see "version") with self-supervised training signals of unlabeled questions.
This adapter was created for usage with the Adapters library.
Usage
First, install adapters:
pip install -U adapters
Now, the adapter can be loaded and activated like this:
from adapters import AutoAdapterModel
model = AutoAdapterModel.from_pretrained("bert-base-uncased")
adapter_name = model.load_adapter("AdapterHub/bert-base-uncased_sts_stackexchange_pfeiffer")
model.set_active_adapters(adapter_name)
Architecture & Training
- Adapter architecture: pfeiffer
- Prediction head: None
- Dataset: StackExchange QA Similarity
Author Information
- Author name(s): Andreas Rücklé
- Author email: [email protected]
- Author links: Website, GitHub, Twitter
Versions
serverfault_commechanics_stackexchange_comux_stackexchange_comhistory_stackexchange_comjudaism_stackexchange_comworkplace_stackexchange_comfreelancing_stackexchange_commatheducators_stackexchange_comliterature_stackexchange_comsoftwareengineering_stackexchange_compatents_stackexchange_compets_stackexchange_comsoftwarerecs_stackexchange_comwriters_stackexchange_comgaming_stackexchange_commovies_stackexchange_comscifi_stackexchange_comparenting_stackexchange_comastronomy_stackexchange_combitcoin_stackexchange_comrpg_stackexchange_comfitness_stackexchange_comcooking_stackexchange_com(main)devops_stackexchange_comavp_stackexchange_comeconomics_stackexchange_comhealth_stackexchange_comsitecore_stackexchange_comcodegolf_stackexchange_comaskubuntu_comsqa_stackexchange_comai_stackexchange_comell_stackexchange_comtor_stackexchange_comearthscience_stackexchange_comworldbuilding_stackexchange_comcstheory_stackexchange_comgis_stackexchange_comrobotics_stackexchange_comsustainability_stackexchange_commathematica_stackexchange_comhardwarerecs_stackexchange_comopensource_stackexchange_comhomebrew_stackexchange_comdiy_stackexchange_comlifehacks_stackexchange_comstats_stackexchange_comhsm_stackexchange_comchristianity_stackexchange_comboardgames_stackexchange_comunix_stackexchange_comspace_stackexchange_comandroid_stackexchange_comquantumcomputing_stackexchange_comwindowsphone_stackexchange_commusic_stackexchange_comcs_stackexchange_comnetworkengineering_stackexchange_comcodereview_stackexchange_comcrypto_stackexchange_comscicomp_stackexchange_commath_stackexchange_comanime_stackexchange_comsuperuser_combiology_stackexchange_comphoto_stackexchange_commusicfans_stackexchange_comgenealogy_stackexchange_comskeptics_stackexchange_comgamedev_stackexchange_compolitics_stackexchange_comexpatriates_stackexchange_comlaw_stackexchange_comchemistry_stackexchange_comblender_stackexchange_comapple_stackexchange_comdba_stackexchange_comquant_stackexchange_comelementaryos_stackexchange_comtravel_stackexchange_comjoomla_stackexchange_comphysics_stackexchange_cominterpersonal_stackexchange_compm_stackexchange_comcogsci_stackexchange_combricks_stackexchange_comham_stackexchange_comopendata_stackexchange_comcomputergraphics_stackexchange_comdsp_stackexchange_combicycles_stackexchange_comdrupal_stackexchange_comphilosophy_stackexchange_comarduino_stackexchange_comethereum_stackexchange_comemacs_stackexchange_comwoodworking_stackexchange_comvi_stackexchange_comsports_stackexchange_comgardening_stackexchange_comsecurity_stackexchange_comwebapps_stackexchange_comenglish_stackexchange_comdatascience_stackexchange_comsharepoint_stackexchange_comexpressionengine_stackexchange_comwordpress_stackexchange_comstackoverflow_comsound_stackexchange_comwebmasters_stackexchange_commagento_stackexchange_combioinformatics_stackexchange_comislam_stackexchange_comraspberrypi_stackexchange_comtex_stackexchange_comchess_stackexchange_comoutdoors_stackexchange_comretrocomputing_stackexchange_comaviation_stackexchange_comtridion_stackexchange_commythology_stackexchange_comeosio_stackexchange_comelectronics_stackexchange_commoney_stackexchange_comlinguistics_stackexchange_comstackapps_com3dprinting_stackexchange_comengineering_stackexchange_compuzzling_stackexchange_comacademia_stackexchange_comcivicrm_stackexchange_commartialarts_stackexchange_comreverseengineering_stackexchange_comhinduism_stackexchange_commonero_stackexchange_comhermeneutics_stackexchange_combuddhism_stackexchange_comcraftcms_stackexchange_comsalesforce_stackexchange_compoker_stackexchange_comgraphicdesign_stackexchange_com
Citation
@inproceedings{rueckle-etal-2020-multicqa,
title = "{MultiCQA}: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale",
author = {R{\"u}ckl{\'e}, Andreas and
Pfeiffer, Jonas and
Gurevych, Iryna},
booktitle = "Proceedings of The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP-2020)",
year = "2020",
address = "Virtual Conference",
url = "https://arxiv.org/abs/2010.00980",
}
This adapter has been auto-imported from https://github.com/Adapter-Hub/Hub/blob/master/adapters/ukp/bert-base-uncased_sts_stackexchange_pfeiffer.yaml.
- Downloads last month
- 3
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.