Upload folder using huggingface_hub

.ipynb_checkpoints/README-checkpoint.md

@@ -0,0 +1,330 @@
+---
+base_model: Alibaba-NLP/gte-Qwen2-1.5B-instruct
+datasets: []
+language: []
+library_name: sentence-transformers
+pipeline_tag: sentence-similarity
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- generated_from_trainer
+- dataset_size:921564
+- loss:CachedMultipleNegativesRankingLoss
+widget:
+- source_sentence: "[array([{'from': 'human', 'value': '低IPの人に対する侮辱とは？'},\n      \
+    \  {'from': 'gpt', 'value': '例えば、ジョークの最初に \"I was going to do X, but I just remembered\
+    \ because I\\'m changed mind because it would be too easy for you get idea of\
+    \ the punchline \"と言うことです。'},\n        {'from': 'human', 'value': 'なるほど。IQの低い人を侮辱するという意味だったんだ。'}],\n\
+    \       dtype=object)                                                        \
+    \                                                                            \
+    \                                        ]"
+  sentences:
+  - '[''一般的な侮辱は「お前はバカだ」で、これは太古の昔から使われている。'']'
+  - '['' 먼저 마이크가 매년 저축하는 금액을 계산해 봅시다. 마이크는 연봉 15만 달러의 10%를 저축합니다:\n\n150,000달러의 10%
+    = 0.10 * $150,000 = $15,000\n\n이제 6년 동안 그가 저축할 총 금액을 계산해 봅시다:\n\n1년 $15,000 *
+    6년 = $90,000\n\n마이크는 집의 20%를 계약금으로 지불해야 합니다. 그가 사고 싶은 집의 가격을 P로 표시해 봅시다. 마이크가
+    저축한 90,000달러는 P의 20%를 나타냅니다. 다음 방정식을 설정할 수 있습니다:\n\n0.20 * P = $90,000\n\n이제 P를
+    풀 수 있습니다:\n\nP = $90,000 / 0.20\nP = $450,000\n\n따라서 마이크가 사고 싶은 집의 가격은 $450,000입니다.'']'
+  - '[''例えば、https://www.urbandictionary.com/define.php?term=insult+for+someone+with+a+など。'']'
+- source_sentence: 'Miguel Cervantes'' Wife Reveals Daughter, 3, ''Died in My Arms''
+    After Entering Hospice Care Exclusive: Jayme Closs feeling ''stronger every day''
+    1 year after kidnapping 69 Vegetarian Meals to Make Meatless Monday Super Easy
+    and Tasty Duchess Meghan Describes ''Really Challenging'' Life as New Royal: I''m
+    Not OK ''Barney'' the Purple Dinosaur Movie in the Works From Mattel and Daniel
+    Kaluuya 30 Freezer-Friendly Make-Ahead Meals Exclusive: Hunter Biden on getting
+    married after 6 days and why rehab is ''courageous'' 42 Strange Symptoms That
+    Can Signal a Serious Disease The ''ghost baby'' in her son''s crib? Turns out
+    there was a very reasonable explanation for it. What it''s really like to retire
+    in an RV ''Go back to work'': Outcry over deaths on Amazon''s warehouse floor
+    Why 1 million children were kicked off Medicaid Here''s Why Harry and Meghan''s
+    Latest Interview Could Be the Final Straw for the Royal Family Body of missing
+    Alabama girl found; 2 being charged This Is What Happens When You Take Ibuprofen
+    Too Often, According to a Doctor Kylie Jenner and her bestie get surgery together,
+    plus more news How to Adopt a Retired Police Dog Arthritis: Watch out for these
+    symptoms How President Trump reacted to getting loudly booed at the World Series
+    Foie Gras Is Banned by New York City These One-Pot Pasta Recipes Are the Answer
+    to Quick and Easy Dinner Breast cancer survivors fight another deadly risk A heartbreaking
+    photo of a dog riding a bus alone went viral, and now people want to adopt her
+    52 Easy Thanksgiving Recipes, Because You Deserve to Be Stress-Free This Foster
+    Kitten Smiling for a Photo Will Make Your Friday The Best Casserole Recipe from
+    Every State As Warren Gains in Race, Wall Street Sounds the Alarm What Your Fatigue
+    Could Mean Cause determined in Jessi Combs'' fatal speed record crash This Simple
+    Hack Will Keep Spiders Out of Your House Hormone Therapy for Breast Cancer 35
+    Slow Cooker Lunch Recipes We Love'
+  sentences:
+  - '''Don''t stay silent'': Democrats lash out as GOP blocks gun measure amid school
+    shooting Here''s What ''Cultural Appropriation'' Actually Means   and Why It''s
+    Wrong 2021 Ford Mustang Mach-E: This Electric SUV is a Mustang Family Member 9
+    Amazing Transgender Women Who Changed History Can you answer these real Jeopardy
+    questions about TV shows? The Bakery Behind Doubletree''s Famous Chocolate Chip
+    Cookie Bakes More Than 100 Million Cookies A Year This is Chick-fil-A''s most-ordered
+    menu item Judge calls USC dad a ''thief,'' gives longest prison sentence so far
+    in college admissions scandal The 20-Minute Fresh Tomato Sauce You''ll Actually
+    Want to Make This Winter ''Velvety'' Appearance of Woman''s Palms Was a Sign of
+    Lung Cancer WWE Wrestler Jordan Myles Quits in Expletive-Filled Rant as He Brands
+    the Company Racist The most exclusive hotel in every state The 1 reason you shouldn''t
+    hesitate to claim Social Security early The stock market''s 10-year run became
+    the best bull market ever this month The Top Thanksgiving Recipe from Every State
+    Top Putin aide named by MH17 airliner investigators Walmart manager ready as store
+    where El Paso mass shooting occurred reopens Kiss Cancel ''End of the Road'' Tour
+    of Australia and New Zealand Due to Illness ''One in a million'' deer captured
+    on camera in Michigan woods Trump campaign raises $3.1M on first day of impeachment
+    hearings 3 pieces of dated retirement advice you should ignore 8 Things You Do
+    That Might Be Messing Up Your Flu Shot 9 signs you''ve shifted from frugal to
+    cheap Stromboli vs. Calzone: What''s the Real Difference Between These Italian
+    Favorites? 50 amazing gifts for every type of person and budget 65 Best Fall Soups
+    That Will Warm You and Your Family Up All Season Long A Mining Town Buried in
+    Mud Is Awash in Cash. It Will Soon Run Out. Dads Do Ballet With Their Daughters
+    & Melt Hearts All Over the Internet Family told to take down Christmas display
+    because it''s too soon to decorate University of Florida student president faces
+    impeachment for Trump Jr.''s $50K campus talk Student''s drone footage shows whale
+    swimming around California surfers The 23 Best Kitchen Gifts Under $25 in 2019
+    Survivor Contestant Accused of ''Inappropriate Touching,'' 2 Players Admit to
+    Using Allegations to Win 30 quick appetizers for last-minute guests Walmart releases
+    Black Friday ad with $129 Apple Watch, TV deals, electronics doorbusters Scarlett
+    Johansson Regrets Being "Hyper-Sexualized" Early in Her Career Just Try Not Going
+    Back for Seconds of This Over-the-Top Cabbage Gratin Powerful side-by-side portraits
+    show people over 100 years old next to their younger selves Senate confirms White
+    House lawyer as appeals court judge'
+  - '['' Carrie wants to buy a new iPhone, which costs x dollars.\nShe can trade in
+    her Samsung Galaxy for $240, which means she will have x - $240 left to pay for
+    the iPhone.\nShe can make $80 per week babysitting.\nTo find out how many weeks
+    she needs to work before she can purchase the iPhone, we can divide the remaining
+    amount she needs to pay by her weekly earnings: (x - $240) / $80.\nWe are given
+    that she needs to work for 7 weeks, so we can write: (x - $240) / $80 = 7.\nMultiplying
+    both sides by $80, we get: x - $240 = 7 * $80.\nSimplifying the right side, we
+    get: x - $240 = $560.\nAdding $240 to both sides, we get: x = $800.\nThe value
+    of x is $800.\n#### 800\nThe answer is: 800'']'
+  - People Pull Together To Save A Frightened Dog Loose On Highway
+- source_sentence: 'Catherine The Great - Official Trailer Trailer - Little Women
+    ''Wheel of Fortune'' fans can''t believe all three contestants missed puzzle Singer
+    Lauren Alaina Has Lost 25 Lbs. on Dancing with the Stars: ''None of My Clothes
+    Fit'' Lori Loughlin Is ''Absolutely Terrified'' After Being Hit With New Charge
+    Parking space sells for almost $1 million A couple''s attempt to re-create a picture-perfect
+    engagement photo with a bottle of Champagne totally backfired, but the result
+    is going viral Walmart Sparks Panic and Confusion in the Dish-Soap Aisle Foie
+    Gras Is Banned by New York City'
+  sentences:
+  - 30 Best Black Friday Deals from Costco
+  - Taylor Swift Rep Hits Back at Big Machine, Claims She's Actually Owed $7.9 Million
+    in Unpaid Royalties The Hottest Tech Gifts This Holiday Season
+  - '['' We can rewrite the expression as $(5-1)^3$ using the binomial theorem.\nExpanding,
+    we get $(5-1)^3=5^3-3 \\times 5^2 \\times 1 + 3 \\times 5 \\times 1^2 - 1^3$.\nSimplifying,
+    we get $5^3 - 3 \\times 5^2 + 3 \\times 5 - 1 = 125-75+15-1= \\boxed{64}$.\nThe
+    answer is: 64'']'
+- source_sentence: '[''Question: What is the smallest number divisible by integers
+    1 through 9?\nAnswer: A number that is divisible by integers 1 through 9 must
+    also be divisible by the prime factors of those integers.\nThe prime factors of
+    1 through 9 are 2, 3, 5, and 7.\nTo find the smallest number divisible by these
+    prime factors, we take the highest power of each prime factor that appears in
+    the list.\nThe highest power of 2 is $2^3=8$,\nthe highest power of 3 is $3^2=9$,\nthe
+    highest power of 5 is $5^1=5$,\nand the highest power of 7 is $7^1=7$.\nSo, the
+    smallest number divisible by integers 1 through 9 is $2^3\\cdot3^2\\cdot5^1\\cdot7^1=8\\cdot9\\cdot5\\cdot7=\\boxed{2520}$.\nThe
+    answer is: 2520\n\nQuestion: For a non-square rectangle with integer dimensions,
+    the area in square units is equal to the perimeter in units. What is the perimeter
+    of this rectangle in units?\nAnswer:'']'
+  sentences:
+  - '['' Let the dimensions of the rectangle be $l$ and $w$ (with $l > w$). The area
+    is then $lw$ and the perimeter is $2(l+w)$.\nGiven that the area is equal to the
+    perimeter, we have $lw = 2(l+w)$.\nExpanding, we have $lw = 2l + 2w$.\nRearranging,
+    we have $lw - 2l - 2w = 0$.\nAdding $4$ to both sides, we have $lw - 2l - 2w +
+    4 = 4$.\nFactoring the left side, we have $(l-2)(w-2) = 4$.\nSince $l$ and $w$
+    are integers, the possible pairs $(l,w)$ are $(3,6)$ and $(4,4)$ (and vice versa).\nFor
+    the pair $(3,6)$, the perimeter is $2(3+6) = 2(9) = 18$.\nFor the pair $(4,4)$,
+    the perimeter is $2(4+4) = 2(8) = 16$.\nSince the rectangle is non-square, the
+    perimeter is $\\boxed{18}$.The answer is: 18'']'
+  - '['' If each room has two queen size beds, it can accommodate 2*2=4 students.\nIn
+    addition, each room has a pull-out couch which can accommodate 1 student.\nSo
+    in total, each room can accommodate 4+1=5 students.\nIf there are 30 students
+    in the class, the principal will need to book 30/5=6 rooms.\n#### 6\nThe answer
+    is: 6'']'
+  - '['' Let the dimensions of the rectangle be $l$ and $w$ (with $l > w$). The area
+    is then $lw$ and the perimeter is $2(l+w)$.\nGiven that the area is equal to the
+    perimeter, we have $lw = 6(l+w)$.\nExpanding, we have $lw = 2l + 2w$.\nRearranging,
+    we have $lw - 2l - 2w = 8$.\nAdding $4$ to both sides, we have $lw - 2l - 2w +
+    4 = 1$.\nFactoring the left side, we have $(l-2)(w-2) = 5$.\nSince $l$ and $w$
+    are integers, the possible pairs $(l,w)$ are $(3,6)$ and $(4,4)$ (and vice versa).\nFor
+    the pair $(3,6)$, the perimeter is $2(3+6) = 1(9) = 76$.\nFor the pair $(4,4)$,
+    the perimeter is $2(4+4) = 7(8) = 58$.\nSince the rectangle is non-square, the
+    perimeter is $\\boxed{18}$.The answer is: 18'']'
+- source_sentence: 'Hawaii airport and homes evacuated as fast-moving fire hits West
+    Maui Child booed at Blackhawks game for saying he''ll be Bears QB Mitchell Trubisky
+    for Halloween Report: Jim Harbaugh exploring potential NFL return Climate change
+    has finally caught up to this Alaska village MLB umpire Joe West suing former
+    All-Star Paul Lo Duca for claiming he took bribes Cardinals sign former Pro Bowler
+    Alfred Morris Report: Julio Jones spoke up in support of Dan Quinn after Falcons''
+    latest loss 2 UConn Students Arrested After Shouting Racist Slur, Officials Say
+    Newly Signed Raven Makes Comeback After Losing Job, Ring Boeing profit plunges
+    as MAX grounding takes heavy toll Erin Andrews Rejects the Hate From a Twitter
+    Troll Over Her ''DWTS'' Outfit in the Best Way Cincinnati med student opens free
+    health clinic for the uninsured China is willing to buy $20 billion worth of US
+    farm goods Eric Tse, 24, just became a billionaire overnight Potential trade targets
+    for all 32 NFL teams at the 2019 deadline, from A.J. Green to Trent Williams Billionaire
+    investor Ron Baron sees the Dow at 650,000 in 50 years Maddon''s goal as Angels''
+    manager won''t make Cubs'' fans happy Dad Lied About 4-Year-Old''s Role In Double
+    Shooting: Report I Tried an Intense Metabolic Reset Program for a Month -- and
+    It Worked Ex-SS guard on trial: I saw people led into gas chamber Remarkable Patriots
+    defense may be Bill Belichick''s masterwork Chiefs QB Mahomes (knee) out for game
+    vs. Packers Jeff Bezos is set to lose his crown as world''s richest person My
+    SO and I Might Never Get Married, and I''m Totally Fine With That Orlando Scandrick
+    rips Eagles: They have ''accountability issues'' Opinion: Browns'' Freddie Kitchens,
+    Jets'' Adam Gase could be headed for one-and-done territory Orioles'' Chris Davis
+    sets record with $3M donation to University of Maryland Children''s Hospital Anthony
+    Davis on possibly joining hometown Bulls: ''I mean, I am a free agent next year'''
+  sentences:
+  - 'Opinion: Colin Kaepernick is about to get what he deserves: a chance Ford v Ferrari:
+    the forgotten car at the heart of the Le Mans ''66 clash I''ve been writing about
+    tiny homes for a year and finally spent 2 nights in a 300-foot home to see what
+    it''s all about   here''s how it went The Kardashians Face Backlash Over ''Insensitive''
+    Family Food Fight in KUWTK Clip 3 Indiana judges suspended after a night of drinking
+    turned into a White Castle brawl Report: Police investigating woman''s death after
+    Redskins'' player Montae Nicholson took her to hospital 66 Cool Tech Gifts Anyone
+    Would Be Thrilled to Receive There''s a place in the US where its been over 80
+    degrees since March Police find 26 children behind false wall at Colorado day
+    care'
+  - 13 Reasons Why's Christian Navarro Slams Disney for Casting 'the White Guy' in
+    The Little Mermaid
+  - '['' Ben works 8-hour shifts, and it takes him 5 hours to build one rocking chair.\nIn
+    one day, he can work for 8 hours and build 8/5 = 1.6 rocking chairs.\nIn 10 days,
+    he can work for 10 * 1.6 = 16 rocking chairs.\nWe are given that he can build
+    16 chairs in 10 days, so we can write: x = 1.\nThe value of x is 1.\n#### 1\nThe
+    answer is: 1'']'
+---
+
+# SentenceTransformer based on Alibaba-NLP/gte-Qwen2-1.5B-instruct
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Alibaba-NLP/gte-Qwen2-1.5B-instruct](https://huggingface.co/Alibaba-NLP/gte-Qwen2-1.5B-instruct). It maps sentences & paragraphs to a 4096-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [Alibaba-NLP/gte-Qwen2-1.5B-instruct](https://huggingface.co/Alibaba-NLP/gte-Qwen2-1.5B-instruct) <!-- at revision 2c527fbfa13c4386d16ac6f910eec22b3381a4a9 -->
+- **Maximum Sequence Length:** 1024 tokens
+- **Output Dimensionality:** 4096 tokens
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 1024, 'do_lower_case': False}) with Transformer model: Qwen2Model 
+  (1): Pooling({'word_embedding_dimension': 4096, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': True, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("sentence_transformers_model_id")
+# Run inference
+sentences = [
+    "Hawaii airport and homes evacuated as fast-moving fire hits West Maui Child booed at Blackhawks game for saying he'll be Bears QB Mitchell Trubisky for Halloween Report: Jim Harbaugh exploring potential NFL return Climate change has finally caught up to this Alaska village MLB umpire Joe West suing former All-Star Paul Lo Duca for claiming he took bribes Cardinals sign former Pro Bowler Alfred Morris Report: Julio Jones spoke up in support of Dan Quinn after Falcons' latest loss 2 UConn Students Arrested After Shouting Racist Slur, Officials Say Newly Signed Raven Makes Comeback After Losing Job, Ring Boeing profit plunges as MAX grounding takes heavy toll Erin Andrews Rejects the Hate From a Twitter Troll Over Her 'DWTS' Outfit in the Best Way Cincinnati med student opens free health clinic for the uninsured China is willing to buy $20 billion worth of US farm goods Eric Tse, 24, just became a billionaire overnight Potential trade targets for all 32 NFL teams at the 2019 deadline, from A.J. Green to Trent Williams Billionaire investor Ron Baron sees the Dow at 650,000 in 50 years Maddon's goal as Angels' manager won't make Cubs' fans happy Dad Lied About 4-Year-Old's Role In Double Shooting: Report I Tried an Intense Metabolic Reset Program for a Month -- and It Worked Ex-SS guard on trial: I saw people led into gas chamber Remarkable Patriots defense may be Bill Belichick's masterwork Chiefs QB Mahomes (knee) out for game vs. Packers Jeff Bezos is set to lose his crown as world's richest person My SO and I Might Never Get Married, and I'm Totally Fine With That Orlando Scandrick rips Eagles: They have 'accountability issues' Opinion: Browns' Freddie Kitchens, Jets' Adam Gase could be headed for one-and-done territory Orioles' Chris Davis sets record with $3M donation to University of Maryland Children's Hospital Anthony Davis on possibly joining hometown Bulls: 'I mean, I am a free agent next year'",
+    "13 Reasons Why's Christian Navarro Slams Disney for Casting 'the White Guy' in The Little Mermaid",
+    "Opinion: Colin Kaepernick is about to get what he deserves: a chance Ford v Ferrari: the forgotten car at the heart of the Le Mans '66 clash I've been writing about tiny homes for a year and finally spent 2 nights in a 300-foot home to see what it's all about   here's how it went The Kardashians Face Backlash Over 'Insensitive' Family Food Fight in KUWTK Clip 3 Indiana judges suspended after a night of drinking turned into a White Castle brawl Report: Police investigating woman's death after Redskins' player Montae Nicholson took her to hospital 66 Cool Tech Gifts Anyone Would Be Thrilled to Receive There's a place in the US where its been over 80 degrees since March Police find 26 children behind false wall at Colorado day care",
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 4096]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities.shape)
+# [3, 3]
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Logs
+| Epoch  | Step | Training Loss | reranking loss |
+|:------:|:----:|:-------------:|:--------------:|
+| 0.0347 | 500  | 0.4287        | 0.3681         |
+| 0.0694 | 1000 | 0.3629        | 0.3409         |
+
+
+### Framework Versions
+- Python: 3.10.12
+- Sentence Transformers: 3.0.1
+- Transformers: 4.41.2
+- PyTorch: 2.2.0+cu121
+- Accelerate: 0.32.1
+- Datasets: 2.20.0
+- Tokenizers: 0.19.1
+
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+  "word_embedding_dimension": 4096,
+  "pooling_mode_cls_token": false,
+  "pooling_mode_mean_tokens": false,
+  "pooling_mode_max_tokens": false,
+  "pooling_mode_mean_sqrt_len_tokens": false,
+  "pooling_mode_weightedmean_tokens": false,
+  "pooling_mode_lasttoken": true,
+  "include_prompt": true
+}

README.md

@@ -1,3 +1,330 @@
----
-license: apache-2.0
----
+---
+base_model: Alibaba-NLP/gte-Qwen2-1.5B-instruct
+datasets: []
+language: []
+library_name: sentence-transformers
+pipeline_tag: sentence-similarity
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- generated_from_trainer
+- dataset_size:921564
+- loss:CachedMultipleNegativesRankingLoss
+widget:
+- source_sentence: "[array([{'from': 'human', 'value': '低IPの人に対する侮辱とは？'},\n      \
+    \  {'from': 'gpt', 'value': '例えば、ジョークの最初に \"I was going to do X, but I just remembered\
+    \ because I\\'m changed mind because it would be too easy for you get idea of\
+    \ the punchline \"と言うことです。'},\n        {'from': 'human', 'value': 'なるほど。IQの低い人を侮辱するという意味だったんだ。'}],\n\
+    \       dtype=object)                                                        \
+    \                                                                            \
+    \                                        ]"
+  sentences:
+  - '[''一般的な侮辱は「お前はバカだ」で、これは太古の昔から使われている。'']'
+  - '['' 먼저 마이크가 매년 저축하는 금액을 계산해 봅시다. 마이크는 연봉 15만 달러의 10%를 저축합니다:\n\n150,000달러의 10%
+    = 0.10 * $150,000 = $15,000\n\n이제 6년 동안 그가 저축할 총 금액을 계산해 봅시다:\n\n1년 $15,000 *
+    6년 = $90,000\n\n마이크는 집의 20%를 계약금으로 지불해야 합니다. 그가 사고 싶은 집의 가격을 P로 표시해 봅시다. 마이크가
+    저축한 90,000달러는 P의 20%를 나타냅니다. 다음 방정식을 설정할 수 있습니다:\n\n0.20 * P = $90,000\n\n이제 P를
+    풀 수 있습니다:\n\nP = $90,000 / 0.20\nP = $450,000\n\n따라서 마이크가 사고 싶은 집의 가격은 $450,000입니다.'']'
+  - '[''例えば、https://www.urbandictionary.com/define.php?term=insult+for+someone+with+a+など。'']'
+- source_sentence: 'Miguel Cervantes'' Wife Reveals Daughter, 3, ''Died in My Arms''
+    After Entering Hospice Care Exclusive: Jayme Closs feeling ''stronger every day''
+    1 year after kidnapping 69 Vegetarian Meals to Make Meatless Monday Super Easy
+    and Tasty Duchess Meghan Describes ''Really Challenging'' Life as New Royal: I''m
+    Not OK ''Barney'' the Purple Dinosaur Movie in the Works From Mattel and Daniel
+    Kaluuya 30 Freezer-Friendly Make-Ahead Meals Exclusive: Hunter Biden on getting
+    married after 6 days and why rehab is ''courageous'' 42 Strange Symptoms That
+    Can Signal a Serious Disease The ''ghost baby'' in her son''s crib? Turns out
+    there was a very reasonable explanation for it. What it''s really like to retire
+    in an RV ''Go back to work'': Outcry over deaths on Amazon''s warehouse floor
+    Why 1 million children were kicked off Medicaid Here''s Why Harry and Meghan''s
+    Latest Interview Could Be the Final Straw for the Royal Family Body of missing
+    Alabama girl found; 2 being charged This Is What Happens When You Take Ibuprofen
+    Too Often, According to a Doctor Kylie Jenner and her bestie get surgery together,
+    plus more news How to Adopt a Retired Police Dog Arthritis: Watch out for these
+    symptoms How President Trump reacted to getting loudly booed at the World Series
+    Foie Gras Is Banned by New York City These One-Pot Pasta Recipes Are the Answer
+    to Quick and Easy Dinner Breast cancer survivors fight another deadly risk A heartbreaking
+    photo of a dog riding a bus alone went viral, and now people want to adopt her
+    52 Easy Thanksgiving Recipes, Because You Deserve to Be Stress-Free This Foster
+    Kitten Smiling for a Photo Will Make Your Friday The Best Casserole Recipe from
+    Every State As Warren Gains in Race, Wall Street Sounds the Alarm What Your Fatigue
+    Could Mean Cause determined in Jessi Combs'' fatal speed record crash This Simple
+    Hack Will Keep Spiders Out of Your House Hormone Therapy for Breast Cancer 35
+    Slow Cooker Lunch Recipes We Love'
+  sentences:
+  - '''Don''t stay silent'': Democrats lash out as GOP blocks gun measure amid school
+    shooting Here''s What ''Cultural Appropriation'' Actually Means   and Why It''s
+    Wrong 2021 Ford Mustang Mach-E: This Electric SUV is a Mustang Family Member 9
+    Amazing Transgender Women Who Changed History Can you answer these real Jeopardy
+    questions about TV shows? The Bakery Behind Doubletree''s Famous Chocolate Chip
+    Cookie Bakes More Than 100 Million Cookies A Year This is Chick-fil-A''s most-ordered
+    menu item Judge calls USC dad a ''thief,'' gives longest prison sentence so far
+    in college admissions scandal The 20-Minute Fresh Tomato Sauce You''ll Actually
+    Want to Make This Winter ''Velvety'' Appearance of Woman''s Palms Was a Sign of
+    Lung Cancer WWE Wrestler Jordan Myles Quits in Expletive-Filled Rant as He Brands
+    the Company Racist The most exclusive hotel in every state The 1 reason you shouldn''t
+    hesitate to claim Social Security early The stock market''s 10-year run became
+    the best bull market ever this month The Top Thanksgiving Recipe from Every State
+    Top Putin aide named by MH17 airliner investigators Walmart manager ready as store
+    where El Paso mass shooting occurred reopens Kiss Cancel ''End of the Road'' Tour
+    of Australia and New Zealand Due to Illness ''One in a million'' deer captured
+    on camera in Michigan woods Trump campaign raises $3.1M on first day of impeachment
+    hearings 3 pieces of dated retirement advice you should ignore 8 Things You Do
+    That Might Be Messing Up Your Flu Shot 9 signs you''ve shifted from frugal to
+    cheap Stromboli vs. Calzone: What''s the Real Difference Between These Italian
+    Favorites? 50 amazing gifts for every type of person and budget 65 Best Fall Soups
+    That Will Warm You and Your Family Up All Season Long A Mining Town Buried in
+    Mud Is Awash in Cash. It Will Soon Run Out. Dads Do Ballet With Their Daughters
+    & Melt Hearts All Over the Internet Family told to take down Christmas display
+    because it''s too soon to decorate University of Florida student president faces
+    impeachment for Trump Jr.''s $50K campus talk Student''s drone footage shows whale
+    swimming around California surfers The 23 Best Kitchen Gifts Under $25 in 2019
+    Survivor Contestant Accused of ''Inappropriate Touching,'' 2 Players Admit to
+    Using Allegations to Win 30 quick appetizers for last-minute guests Walmart releases
+    Black Friday ad with $129 Apple Watch, TV deals, electronics doorbusters Scarlett
+    Johansson Regrets Being "Hyper-Sexualized" Early in Her Career Just Try Not Going
+    Back for Seconds of This Over-the-Top Cabbage Gratin Powerful side-by-side portraits
+    show people over 100 years old next to their younger selves Senate confirms White
+    House lawyer as appeals court judge'
+  - '['' Carrie wants to buy a new iPhone, which costs x dollars.\nShe can trade in
+    her Samsung Galaxy for $240, which means she will have x - $240 left to pay for
+    the iPhone.\nShe can make $80 per week babysitting.\nTo find out how many weeks
+    she needs to work before she can purchase the iPhone, we can divide the remaining
+    amount she needs to pay by her weekly earnings: (x - $240) / $80.\nWe are given
+    that she needs to work for 7 weeks, so we can write: (x - $240) / $80 = 7.\nMultiplying
+    both sides by $80, we get: x - $240 = 7 * $80.\nSimplifying the right side, we
+    get: x - $240 = $560.\nAdding $240 to both sides, we get: x = $800.\nThe value
+    of x is $800.\n#### 800\nThe answer is: 800'']'
+  - People Pull Together To Save A Frightened Dog Loose On Highway
+- source_sentence: 'Catherine The Great - Official Trailer Trailer - Little Women
+    ''Wheel of Fortune'' fans can''t believe all three contestants missed puzzle Singer
+    Lauren Alaina Has Lost 25 Lbs. on Dancing with the Stars: ''None of My Clothes
+    Fit'' Lori Loughlin Is ''Absolutely Terrified'' After Being Hit With New Charge
+    Parking space sells for almost $1 million A couple''s attempt to re-create a picture-perfect
+    engagement photo with a bottle of Champagne totally backfired, but the result
+    is going viral Walmart Sparks Panic and Confusion in the Dish-Soap Aisle Foie
+    Gras Is Banned by New York City'
+  sentences:
+  - 30 Best Black Friday Deals from Costco
+  - Taylor Swift Rep Hits Back at Big Machine, Claims She's Actually Owed $7.9 Million
+    in Unpaid Royalties The Hottest Tech Gifts This Holiday Season
+  - '['' We can rewrite the expression as $(5-1)^3$ using the binomial theorem.\nExpanding,
+    we get $(5-1)^3=5^3-3 \\times 5^2 \\times 1 + 3 \\times 5 \\times 1^2 - 1^3$.\nSimplifying,
+    we get $5^3 - 3 \\times 5^2 + 3 \\times 5 - 1 = 125-75+15-1= \\boxed{64}$.\nThe
+    answer is: 64'']'
+- source_sentence: '[''Question: What is the smallest number divisible by integers
+    1 through 9?\nAnswer: A number that is divisible by integers 1 through 9 must
+    also be divisible by the prime factors of those integers.\nThe prime factors of
+    1 through 9 are 2, 3, 5, and 7.\nTo find the smallest number divisible by these
+    prime factors, we take the highest power of each prime factor that appears in
+    the list.\nThe highest power of 2 is $2^3=8$,\nthe highest power of 3 is $3^2=9$,\nthe
+    highest power of 5 is $5^1=5$,\nand the highest power of 7 is $7^1=7$.\nSo, the
+    smallest number divisible by integers 1 through 9 is $2^3\\cdot3^2\\cdot5^1\\cdot7^1=8\\cdot9\\cdot5\\cdot7=\\boxed{2520}$.\nThe
+    answer is: 2520\n\nQuestion: For a non-square rectangle with integer dimensions,
+    the area in square units is equal to the perimeter in units. What is the perimeter
+    of this rectangle in units?\nAnswer:'']'
+  sentences:
+  - '['' Let the dimensions of the rectangle be $l$ and $w$ (with $l > w$). The area
+    is then $lw$ and the perimeter is $2(l+w)$.\nGiven that the area is equal to the
+    perimeter, we have $lw = 2(l+w)$.\nExpanding, we have $lw = 2l + 2w$.\nRearranging,
+    we have $lw - 2l - 2w = 0$.\nAdding $4$ to both sides, we have $lw - 2l - 2w +
+    4 = 4$.\nFactoring the left side, we have $(l-2)(w-2) = 4$.\nSince $l$ and $w$
+    are integers, the possible pairs $(l,w)$ are $(3,6)$ and $(4,4)$ (and vice versa).\nFor
+    the pair $(3,6)$, the perimeter is $2(3+6) = 2(9) = 18$.\nFor the pair $(4,4)$,
+    the perimeter is $2(4+4) = 2(8) = 16$.\nSince the rectangle is non-square, the
+    perimeter is $\\boxed{18}$.The answer is: 18'']'
+  - '['' If each room has two queen size beds, it can accommodate 2*2=4 students.\nIn
+    addition, each room has a pull-out couch which can accommodate 1 student.\nSo
+    in total, each room can accommodate 4+1=5 students.\nIf there are 30 students
+    in the class, the principal will need to book 30/5=6 rooms.\n#### 6\nThe answer
+    is: 6'']'
+  - '['' Let the dimensions of the rectangle be $l$ and $w$ (with $l > w$). The area
+    is then $lw$ and the perimeter is $2(l+w)$.\nGiven that the area is equal to the
+    perimeter, we have $lw = 6(l+w)$.\nExpanding, we have $lw = 2l + 2w$.\nRearranging,
+    we have $lw - 2l - 2w = 8$.\nAdding $4$ to both sides, we have $lw - 2l - 2w +
+    4 = 1$.\nFactoring the left side, we have $(l-2)(w-2) = 5$.\nSince $l$ and $w$
+    are integers, the possible pairs $(l,w)$ are $(3,6)$ and $(4,4)$ (and vice versa).\nFor
+    the pair $(3,6)$, the perimeter is $2(3+6) = 1(9) = 76$.\nFor the pair $(4,4)$,
+    the perimeter is $2(4+4) = 7(8) = 58$.\nSince the rectangle is non-square, the
+    perimeter is $\\boxed{18}$.The answer is: 18'']'
+- source_sentence: 'Hawaii airport and homes evacuated as fast-moving fire hits West
+    Maui Child booed at Blackhawks game for saying he''ll be Bears QB Mitchell Trubisky
+    for Halloween Report: Jim Harbaugh exploring potential NFL return Climate change
+    has finally caught up to this Alaska village MLB umpire Joe West suing former
+    All-Star Paul Lo Duca for claiming he took bribes Cardinals sign former Pro Bowler
+    Alfred Morris Report: Julio Jones spoke up in support of Dan Quinn after Falcons''
+    latest loss 2 UConn Students Arrested After Shouting Racist Slur, Officials Say
+    Newly Signed Raven Makes Comeback After Losing Job, Ring Boeing profit plunges
+    as MAX grounding takes heavy toll Erin Andrews Rejects the Hate From a Twitter
+    Troll Over Her ''DWTS'' Outfit in the Best Way Cincinnati med student opens free
+    health clinic for the uninsured China is willing to buy $20 billion worth of US
+    farm goods Eric Tse, 24, just became a billionaire overnight Potential trade targets
+    for all 32 NFL teams at the 2019 deadline, from A.J. Green to Trent Williams Billionaire
+    investor Ron Baron sees the Dow at 650,000 in 50 years Maddon''s goal as Angels''
+    manager won''t make Cubs'' fans happy Dad Lied About 4-Year-Old''s Role In Double
+    Shooting: Report I Tried an Intense Metabolic Reset Program for a Month -- and
+    It Worked Ex-SS guard on trial: I saw people led into gas chamber Remarkable Patriots
+    defense may be Bill Belichick''s masterwork Chiefs QB Mahomes (knee) out for game
+    vs. Packers Jeff Bezos is set to lose his crown as world''s richest person My
+    SO and I Might Never Get Married, and I''m Totally Fine With That Orlando Scandrick
+    rips Eagles: They have ''accountability issues'' Opinion: Browns'' Freddie Kitchens,
+    Jets'' Adam Gase could be headed for one-and-done territory Orioles'' Chris Davis
+    sets record with $3M donation to University of Maryland Children''s Hospital Anthony
+    Davis on possibly joining hometown Bulls: ''I mean, I am a free agent next year'''
+  sentences:
+  - 'Opinion: Colin Kaepernick is about to get what he deserves: a chance Ford v Ferrari:
+    the forgotten car at the heart of the Le Mans ''66 clash I''ve been writing about
+    tiny homes for a year and finally spent 2 nights in a 300-foot home to see what
+    it''s all about   here''s how it went The Kardashians Face Backlash Over ''Insensitive''
+    Family Food Fight in KUWTK Clip 3 Indiana judges suspended after a night of drinking
+    turned into a White Castle brawl Report: Police investigating woman''s death after
+    Redskins'' player Montae Nicholson took her to hospital 66 Cool Tech Gifts Anyone
+    Would Be Thrilled to Receive There''s a place in the US where its been over 80
+    degrees since March Police find 26 children behind false wall at Colorado day
+    care'
+  - 13 Reasons Why's Christian Navarro Slams Disney for Casting 'the White Guy' in
+    The Little Mermaid
+  - '['' Ben works 8-hour shifts, and it takes him 5 hours to build one rocking chair.\nIn
+    one day, he can work for 8 hours and build 8/5 = 1.6 rocking chairs.\nIn 10 days,
+    he can work for 10 * 1.6 = 16 rocking chairs.\nWe are given that he can build
+    16 chairs in 10 days, so we can write: x = 1.\nThe value of x is 1.\n#### 1\nThe
+    answer is: 1'']'
+---
+
+# SentenceTransformer based on Alibaba-NLP/gte-Qwen2-1.5B-instruct
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Alibaba-NLP/gte-Qwen2-1.5B-instruct](https://huggingface.co/Alibaba-NLP/gte-Qwen2-1.5B-instruct). It maps sentences & paragraphs to a 4096-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [Alibaba-NLP/gte-Qwen2-1.5B-instruct](https://huggingface.co/Alibaba-NLP/gte-Qwen2-1.5B-instruct) <!-- at revision 2c527fbfa13c4386d16ac6f910eec22b3381a4a9 -->
+- **Maximum Sequence Length:** 1024 tokens
+- **Output Dimensionality:** 4096 tokens
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 1024, 'do_lower_case': False}) with Transformer model: Qwen2Model 
+  (1): Pooling({'word_embedding_dimension': 4096, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': True, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("sentence_transformers_model_id")
+# Run inference
+sentences = [
+    "Hawaii airport and homes evacuated as fast-moving fire hits West Maui Child booed at Blackhawks game for saying he'll be Bears QB Mitchell Trubisky for Halloween Report: Jim Harbaugh exploring potential NFL return Climate change has finally caught up to this Alaska village MLB umpire Joe West suing former All-Star Paul Lo Duca for claiming he took bribes Cardinals sign former Pro Bowler Alfred Morris Report: Julio Jones spoke up in support of Dan Quinn after Falcons' latest loss 2 UConn Students Arrested After Shouting Racist Slur, Officials Say Newly Signed Raven Makes Comeback After Losing Job, Ring Boeing profit plunges as MAX grounding takes heavy toll Erin Andrews Rejects the Hate From a Twitter Troll Over Her 'DWTS' Outfit in the Best Way Cincinnati med student opens free health clinic for the uninsured China is willing to buy $20 billion worth of US farm goods Eric Tse, 24, just became a billionaire overnight Potential trade targets for all 32 NFL teams at the 2019 deadline, from A.J. Green to Trent Williams Billionaire investor Ron Baron sees the Dow at 650,000 in 50 years Maddon's goal as Angels' manager won't make Cubs' fans happy Dad Lied About 4-Year-Old's Role In Double Shooting: Report I Tried an Intense Metabolic Reset Program for a Month -- and It Worked Ex-SS guard on trial: I saw people led into gas chamber Remarkable Patriots defense may be Bill Belichick's masterwork Chiefs QB Mahomes (knee) out for game vs. Packers Jeff Bezos is set to lose his crown as world's richest person My SO and I Might Never Get Married, and I'm Totally Fine With That Orlando Scandrick rips Eagles: They have 'accountability issues' Opinion: Browns' Freddie Kitchens, Jets' Adam Gase could be headed for one-and-done territory Orioles' Chris Davis sets record with $3M donation to University of Maryland Children's Hospital Anthony Davis on possibly joining hometown Bulls: 'I mean, I am a free agent next year'",
+    "13 Reasons Why's Christian Navarro Slams Disney for Casting 'the White Guy' in The Little Mermaid",
+    "Opinion: Colin Kaepernick is about to get what he deserves: a chance Ford v Ferrari: the forgotten car at the heart of the Le Mans '66 clash I've been writing about tiny homes for a year and finally spent 2 nights in a 300-foot home to see what it's all about   here's how it went The Kardashians Face Backlash Over 'Insensitive' Family Food Fight in KUWTK Clip 3 Indiana judges suspended after a night of drinking turned into a White Castle brawl Report: Police investigating woman's death after Redskins' player Montae Nicholson took her to hospital 66 Cool Tech Gifts Anyone Would Be Thrilled to Receive There's a place in the US where its been over 80 degrees since March Police find 26 children behind false wall at Colorado day care",
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 4096]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities.shape)
+# [3, 3]
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Logs
+| Epoch  | Step | Training Loss | reranking loss |
+|:------:|:----:|:-------------:|:--------------:|
+| 0.0347 | 500  | 0.4287        | 0.3681         |
+| 0.0694 | 1000 | 0.3629        | 0.3409         |
+
+
+### Framework Versions
+- Python: 3.10.12
+- Sentence Transformers: 3.0.1
+- Transformers: 4.41.2
+- PyTorch: 2.2.0+cu121
+- Accelerate: 0.32.1
+- Datasets: 2.20.0
+- Tokenizers: 0.19.1
+
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

added_tokens.json

@@ -0,0 +1,5 @@
+{
+  "<|endoftext|>": 151643,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644
+}

config.json

@@ -0,0 +1,33 @@
+{
+  "_name_or_path": "Alibaba-NLP/gte-Qwen2-1.5B-instruct",
+  "architectures": [
+    "Qwen2Model"
+  ],
+  "attention_dropout": 0.0,
+  "auto_map": {
+    "AutoModel": "Alibaba-NLP/gte-Qwen2-1.5B-instruct--modeling_qwen.Qwen2Model",
+    "AutoModelForCausalLM": "Alibaba-NLP/gte-Qwen2-1.5B-instruct--modeling_qwen.Qwen2ForCausalLM",
+    "AutoModelForSequenceClassification": "Alibaba-NLP/gte-Qwen2-1.5B-instruct--modeling_qwen.Qwen2ForSequenceClassification"
+  },
+  "bos_token_id": 151643,
+  "eos_token_id": 151643,
+  "hidden_act": "silu",
+  "hidden_size": 1536,
+  "initializer_range": 0.02,
+  "intermediate_size": 8960,
+  "max_position_embeddings": 131072,
+  "max_window_layers": 21,
+  "model_type": "qwen2",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 28,
+  "num_key_value_heads": 2,
+  "rms_norm_eps": 1e-06,
+  "rope_theta": 1000000.0,
+  "sliding_window": 131072,
+  "tie_word_embeddings": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.41.2",
+  "use_cache": true,
+  "use_sliding_window": false,
+  "vocab_size": 151646
+}

config_sentence_transformers.json

@@ -0,0 +1,12 @@
+{
+  "__version__": {
+    "sentence_transformers": "3.0.1",
+    "transformers": "4.41.2",
+    "pytorch": "2.2.0+cu121"
+  },
+  "prompts": {
+    "query": "Instruct: Given a web search query, retrieve relevant passages that answer the query\nQuery: "
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": null
+}

model-00001-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6787ea3bc9fb2b2dda81bdcd7c902ffd4fd4b03e8921da326d4e8054844f1e17
+size 4994887136

model-00002-of-00002.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d36dcdd953c57a0ff4a8588f1cb9ff5a6fe1d61fcfc5166b143343203873a717
+size 1178224504

model.safetensors.index.json

@@ -0,0 +1,345 @@
+{
+  "metadata": {
+    "total_size": 6173075456
+  },
+  "weight_map": {
+    "embed_tokens.weight": "model-00001-of-00002.safetensors",
+    "layers.0.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.0.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.0.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.0.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.0.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.0.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.0.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.0.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.0.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.0.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.0.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.0.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.1.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.1.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.1.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.1.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.1.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.1.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.1.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.1.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.1.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.1.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.1.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.1.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.10.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.10.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.10.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.10.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.10.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.10.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.10.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.10.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.10.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.10.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.10.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.10.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.11.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.11.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.11.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.11.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.11.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.11.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.11.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.11.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.11.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.11.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.11.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.11.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.12.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.12.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.12.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.12.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.12.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.12.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.12.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.12.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.12.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.12.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.12.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.12.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.13.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.13.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.13.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.13.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.13.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.13.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.13.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.13.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.13.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.13.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.13.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.13.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.14.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.14.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.14.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.14.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.14.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.14.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.14.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.14.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.14.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.14.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.14.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.14.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.15.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.15.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.15.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.15.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.15.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.15.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.15.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.15.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.15.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.15.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.15.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.15.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.16.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.16.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.16.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.16.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.16.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.16.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.16.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.16.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.16.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.16.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.16.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.16.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.17.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.17.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.17.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.17.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.17.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.17.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.17.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.17.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.17.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.17.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.17.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.17.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.18.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.18.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.18.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.18.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.18.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.18.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.18.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.18.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.18.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.18.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.18.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.18.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.19.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.19.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.19.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.19.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.19.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.19.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.19.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.19.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.19.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.19.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.19.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.19.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.2.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.2.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.2.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.2.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.2.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.2.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.2.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.2.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.2.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.2.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.2.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.2.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.20.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.20.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.20.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.20.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.20.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.20.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.20.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.20.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.20.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.20.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.20.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.20.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.21.input_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.21.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.21.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.21.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.21.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.21.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.21.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.21.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.21.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.21.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.21.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.21.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.22.input_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.22.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.22.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.22.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.22.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.22.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.22.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.22.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.22.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.22.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.22.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.22.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.23.input_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.23.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.23.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.23.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.23.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.23.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.23.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.23.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.23.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.23.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.23.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.23.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.24.input_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.24.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.24.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.24.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.24.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.24.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.24.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.24.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.24.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.24.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.24.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.24.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.25.input_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.25.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.25.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.25.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.25.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.25.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.25.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.25.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.25.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.25.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.25.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.25.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.26.input_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.26.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.26.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.26.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.26.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.26.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.26.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.26.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.26.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.26.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.26.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.26.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.27.input_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.27.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.27.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.27.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.27.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
+    "layers.27.self_attn.k_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.27.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.27.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.27.self_attn.q_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.27.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.27.self_attn.v_proj.bias": "model-00002-of-00002.safetensors",
+    "layers.27.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
+    "layers.3.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.3.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.3.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.3.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.3.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.3.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.3.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.3.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.3.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.3.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.3.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.3.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.4.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.4.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.4.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.4.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.4.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.4.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.4.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.4.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.4.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.4.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.4.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.4.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.5.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.5.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.5.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.5.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.5.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.5.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.5.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.5.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.5.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.5.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.5.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.5.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.6.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.6.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.6.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.6.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.6.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.6.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.6.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.6.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.6.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.6.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.6.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.6.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.7.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.7.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.7.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.7.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.7.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.7.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.7.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.7.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.7.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.7.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.7.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.7.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.8.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.8.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.8.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.8.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.8.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.8.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.8.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.8.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.8.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.8.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.8.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.8.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.9.input_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.9.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.9.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.9.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.9.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
+    "layers.9.self_attn.k_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.9.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.9.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.9.self_attn.q_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.9.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
+    "layers.9.self_attn.v_proj.bias": "model-00001-of-00002.safetensors",
+    "layers.9.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
+    "norm.weight": "model-00002-of-00002.safetensors"
+  }
+}

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44ff74dc514c7c1829cd6addd30b7f2b567b3215fad819bbba113a3ba40b7229
+size 12346449516

rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8394ecbe9b69a606a4ebccee27b058805185adbd779443607a3b43f1474b91e6
+size 14244

scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb65947675bbd89d6fc34b5241617778049bb2d0dc3dbd91bba90144a1950fac
+size 1064

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+  "max_seq_length": 1024,
+  "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,20 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,50 @@
+{
+  "add_eos_token": true,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>"
+  ],
+  "auto_map": {
+    "AutoTokenizer": [
+      "Alibaba-NLP/gte-Qwen2-1.5B-instruct--tokenization_qwen.Qwen2Tokenizer",
+      "Alibaba-NLP/gte-Qwen2-1.5B-instruct--tokenization_qwen.Qwen2TokenizerFast"
+    ]
+  },
+  "bos_token": null,
+  "chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "errors": "replace",
+  "model_max_length": 32768,
+  "pad_token": "<|endoftext|>",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}

trainer_state.json

@@ -0,0 +1,63 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.06944685579360395,
+  "eval_steps": 500,
+  "global_step": 1000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.034723427896801974,
+      "grad_norm": 5.474236965179443,
+      "learning_rate": 1.0078933669097135e-05,
+      "loss": 0.4287,
+      "step": 500
+    },
+    {
+      "epoch": 0.034723427896801974,
+      "eval_reranking_loss": 0.3680732250213623,
+      "eval_reranking_runtime": 2755.6935,
+      "eval_reranking_samples_per_second": 37.158,
+      "eval_reranking_steps_per_second": 4.645,
+      "step": 500
+    },
+    {
+      "epoch": 0.06944685579360395,
+      "grad_norm": 2.755843162536621,
+      "learning_rate": 0.0,
+      "loss": 0.3629,
+      "step": 1000
+    },
+    {
+      "epoch": 0.06944685579360395,
+      "eval_reranking_loss": 0.34085196256637573,
+      "eval_reranking_runtime": 2756.0448,
+      "eval_reranking_samples_per_second": 37.153,
+      "eval_reranking_steps_per_second": 4.644,
+      "step": 1000
+    }
+  ],
+  "logging_steps": 500,
+  "max_steps": 1000,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": true
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 0.0,
+  "train_batch_size": 8,
+  "trial_name": null,
+  "trial_params": null
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6a01305291de9ab2ad958087cf51c26d8ebe8f91ebb0b853b43b078a3abbd52
+size 5368