radna/NEW-Fuse-DeepSeek-R1-AIME-1

NEW-Fuse-AIME-1

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 as a base.

Models Merged

The following models were included in the merge:

• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046

Configuration

The following YAML configuration was used to produce this model:

base_model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
dtype: bfloat16
merge_method: dare_ties
parameters:
  int8_mask: 1.0
  normalize: 0.0
slices:
- sources:
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.35244033843752853
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.06565483579026653
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8248923599361199
      weight: 0.38461070968524835
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8592460452699369
      weight: 0.2709388464832553
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6541749263416319
      weight: 0.33556129068833057
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9426661206524789
      weight: 0.0053235629152804664
- sources:
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9488748922395204
      weight: 0.14826464617072407
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9131099463854294
      weight: 0.0500716728672521
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.03528639404457212
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.2726030572249115
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.12239211353380436
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9635154239911565
      weight: 0.21170102977920005
- sources:
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.36980377431194145
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9379968946209096
      weight: 0.4105923892761978
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9581657977584064
      weight: 0.22436197906860517
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8304501761634047
      weight: 0.319948178020794
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9871664200736995
      weight: 0.2330494583171301
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.6729079463501024
      weight: 0.019625987153301827
- sources:
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9485863817976715
      weight: 0.34558356909458027
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.06796959970262986
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8683263873836304
      weight: 0.23631196193757625
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.12897658747785207
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8873304359583831
      weight: 0.09356346904417376
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9199000783393735
      weight: 0.32323945110304375
- sources:
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.22626532519457837
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9303308151499403
      weight: 0.22866449319501092
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.012114770324266916
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8262691273376455
      weight: 0.1880770093616853
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.6580148272567256
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.006053164452560877
- sources:
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8963288717396416
      weight: 0.19450243612974277
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.791368227831232
      weight: 0.02572381859402889
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.6409267202920192
      weight: 0.33005762288513496
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8230620681157153
      weight: 0.2788608064344805
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.34794277506374116
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8603238495904307
      weight: 0.21702807973364863
- sources:
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9209955445213542
      weight: 0.08974446616116238
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.8932160714427164
      weight: 0.3104783993545368
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9414970547144341
      weight: 0.06504213911605598
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.057654213441167196
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9821945836928729
      weight: 0.15808303028309914
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7467053899439082
      weight: 0.33525672482486385
- sources:
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.1780233459840618
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.6637198537771577
      weight: 0.350440019875121
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.051708884503478325
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9018872471355386
      weight: 0.28677118290764636
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9108709485880905
      weight: 0.1265598944346814
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.041086328510648196
- sources:
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9344819873448885
      weight: 0.14958159570120846
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.8950475774498431
      weight: 0.12770736183473413
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.29231444574882387
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.2836375863562878
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8016409115061408
      weight: 0.5444344731114215
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.1491478960761252
- sources:
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9317774796610699
      weight: 0.17259642691510574
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.4891275526164048
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.06226032047681976
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7193472375209293
      weight: 0.021179331761708137
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9493623767409787
      weight: 0.2293855220751523
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8858649669962416
      weight: 0.29222706340856736
- sources:
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6979571275513518
      weight: 0.023735569803217782
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9236270062825293
      weight: 0.16859473651635182
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.18526269676326299
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9350660069572695
      weight: 0.0029221621280073606
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9895653552801078
      weight: 0.2058759130527274
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.06466413527070317
- sources:
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.6279945130814091
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.24256131069766823
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.2447996601710355
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.017408971387654848
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.20639036292982904
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7736379676309147
      weight: 0.33620172015889555
- sources:
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.3818620713241046
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7539315797503614
      weight: 0.12629217690057457
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8631011351825837
      weight: 0.07024936053875813
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9243050506620795
      weight: 0.16603356264453165
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.7064439770108553
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9707078804463223
      weight: 0.1917727733034922
- sources:
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9035937491248339
      weight: 0.20684942933884876
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.04062045229132705
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.09652371545953004
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7204498418796482
      weight: 0.1395997755690292
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.134725400133938
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.962863472735488
      weight: 0.19544068754739274
- sources:
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8560543604546618
      weight: 0.1596539163235574
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.1721068557847252
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9711858017304653
      weight: 0.42200633908888024
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9378240211471923
      weight: 0.03138822797552815
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.15825350887621872
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.09871857447169267
- sources:
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.38430635558799175
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.2015475291011739
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.14445591261752855
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8603795951417006
      weight: 0.2961618979486625
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8580174053646074
      weight: 0.14301069206654715
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9717109204302016
      weight: 0.13328672591584922
- sources:
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.11107527593944753
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9560507181369473
      weight: 0.07368367503319825
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.46261433358045856
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7924646357268611
      weight: 0.11061801788303605
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8444385710697626
      weight: 0.10305302346005583
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.0033179983310088756
- sources:
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.11885485419792863
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.27503497205951427
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.11605870572277832
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.027617068554572383
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.16306758931309295
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.22889893069371342
- sources:
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.25063161498642306
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.049954748105031685
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.6586200195059745
      weight: 0.24754329216230073
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7097504913960737
      weight: 0.2550043425392273
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8834084153180433
      weight: 0.38978515412037573
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.1950877626598588
- sources:
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.261038844209231
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9706444430350814
      weight: 0.1268925466636987
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7007460424648342
      weight: 0.20228947344196918
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.076790678467687
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.11955356146006063
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.2229078913547204
- sources:
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9185448618625446
      weight: 0.05165852000790261
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3417497799332185
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.0017734187865023343
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.15065291883212018
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.02092694750775584
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8221087620644192
      weight: 0.015352026000658103
- sources:
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.49113340525127774
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.10078126487271136
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.13522916547535774
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8463870815251355
      weight: 0.01017440107626627
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8904244483414491
      weight: 0.16213203359513373
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8744143758375571
      weight: 0.09177625364256652
- sources:
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.038138234981707264
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.5807219363288547
      weight: 0.3143909820843033
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.16364838395099435
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9739944185674109
      weight: 0.26398466553894406
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.21289922167960806
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.909420234746683
      weight: 0.06118470770696044
- sources:
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.016238586669195365
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.0674191127475775
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.08924636330686106
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.18865926192306698
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9057614959272517
      weight: 0.14952753666206495
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.025478952600610005
- sources:
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8204927776970573
      weight: 0.36995116785406174
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.934168195510422
      weight: 0.20509317839001168
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.3427482412645266
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.03706819006697437
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.18794113071293173
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.682543816882643
      weight: 0.2640077319659903
- sources:
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.26904173102605095
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.8187927395574907
      weight: 0.06746446492300981
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.4684163299580099
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.17036632853867986
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6500524858575425
      weight: 0.36960464654343594
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.2791067328283276
- sources:
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.10502658708408241
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7698269154741941
      weight: 0.33073559939362185
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.020727132033309892
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.20792079652234302
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.4639379292226603
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7762185845243367
      weight: 0.08584305195533527
- sources:
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7400954357615026
      weight: 0.3367454373266633
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.571205975367094
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9044090673153418
      weight: 0.037137091677969525
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.09801558194237756
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.058024268735814066
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.903086579972829
      weight: 0.10193817509394704
- sources:
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.4929574585773262
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.28060867977109183
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.026590892728238696
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.19141198034510415
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.5960927165572599
      weight: 0.114412400199558
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9588873226257536
      weight: 0.23210466929877763
- sources:
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6540253815457119
      weight: 0.26676253628350277
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.6064521456724821
      weight: 0.32731913275227376
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.37939168265170087
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9044341556516037
      weight: 0.20490518434022081
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.858245861387603
      weight: 0.17917087234350287
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.6882844641154083
- sources:
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.007150508817157786
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9563254040190147
      weight: 0.09103575098086883
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.43790175373766804
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9486698828297574
      weight: 0.0818669239466478
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.39833013977879245
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7181908348870916
      weight: 0.24121561497284677
- sources:
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.10882054979448666
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7543537234549338
      weight: 0.12479083340438962
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.0708097726950752
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.333948814242619
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8977007951960791
      weight: 0.10298756332912873
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.4794089660108718
      weight: 0.21087998893169188
- sources:
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9370115576544044
      weight: 0.02842206610649345
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.25557990331445146
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.06247100876710021
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.3388392565514537
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3756061798577917
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.10009126737493823
- sources:
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9556503508646775
      weight: 0.3970244378117722
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.19285762221371153
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.9020002055955054
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8420359869052865
      weight: 0.05429678307661277
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8067384349045997
      weight: 0.11235997530357353
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.14904022052788152
- sources:
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9434911210556413
      weight: 0.2548247050531814
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9719378514337645
      weight: 0.15819291099062346
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.04398329584656263
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.6918354532568436
      weight: 0.0854102139896491
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.22535807455552204
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.35693881247164805
- sources:
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9319467891271266
      weight: 0.29058568002907836
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7952244776117314
      weight: 0.17910477728880925
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7956790509562062
      weight: 0.1438684581908245
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.825456233455119
      weight: 0.21040956342605738
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2711380048826145
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.1213323922087308
- sources:
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.10540127798604942
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.30234245332173515
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.48360309114201594
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.5199760376551235
      weight: 0.15791172185500307
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8229819309620275
      weight: 0.20292181858545125
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.130673858806438
- sources:
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.3389908967120333
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.8098832799175976
      weight: 0.032729969813799886
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.06556489588048102
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9606585552315425
      weight: 0.39112937866501835
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.10151217876708106
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9147776170708031
      weight: 0.3361818039402313
- sources:
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.07553646917615456
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.18713681607621746
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8066647125365156
      weight: 0.1377407178430086
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7942981092851459
      weight: 0.15258533005989686
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9317818891985491
      weight: 0.1917799304294585
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.014887699641953689
- sources:
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.20840025067571885
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9782399449646568
      weight: 0.2328438946903973
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8995390693540155
      weight: 0.03203001507470046
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.931359822067464
      weight: 0.23927051033346863
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.32001222942808727
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.10925837419057471
- sources:
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.41651154278513103
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.15562043474854753
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.010757564378272605
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8076181360972706
      weight: 0.32394761313424586
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9479478932638606
      weight: 0.21045149780131678
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.05057244982605083
- sources:
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8236658041251139
      weight: 0.21321322044720487
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9543216813136639
      weight: 0.11263172588937082
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9709605318433385
      weight: 0.3523451529485697
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.3040953041306902
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.17186154702391532
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9068299422142455
      weight: 0.05240246428051881
- sources:
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.09508672685600689
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.22133149029323637
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7669173526006674
      weight: 0.08057282883798367
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.0913965000724602
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.5634995238181923
      weight: 0.013003111064234352
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.0463173781438628
- sources:
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7737123104466118
      weight: 0.17942861257500786
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.29415458383167614
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.4348355267146788
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.18303269950667883
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9713390697352875
      weight: 0.22507337047150916
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8137903764931057
      weight: 0.04079562353601332
- sources:
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.047062104611051064
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.16846088469030315
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7880602717133516
      weight: 0.2789583731212955
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.32352529491682286
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8949399037061117
      weight: 0.2545484290147384
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.09517685873313844
- sources:
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8358580272764898
      weight: 0.2855837708760959
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.41479888008593596
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.2550535659664166
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.28139845163428256
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8980539982908744
      weight: 0.12713384155889973
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.004351098386697783
- sources:
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.38857173097398257
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.14163401231091394
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8868499716013419
      weight: 0.25483408300091354
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8490612361146361
      weight: 0.3838493668524031
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2134383937085923
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.29351791671961525
- sources:
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7592788632718213
      weight: 0.21580100444026937
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.11563748273172356
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8238278678209028
      weight: 0.12046149405569524
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7027924239196756
      weight: 0.08545622694966344
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.11400029849999294
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.1385923431877603
- sources:
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.26847461441506426
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9989059042448725
      weight: 0.02755706551909709
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.29454458599205624
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.21027571525323657
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.05698290419859764
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7984875107617855
      weight: 0.008106935637840706
- sources:
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.06730944082274636
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.056144623361766885
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9456462618822497
      weight: 0.14816750915525348
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9456887334985299
      weight: 0.010656517207506516
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.18034550821096046
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.2614189069253616
- sources:
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.09036514284084263
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.2793847527781395
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7823494966044564
      weight: 0.1918617933005795
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.06742144092010083
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.08939312333251181
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.833744405837781
      weight: 0.2569366887908943
- sources:
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.204580104229255
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.5650841458103742
      weight: 0.05931790715471086
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.778532619712101
      weight: 0.19801357088299154
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8282432512063711
      weight: 0.3503101423420888
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.16037771860597982
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.056630800646782664
- sources:
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8102173034683241
      weight: 0.17436162327079358
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.053046951706820056
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.27843953938291616
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.15918211869367555
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8007638182050225
      weight: 0.032818586693711294
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.17033249682303778
- sources:
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.09624555984301572
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.5571652220837998
      weight: 0.04953328492569409
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.041116739637920924
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.17225873901498326
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.5226491226347826
      weight: 0.2782408228603738
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.3032589409329551
- sources:
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9304345418952316
      weight: 0.032364817446169286
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.39179869867982725
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8150966766025997
      weight: 0.02288042804967988
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.1789626519265678
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8910058256154507
      weight: 0.20471189803004364
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.13970624095073508
- sources:
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8053976349102374
      weight: 0.2840366733935171
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9537785616138238
      weight: 0.04358059246606438
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.24477013102149628
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9585712571206357
      weight: 0.37102592178522487
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8998251608652412
      weight: 0.39569695763453694
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.14637293332966364
- sources:
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.898055237651287
      weight: 0.057788054342290326
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.24981253173887333
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7804588723814723
      weight: 0.44130754723160515
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8842003107758944
      weight: 0.0008712317185377572
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.11582432992359575
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8776343698470468
      weight: 0.12743969299538765
- sources:
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.01377373448756325
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.925005411207583
      weight: 0.31944303509866195
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8762567459720589
      weight: 0.2990916989904438
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.30495949216462254
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8839795316361178
      weight: 0.24258010470545116
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.12604448444251193
- sources:
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.724670014865185
      weight: 0.24511684858463265
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.4349914719295033
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.2026461684035123
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.2051083755305495
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.08276720148098043
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9009273902277648
      weight: 0.1254339189305163
- sources:
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9466214229369014
      weight: 0.3403510978774423
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.17569006036341767
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.019809874547022877
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.057565875154789975
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8381886677136565
      weight: 0.0737289532231587
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.892209341014166
      weight: 0.24307087184793097
- sources:
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9951552547915052
      weight: 0.19712510079989057
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.5619165612671431
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8781048804500454
      weight: 0.26190386780513264
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7316121364951871
      weight: 0.13798543588037673
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.28118540067796494
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9768004959403602
      weight: 0.10847809141549553
- sources:
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.007750679801211385
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.08089462228857118
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8393212930792688
      weight: 0.22937555333464804
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9793604094050525
      weight: 0.07184083460820315
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9182862858497272
      weight: 0.4506195904381331
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.16547976349593468
- sources:
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.4665122813434508
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.851187623811185
      weight: 0.061043514475124655
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.565587088161311
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.11058276936579046
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.18513626419830287
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9388107295104234
      weight: 0.4570799451538212
- sources:
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9948294171948843
      weight: 0.03137695207967589
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.6675709065596998
      weight: 0.3221447497043656
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9587013647644738
      weight: 0.10573015996836115
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.12008206027963769
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.0765927728276577
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.3810624649836515