radna/NEW-Fuse-DeepSeek-R1-AIME-2

NEW-Fuse-AIME-2

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 as a base.

Models Merged

The following models were included in the merge:

• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842

Configuration

The following YAML configuration was used to produce this model:

base_model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
dtype: bfloat16
merge_method: dare_ties
parameters:
  int8_mask: 1.0
  normalize: 0.0
slices:
- sources:
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.2782315873972385
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.19635741093400924
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.839041420919602
      weight: 0.1393051419022209
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9049838949212962
      weight: 0.007949192496240043
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6368696615921805
      weight: 0.03283807920340641
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.34339904488021705
- sources:
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8298629387880676
      weight: 0.012178045683612151
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.2742647165349933
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.3118824904882318
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.20820237912448977
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6882884993390114
      weight: 0.32931098839032225
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7541644143115471
      weight: 0.5283350552564068
- sources:
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.1475972757877593
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.36006129832521916
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.6383637368643884
      weight: 0.2417455775856331
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9634617790683426
      weight: 0.30988574000828395
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2123327378847143
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9745011611918509
      weight: 0.26417975152408857
- sources:
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.15769046109738702
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.1523214821495638
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.037213704935742886
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7497177917163473
      weight: 0.2861632132956589
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.7215595383344846
      weight: 0.4606348758519766
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.0003362236275280678
- sources:
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6910337109786082
      weight: 0.24392684897607322
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9710965496454345
      weight: 0.012635998710707627
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.4860547857824506
      weight: 0.23402390666045142
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7500944911682366
      weight: 0.2572776682722997
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.08365043313088268
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9810133262115704
      weight: 0.3613481642532599
- sources:
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6741956384738605
      weight: 0.37578743779124096
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9072174733548687
      weight: 0.07625416776300153
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8744591420309692
      weight: 0.408177109381669
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.2683692653545862
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.06686054697269289
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8449084919956413
      weight: 0.4488419163177444
- sources:
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.11629103922432293
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.09563282389416433
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9904373561782471
      weight: 0.11994247597890378
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9299436120275166
      weight: 0.22834226407956734
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.11512519202646376
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9445172175266126
      weight: 0.21318549805793088
- sources:
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.18798747602597987
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7452937123126001
      weight: 0.14746911601895424
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8204977104998925
      weight: 0.19134291787306087
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9737073791320208
      weight: 0.4983379958659422
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.867081025278063
      weight: 0.05096153597806359
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8793745878128797
      weight: 0.23915742179684527
- sources:
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9908584743786936
      weight: 0.2900964369859359
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.6770121314397981
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.7421772684770622
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.1288360821322317
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.19588203535256857
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9647488315759917
      weight: 0.05954407329266449
- sources:
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.051952322557393654
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7705586830846688
      weight: 0.5733745872563619
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.1970853442522889
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8717807909710711
      weight: 0.0908833911515223
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.7908247294988782
      weight: 0.1845905936365468
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8746886550244568
      weight: 0.12012453127168171
- sources:
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.5901488666433586
      weight: 0.4132454940186627
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.6564276215102214
      weight: 0.05482864296740633
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.5363622563055074
      weight: 0.1806790978658725
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9962626071178531
      weight: 0.0641105089408362
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.11302650096438938
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.935821018848516
      weight: 0.4976548707302226
- sources:
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.19900912406353574
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.20695001682401898
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9178868704524388
      weight: 0.485866085043937
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8777643958740872
      weight: 0.3914734004939914
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.03205146584371449
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.18556656278840403
- sources:
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.20656175990330095
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7968900729582112
      weight: 0.3317709752868623
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.27491910682117465
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9894580466554811
      weight: 0.036643107048087105
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.28862007087718894
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7487264086943679
      weight: 0.4032155957575983
- sources:
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.10288506772457816
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.25240385899016365
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.24112069713536738
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.17970681579851688
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9880840219872322
      weight: 0.09375379195324154
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.5146485259568411
- sources:
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8246319334241813
      weight: 0.37830969105567097
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.18310637878417466
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.1878731334364966
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9988962548231595
      weight: 0.068783579040219
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.059252156826440756
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.06399965153945208
- sources:
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7671711029056976
      weight: 0.08279825270344171
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.4832191061533638
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.43397801143478104
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9301793901319233
      weight: 0.060057556519650085
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3291053018368783
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.09163179667175611
- sources:
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.585335562539892
      weight: 0.23990667870923393
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9501246198992629
      weight: 0.14501212433260446
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8142622747372522
      weight: 0.17718360841131947
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9588318274545542
      weight: 0.48150382002080344
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.126230462170154
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.4892312413786961
      weight: 0.24269527765600346
- sources:
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9709385013773042
      weight: 0.07104163819906398
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9907919866060557
      weight: 0.0007542843250286091
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9460559808768376
      weight: 0.2752973549458865
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9983533282926503
      weight: 0.15966873618588628
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6921736257955359
      weight: 0.0015923913647673538
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.31390324400321623
- sources:
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7207752757241536
      weight: 0.20938924032120507
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.806331369611605
      weight: 0.014409611142731926
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.36097342241865993
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7531577043031259
      weight: 0.09689525515688532
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.6318999013401043
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7670284456767872
      weight: 0.08004223909034286
- sources:
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.15219459605986607
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7917787133894402
      weight: 0.18033705157266788
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8590518812159822
      weight: 0.24947137503137812
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.054118308616569924
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9244409534965156
      weight: 0.04720723246789843
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.32589512367293716
- sources:
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8974635885630745
      weight: 0.4724663033132477
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.11510664715241947
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9235295631691169
      weight: 0.042695431127009076
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.11133339509681325
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.4454395094657316
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7815707892292135
      weight: 0.3716666021599484
- sources:
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.20445075642606872
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.08520193692835092
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7772131139869718
      weight: 0.005731024920312133
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.6351582798252953
      weight: 0.2567372966508105
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9992444948886876
      weight: 0.0809572690618752
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.4178172190398364
- sources:
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9964683534245098
      weight: 0.23152496012989637
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.019642782853222324
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.19345821213830322
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8259775627246622
      weight: 0.1710965828934345
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9655374347532074
      weight: 0.1304630777907399
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.45493316692535235
      weight: 0.07600846212926438
- sources:
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6721109403298298
      weight: 0.2356891503907223
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.10387151135694028
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7836152755374957
      weight: 0.07899479075913782
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7825729304855489
      weight: 0.24000742240862422
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9821688259769421
      weight: 0.2354263414935049
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.21874627666822238
- sources:
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9392645214321065
      weight: 0.19031861752847407
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.16765974328240574
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9550931808653395
      weight: 0.0393875764308524
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.98045839892385
      weight: 0.5243868032740402
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9441593866734689
      weight: 0.03683392304225987
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8671662108560604
      weight: 0.2053450649145078
- sources:
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.09710053670860862
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9523988152047644
      weight: 0.11779751921107934
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.5430552965743557
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.25258751641790106
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.20005994269627547
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9541301284421821
      weight: 0.34044100626643836
- sources:
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.28336897808636863
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7840965294605414
      weight: 0.12993902081988035
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8777576583284323
      weight: 0.35922131109052746
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8085516370560839
      weight: 0.5589123218741695
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2878091149491125
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.5738334493450006
- sources:
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6925825193976535
      weight: 0.21465740887083135
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7151740929979256
      weight: 0.2411662207956331
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.0601582880630152
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.27109660295620275
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.67885599604793
      weight: 0.5739501338116965
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.37288477352244037
- sources:
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7117475160844768
      weight: 0.026680088358767312
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.43206913052299967
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.6825346935306619
      weight: 0.3848004265440627
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.1174486809204486
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.03446883068163623
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.17279716303611553
- sources:
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6310034358888048
      weight: 0.12510510698935506
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.12123624320328882
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.21813157440017286
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7177540094279146
      weight: 0.1353882392476031
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.1881689886549915
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7305809384923427
      weight: 0.376818424193501
- sources:
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8993640320922442
      weight: 0.10196945523086967
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.5034086235375271
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.6942204155040704
      weight: 0.1338853027545463
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.5028174851551407
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8843818959138889
      weight: 0.18100811409305972
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.16104353135766042
- sources:
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7904228187317733
      weight: 0.43698500576059274
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.5936095539512497
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.14769236332694313
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.32773931635626724
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.011977893279050605
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.951087230384274
      weight: 0.13846355395798557
- sources:
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.5405192410937041
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.43111899126718234
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9551387881134268
      weight: 0.22687281842086082
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.873842693623591
      weight: 0.16884088867211666
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.28988835450802036
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9628483492164649
      weight: 0.28613172963789724
- sources:
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9660432462038945
      weight: 0.1794102626672678
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.5677260098192384
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8606352805654085
      weight: 0.31532457675577374
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.02959242060013658
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.24939191288685683
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.3425950191564526
- sources:
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6721312070848626
      weight: 0.12024261675706371
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.019202127824589216
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.30326296676546083
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.16136044813224878
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8758256653555511
      weight: 0.10297032302601486
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.10140112186794767
- sources:
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8213652326986552
      weight: 0.025122172830659414
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.07105756794027786
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.18392576209300893
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.20689669056513565
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9855597569074632
      weight: 0.014505769298279403
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.944905419404809
      weight: 0.15640978099711594
- sources:
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9435305974227193
      weight: 0.21865101700794948
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3665913818417759
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.2326236606988492
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.31748463039847885
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6510288624800707
      weight: 0.2794996180603957
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7756816509977775
      weight: 0.39386186811472035
- sources:
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8471466862455088
      weight: 0.1054419594045002
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9616794829960454
      weight: 0.043352142042583044
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.31957748249992324
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.02782699112527924
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8172565934314691
      weight: 0.1277490198636007
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8572198669303388
      weight: 0.22670446700028396
- sources:
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7108000073584617
      weight: 0.14925746902562262
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7947544560681823
      weight: 0.0711535777774904
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.0827474861731709
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.21147448956539472
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.22620021391358253
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9110748174290368
      weight: 0.6500310835503815
- sources:
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.0020954267426730594
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7974646792001101
      weight: 0.31506886844439824
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.15473405497359374
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8730840189168834
      weight: 0.11377520350754662
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.22172514394701104
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.045832021359076935
- sources:
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.40617426548358937
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7293174204491722
      weight: 0.18765270592674677
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.07782987965295007
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.5964778321159088
      weight: 0.3882928650086385
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2931422056675209
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9163024077820021
      weight: 0.22943743711338963
- sources:
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9632090369890876
      weight: 0.102078915644014
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.6623465226007259
      weight: 0.15912099272885613
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.2555144977628281
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.22493138386177133
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.7965620645278113
      weight: 0.3488203269613851
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.511154852086326
      weight: 0.08526320902249696
- sources:
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.6366405856168433
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.30068502897912774
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9537313606839656
      weight: 0.17094172082484585
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9584256353781965
      weight: 0.10215932540697358
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9741621393637496
      weight: 0.397153527257189
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.944947078669692
      weight: 0.02182087356037161
- sources:
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6589519722788534
      weight: 0.24922615456400055
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7355957820471619
      weight: 0.47067521934612006
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.17869005019437223
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.029740284638674896
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9066172053744459
      weight: 0.4690665585114081
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.26857497847644474
- sources:
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7322189781528857
      weight: 0.04220887442606691
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3927460815806082
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.1776425311464363
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9111422043244886
      weight: 0.07019459222990815
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8927447142902996
      weight: 0.3203847503770507
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.3062471241146648
- sources:
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.018248569758602007
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.47581471574830314
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.1402055666753047
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.01690887852775419
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.18114560999104787
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9328123915780923
      weight: 0.06302157151314448
- sources:
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8273736951212698
      weight: 0.14670372972572973
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.5117048774533038
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9859786039118714
      weight: 0.013636747101578778
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.2014433972478546
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9937470311597871
      weight: 0.01735028806980282
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7810778382468737
      weight: 0.07828387109196101
- sources:
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7883109207887593
      weight: 0.02129674787906119
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.12692348389073616
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9682184167024662
      weight: 0.03941603422714035
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.044210621164719355
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.14971915383704015
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.5972169931826233
      weight: 0.05602522459520403
- sources:
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.028867226889573883
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.31826427696469695
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.062101442235530574
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8580212133028511
      weight: 0.14925021642324868
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2997249902505159
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.4567488915611886
- sources:
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.3887546798623643
      weight: 0.22250851848434627
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.29918010727072736
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.0006963799120076053
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.5196794348046012
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.16886829950429177
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.21169831684759394
- sources:
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9263984426155888
      weight: 0.46208117066898613
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.26513336920610525
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9842480696543732
      weight: 0.2606511991191279
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8321555646679069
      weight: 0.260037744419943
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3362202749259709
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7799505656336573
      weight: 0.2148809629948658
- sources:
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9456014782497077
      weight: 0.2684329744931154
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9218159685802345
      weight: 0.04447382443778326
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.12634547595280862
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.0345938092305072
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.17063364496157324
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.050232899418394705
- sources:
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.08075549628007361
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7558578759683025
      weight: 0.22688105172640147
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9132175305169759
      weight: 0.6284259023072631
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.16826756744339957
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.22804881825097434
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.984122045513045
      weight: 0.27033565277425947
- sources:
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9255767405080507
      weight: 0.37663767730586784
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7234368969266856
      weight: 0.1658160463398735
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8532059590120992
      weight: 0.43706964196670706
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.04771119856381902
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.5919569102221742
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.22963281435189492
- sources:
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.3475997473426404
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.8161329387790792
      weight: 0.03648533113218805
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9028789366865357
      weight: 0.3371401502028399
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.5021778754503483
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6278797730584087
      weight: 0.037325139532396634
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.3936120888548632
- sources:
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7388750662277602
      weight: 0.2151193971005742
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.5399766405483633
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.10442143666781545
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8263488485859503
      weight: 0.06485929066641631
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.743026202579836
      weight: 0.014638125069511204
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8227894425909675
      weight: 0.11892832059734368
- sources:
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.38393582684841193
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.24201730267713273
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.26007076742470825
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.08422385804581514
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.0036992660024722512
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7514939139207344
      weight: 0.3451997072846399
- sources:
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.33871613921258287
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.048182597743439665
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.011651172527993914
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8160849831431859
      weight: 0.11424646832766437
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3931983123342998
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7171727264220018
      weight: 0.10929452652254812
- sources:
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.22497978384478687
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7768256950509063
      weight: 0.10479639369472392
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.145637724965138
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.12241569680355846
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.883279950825221
      weight: 0.5532199243057724
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.06739967651517345
- sources:
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8844073333555544
      weight: 0.1938231280257878
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7891270799908772
      weight: 0.16010268470615255
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.4343278594861103
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.389752137962742
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9016217999214565
      weight: 0.2505204090631463
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.1977767156949726
- sources:
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.2543523020344591
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9662968003254059
      weight: 0.18615431697974158
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9113337809225843
      weight: 0.07920949500135421
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.11878279057630278
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.7952742674123203
      weight: 0.16118019976313275
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.031103198183016406
- sources:
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.05410447775552422
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9104633681153931
      weight: 0.30571810831172763
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9154645628329681
      weight: 0.27927303553096483
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.0761595032045365
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.869901125974021
      weight: 0.22816111210614895
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7806001258108655
      weight: 0.09188340518847221
- sources:
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.09551963768037755
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.8646175386347293
      weight: 0.24410971068987242
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.895326932093959
      weight: 0.47378092599141397
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.18318460294204425
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6660708817741321
      weight: 0.18328269352991441
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8814742970830101
      weight: 0.5453905534189657
- sources:
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7504478590156137
      weight: 0.36513314401521524
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3744076494258641
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.026651943167621095
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9059698105875248
      weight: 0.1505532240067479
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.04263662107328934
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.3274436147282644