Untitled

This model is the result of merge of the following models made with flow-merge:

  • Base model:
    • Qwen/Qwen1.5-0.5B
  • Models:
    • Qwen/Qwen1.5-0.5B-chat
    • minghaowu/Qwen1.5-0.5B-OpenHermes-2.5

flow-merge config

The following configuration was used to merge the models:

base_model: Qwen/Qwen1.5-0.5B
models:
- path_or_id: Qwen/Qwen1.5-0.5B
- path_or_id: Qwen/Qwen1.5-0.5B-chat
- path_or_id: minghaowu/Qwen1.5-0.5B-OpenHermes-2.5
method: addition-task-arithmetic
device: !!python/object/apply:flow_merge.lib.constants.DeviceIdentifier
- cpu
method_global_parameters:
  scaling_coefficient: 0.7
  normalize: false
directory_settings:
  cache_dir: null
  local_dir: ./models
  output_dir: ./merged_model
Downloads last month
18
Safetensors
Model size
619M params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.