mathexpert7b is a merge of the following models further aligned by Direct preference optimization.
Files info