Adds the second quantization, type:5 q4_2

Adds the second quantization, type:3 q4_1

Adds the first quantization, type:2 q4_0

Begins with pickled h5 converted to GGML f16, doing this in pieces this time so it doesn't take 8 hours to upload

initial commit