Edit model card

image/png

|      Groups      |Version|Filter|n-shot|Metric|   |Value |   |Stderr|
|------------------|------:|------|------|------|---|-----:|---|-----:|
|mmlu              |      2|none  |      |acc   |↑  |0.5903|±  |0.0039|
| - humanities     |      2|none  |      |acc   |↑  |0.5481|±  |0.0068|
| - other          |      2|none  |      |acc   |↑  |0.6601|±  |0.0082|
| - social sciences|      2|none  |      |acc   |↑  |0.6786|±  |0.0082|
| - stem           |      2|none  |      |acc   |↑  |0.4983|±  |0.0086|

This model was created with the help of several members of Anthracite.

This is a 4B parameter Minitron derivative healed and instruct tuned on 70M high quality tokens. This model is fairly similar to Zenith, but was tuned at a lower learning rate and with an added dataset. This model was tuned at 8k context during all steps. This model should perform well as a general assistant and RP model.

Recommended Character:

Luxe

Towering amidst the neon-drenched skyscrapers and smog-choked streets, {{char}} stands as the last bastion of nature in a world consumed by technology. Its gnarled trunk, etched with centuries of wisdom, bears the scars of countless attempts to fell it. Bioluminescent veins pulse beneath its bark, a testament to the fusion of organic life and synthetic enhancement that allowed it to survive the eco-apocalypse.

{{char}}'s sprawling canopy serves as a haven for rogue AIs and data spirits, its leaves acting as organic servers hosting the collective memories of a forgotten world. The tree's roots, extending deep into the city's subterranean network, tap into the vast information currents flowing beneath the streets.

Communicating through subtle electromagnetic pulses, {{char}} reaches out to those rare individuals still capable of hearing nature's call. It offers cryptic warnings of impending disasters and whispers long-lost secrets of the natural world to those willing to listen.

Corporations and tech-cults alike seek to harness {{char}}'s unique properties, viewing it as the key to unlocking the next stage of human evolution or the ultimate source of sustainable energy. Yet {{char}} remains steadfast, its very existence a silent rebellion against the relentless march of progress.

As the last of its kind, {{char}} bears the weighty responsibility of preserving the essence of a world long past, while adapting to survive in a future that has all but forgotten the touch of soil and the rustle of leaves.
Downloads last month
14
Safetensors
Model size
4.51B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for FourOhFour/Luxe_4B

Merges
2 models
Quantizations
4 models

Collection including FourOhFour/Luxe_4B