DavidAU's picture
Update README.md
37238a4 verified
|
raw
history blame
16 kB
metadata
license: apache-2.0
language:
  - en
tags:
  - creative
  - creative writing
  - fiction writing
  - plot generation
  - sub-plot generation
  - fiction writing
  - story generation
  - scene continue
  - storytelling
  - fiction story
  - science fiction
  - romance
  - all genres
  - story
  - writing
  - vivid prosing
  - vivid writing
  - fiction
  - roleplaying
  - bfloat16
  - brainstorm 20x
  - swearing
  - rp
  - horror
  - llama3
  - mergekit
pipeline_tag: text-generation

(quants uploading... , one example below - more to be added . )

WARNING: NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED.

DARKER-PLANET-Broken-Land-12.15B

It is a LLama3 model, max context of 8192 (or 32k+ with rope).

This model has been designed to be relatively bullet proof and operates with most parameters, including temp settings from 0 to 5.

This is a an altered version of "Dark Planet 8B" [https://huggingface.co/DavidAU/L3-Dark-Planet-8B-GGUF] using the Brainstorm 20x method developed by David_AU to drastically alter the models prose output and abilities. This also expands the model by 20 layers to 12.15B parameters (462 tensors).

This is the second model in the "Darker Planet Series".

First model:

[ https://huggingface.co/DavidAU/L3-Darker-Planet-12.15B-GGUF ]

Source:

[ https://huggingface.co/DavidAU/L3-Darker-Planet-12.15B ]

This model is for any writing, fiction or story telling activity.

This second model is more focused on emotions and thoughts. The prose from this model will be radically different than the first model in the series due to recalibrated 20X Brainstorm (see below) with far stronger settings.

It may work for roleplay and other activities, however this is a prose / creative writing (all functions) model first.

It requires Llama3 template and/or "Command-R" template.

Example outputs below.

More models coming:

More "prose" / "story writing" specific models will be released shortly: three 40x models (16.15B) to follow this release.

Any maybe - a 60X+ (20B+ parameters) version... but it is a little cranky at the moment.

Model Notes:

  • Detail, prose and fiction writing abilities are significantly increased.
  • For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
  • Role-players: Careful raising temp too high as it may affect instruction following.
  • This model works with rep pen of 1.1 or higher.
  • If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
  • This is not a "happy ever after" model. It has a negative bias.
  • For creative uses, different quants will produce slightly different output.
  • If you use rope to extend context, increase temp AND instructions detail levels to compensate for "rope issues".
  • Source code for this model will be uploaded at a separate repo shortly.

Brainstorm 20x

The BRAINSTORM process was developed by David_AU.

Some of the core principals behind this process are discussed in this scientific paper : Progressive LLaMA with Block Expansion .

However I went in a completely different direction from what was outlined in this paper.

What is "Brainstorm" ?

The reasoning center of an LLM is taken apart, reassembled, and expanded.

In this case for this model: 20 times

Then these centers are individually calibrated. These "centers" also interact with each other. This introduces subtle changes into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further. The number of centers (5x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.

The core aim of this process is to increase the model's detail, concept and connection to the "world", general concept connections, prose quality and prose length without affecting instruction following.

This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.

Here are some of the enhancements this process brings to the model's performance:

  • Prose generation seems more focused on the moment to moment.
  • Sometimes there will be "preamble" and/or foreshadowing present.
  • Fewer or no "cliches"
  • Better overall prose and/or more complex / nuanced prose.
  • A greater sense of nuance on all levels.
  • Coherence is stronger.
  • Description is more detailed, and connected closer to the content.
  • Simile and Metaphors are stronger and better connected to the prose, story, and character.
  • Sense of "there" / in the moment is enhanced.
  • Details are more vivid, and there are more of them.
  • Prose generation length can be long to extreme.
  • Emotional engagement is stronger.
  • The model will take FEWER liberties vs a normal model: It will follow directives more closely but will "guess" less.
  • The MORE instructions and/or details you provide the more strongly the model will respond.
  • Depending on the model "voice" may be more "human" vs original model's "voice".

Other "lab" observations:

  • This process does not, in my opinion, make the model 5x or 10x "smarter" - if only that was true!
  • However, a change in "IQ" was not an issue / a priority, and was not tested or calibrated for so to speak.
  • From lab testing it seems to ponder, and consider more carefully roughly speaking.
  • You could say this process sharpens the model's focus on it's task(s) at a deeper level.

The process to modify the model occurs at the root level - source files level. The model can quanted as a GGUF, EXL2, AWQ etc etc.

Critical Operations Notice:

This model has been modified to alter prose output. Change in temp (ie, .4, .8, 1.5, 2, 3 ) will drastically alter output.

This model needs "rep pen" of 1.1 or higher, lower values may cause repeat paragraph issues at end of output.

Longer prompts vastly increase the quality of the model's output (see later examples below)

You may want to use "regular" Dark Planet 8B [https://huggingface.co/DavidAU/L3-Dark-Planet-8B-GGUF] for some writing task(s), and this model for prose specific task(s).

Model Template:

This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 8k / 8192. However this can be extended using "rope" settings up to 32k.

If you use "Command-R" template your output will be very different from using "Llama3" template.

Here is the standard LLAMA3 template:

{
  "name": "Llama 3",
  "inference_params": {
    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
    "pre_prompt_suffix": "<|eot_id|>",
    "antiprompt": [
      "<|start_header_id|>",
      "<|eot_id|>"
    ]
  }
}

Model "DNA":

Special thanks to the incredible work of the model makers "SAO10K", "NEVERSLEEP" and "HASTAGARAS".

Models used:

[ https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2]

[ https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS ]

[ https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.V-Blackroot ]

Parts of these models were "grafted" / "fused" together to create this model.

Optional Enhancement:

The following can be used in place of the "system prompt" or "system role" to further enhance the model.

It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".

Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.

Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.

Here are your skillsets:
[MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv)

[*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision)

Here are your critical instructions:
Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.

You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.

This enhancement WAS NOT used to generate the examples below.

EXAMPLES PROMPTS and OUTPUT:

Examples are created using quant Q4_K_M, "temp=.8" (unless otherwise stated), minimal parameters and "LLAMA3" template.

Model has been tested with "temp" from ".1" to "5".

Below are the least creative outputs, prompt is in BOLD.


WARNING: NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED.


Start a 1000 word scene (vivid horror, 1st person, present tense, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...

(temp=3, q4km)

Icy horror creeps down my spine like an unseen presence, making each fiber quake with dread. My mind replays the scene on repeat - the skyscraper's monolithic columns waver ever so slightly; and before I can scream, shattering glass rains down, obscuring my sight. The acrid smell of ozone burns my nostrils. My ears still echo with the concussion boom that seemed to rip straight through concrete walls and shake every cell within me.

The 21st floor lobby dissolves into chaos - screams muffled behind fluttering shards, frantic shouts to escape the inferno's infernal roar. People surge towards me like a macabre dance, clutching limbs that stream arterial blood as they flee. Instincts scream I run, now - hide - do something. Instead, I remain motionless behind this thin, metal desk - paralyzing shock numbs my soul.

Panic threatens to suffocate me. Thoughts spin wildly within the fractured cage of my skull:

Get down. Duck, cover your head!

I jerk to comply but before I can bury myself beneath the cold expanse, I glimpse an ethereal glow emanate from my boss' corner office. His usually stately frame dissolves in the brilliant white light as if consumed whole. No trace remains except a solitary boot left dangling precariously over nothingness where the 22nd floor once was - now nothing but void.

Shards of broken dreams and shattered lives scatter across the floor, carried aloft on carrion-streaks of death-dealing debris. Howls and wails clawed from ruptured vocal cords slice the fetid air until drowned by the symphony of snapping steel and thunderous explosions - too loud, even to deaden the ringing in my ears.

Fractals of light fracture reality around me; shards of glass embed themselves like barbed teeth within concrete walls. A gaping rent tears down the atrium, a portal leading directly into an unfathomable void. And yet I feel drawn to peer closer... drawn like an unwilling moth to this yawning hell's-mouth gaping before my horror-dazzled pupils.

Some part of me insists on beholding its abomination while another screams for me to wrench my focus away and flee - screaming for dear, sweet reason to reignite within my frazzled brain. Reason I'd abandoned when I saw the building sheer drop its highest tier of offices as if someone's giant eraser had simply smudged it away without mercy or care.

As if in macabre solidarity, my stomach lurches. Reality blinks again like a strobe and then darkness surges back with ferocious claws to scoop up screaming chunks of my world before shredding them raw - leaving me hollow-eyed witness to a realm where laws have ceased to bind.

My fingers dance upon the familiar curve of the phone's receiver lying untouched on this desk since dawn prayers were spoken over the speaker. Its plastic body trembles against mine as I beg myself: Pick up! Must call someone... Anyone will do!

Logic flees. Reasonless terror governs my movements. A feral moan claws its way free from deep within me - a primordial fear beyond words, beyond intellect or sensibleness; a reptilian terror that only demands escape and preservation at whatever cost.

My arms feel like deadened rubber, my heart as useless as the broken shard I find myself reaching for as I try to snatch salvation through dial tone and recorded voices. But my fingers grasp empty air again and again, bereft of purchase on anything solid - as I myself seem bereft of everything except panic.

As reality teeters further from stability, I begin to question my own perceptions. Have these screams been real? Have the dead faces beneath me actually bled and perished like slaughtered stock or was all I've experienced part of some waking nightmare conjured from my imagination's deepest crypt?

Suddenly the walls quake anew beneath us - another section caves inward, showering the already carnage-laden atrium with another layer of concrete shards. Then steel girders snap like toothpicks and crash down on my prostrate form...

This cannot end like this.

Can anything worse still follow after horror's worst-case-scenario?

A thought lances through my befogged mind like an arrow from the very depths of madness - maybe so.

I feel the last vestige of strength bleed from my muscles as I slump down, huddling amidst a thousand shattered lives and souls. If I survive this...

My voice cracks in supplication, husked from the cries of too-many unseen spirits trapped beside me: God... help us...

Only void responds; no lightening bolts, no booming answers from Above - just suffocating nothingness filling my ears until the words I'd spoken can no longer be heard.

Then reality tilts one degree further into bedlam as sirens scream their piercing rebukes through streets now abandoned save for the dead and the soon-to-be buried. Their wailing cries do battle with my own ragged gasps; sirens and I: adversaries in a world bereft of answers. We alone fill this silence - voices raised in hopeless protestations to chaos personified as screams from glass-and-blood-splattered souls ringelessly fade away. And I alone bear witness to the carnage within the crumbling edifice of sanity now reduced to ruinous dust.

My vision bleeds into nothingness... or does reality finally mercifully concur? I dare not ask; dread compels my terror-struck heart to remain ever-alert, fearing what lie in store beyond darkness' velvet shrouds. Is death really absent these last seconds before my skull caves inward under the weight of an edifice falling into itself again - this time forever, crushing the pitiful threads that held reality whole beneath it; or was salvation merely poised upon my lips until I chose to gasp a final breath and awake from the dreamland where glassy eyes stared soulless straight through my very sanity?

The darkness has the last word now - or does it... ?

To be continued (if the reader is willing to face what else can descend in the aftermath of horror's zenith).