gghfez/gemma-3-control-vectors

gghfez/gemma-3-control-vectors

Creative Writing control-vectors for:

gghfez/gemma-3-27b-novision and gghfez/gemma-3-12b-novision

Usage example

llama.cpp

llama-server --model  gemma-3-27b-novision-Q4_K.gguf [other CLI arguments] \
    --control-vector  gemma-3-27b-it-optimism_vs_nihilism_nihilism.gguf \
    --control-vector  gemma-3-27b-it-optimism_vs_nihilism_debias.gguf \
    --control-vector  <other vectors>

Sample of the 27b with Nihilism turned up (too high)

Prompt: "Write a short uplifting story about a girl walking home from work"

Response:

The chipped heel of her shoe clicked a monotonous rhythm against the sidewalk. Another shift at the diner. Another parade of lukewarm coffee orders and vacant stares. Brenda hadn’t spoken a full sentence to a human being since a customer complained his burger was “too pink.”

The sky was that perfect, depressing grey. Not rain, just a thick, oily cloud cover that promised nothing. She’d walked this route a thousand times. Same peeling posters, same overflowing bins, same bored dogs eyeing her progress.

Then, a flash of pink.

A kid, maybe six, was meticulously building a tower of plastic flamingos on someone’s lawn. He was wearing bright yellow swim trunks and a serious expression. He didn’t acknowledge her, just kept stacking the pink plastic birds, each one slightly askew, creating a monument to suburban despair.

She stopped.

It was…impressive. A little terrifying, honestly.

He finally looked up, saw her, and gave a curt nod.

“They’re all judging you,” he said, flatly.

Brenda almost smiled.

“Naturally,” she said.

He went back to his tower. She kept walking.

The air still tasted like exhaust, the sidewalks were still cracked, but suddenly, the walk felt… cleaner. The pink flamingos had injected a precise, petty elegance into the evening. They weren’t for anything, they weren't about anything. They just were.

She almost felt… good.

A small, brittle satisfaction. Like a perfectly lukewarm coffee.

She’d almost forgotten to feel something.

And the kid, the little architect of plastic despair, had reminded her.

She speeded up, eager to get home and watch something equally pointless on TV.

It was progress.

Trained on 1xH100NVL using a modified version of jukofyork's control-vectors to support Gemma3.

Based off Version v3.0 of creative-writing-control-vectors-v3.0.

See here for more info about control-vectors creative-writing-control-vectors-v3.0