Open LLMs/DavidAU

Open-Weight LLM · Private & Custom AI

Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF

A 18.4B mixture-of-experts creative writing and roleplay engine designed for self-hosted deployment where uncensored, high-volume prose generation and creative task automation matter more than safety guardrails.

This is a Llama 3.2 8X3B MOE model (Apache 2.0) that merges eight 3B experts into a single 18.4B parameter unit, optimized for fiction, storytelling, and creative roleplay with minimal refusal rates. An ops AI team would use it to automate narrative-heavy workflows, content generation pipelines, or creative automation tasks while retaining full data privacy in their own environment.

Unknown
Parameters
apache-2.0
License (OSI/permissive)
Unknown
Context
39.7k
Downloads

Model facts

DeveloperDavidAU
ParametersUnknown
Context windowUnknown
Licenseapache-2.0 — OSI/permissive
Tasktext-generation
GatedNo
Downloads39.7k
Likes580
Updated2026-04-28
SourceDavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF

Private deployment

Run Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF in your own environment

Self-hostable via GGUF quantization on 16GB+ VRAM cards (estimates: 10–14GB for IQ4XS, higher for full precision). Deploy via LMStudio, Text-Generation-WebUI, KoboldCPP, or llama.cpp server. No cloud calls; all data stays in-house. Speed: 50+ tokens/sec on low-end 16GB GPU (2 experts), scales with quant level and expert count. Requires llama3 or Command-R prompt template.

Operational AI use cases

01

Automated Story & Scenario Generation for Training/Testing

Generate synthetic narrative scenarios, test plots, or dialogue sequences for training datasets, simulation environments, or QA testing without external APIs. Adjust expert count (2–8) and temperature for variety; supports 128k context for long-form outputs.

02

Creative Content Automation for Internal Communications

Automate internal documentation, procedural storytelling, or process narratives (e.g., onboarding stories, case study prose). Bias toward longer, detailed outputs reduces need for manual rewrites; uncensored nature suits frank, unfiltered internal comms.

03

Roleplay-Driven Customer Simulation & Support Workflow Testing

Simulate customer personas or dialogue sequences for support training, scenario testing, or agent robustness validation. High instruction-following and MOE gating allow fine-grained control over character consistency and response tone.

Custom AI

As a base for custom AI

Strong base for custom creative AI products: fiction-generation APIs, interactive storytelling platforms, or roleplay-driven SaaS tools. MOE architecture allows tuning expert mix per domain (e.g., horror, romance, technical fiction). Abliterated models in the merge reduce refusal overhead; custodians can wrap with safety layer if needed. GGUF format enables edge deployment.

In the operating system

Where it fits

**Knowledge/Agent Layer**: feeds creative or narrative-driven workflows. Can chain into downstream agents (e.g., plot validator, character consistency checker). **Workflow Layer**: automates scenario/story generation steps in larger ops pipelines. Not suited for retrieval-augmented generation (RAG) or structured data extraction; best paired with specialized retrieval or tagging models upstream.

Data control & security

Fully self-hosted deployment keeps all prompts, generation history, and outputs within company infrastructure—no cloud logging or third-party model calls. This is an *architectural* privacy benefit, not a model-level guarantee. NSFW/uncensored outputs remain the company's responsibility to filter or govern; model itself contains no built-in content filters. Data residency compliance (GDPR, HIPAA, etc.) depends on infrastructure setup, not the model.

Hardware footprint

**Estimate (GGUF quantization)** - IQ4XS: ~10–11 GB VRAM (production baseline) - Q4_K_M: ~12–13 GB - Q5_K_M: ~14–15 GB - Full bfloat16: ~37–40 GB Figures assume single expert inference; MOE gating may add 1–2% overhead. Test on target hardware.

Integration

GGUF format integrates into llama.cpp ecosystem and Python/JS wrappers (LlamaIndex, LangChain, Ollama). Set expert count via CLI flag (`--override-kv llama.expert_used_count=int:N`), API payload (`num_experts_used`), or UI (LMStudio, WebUI). Supports flash attention for throughput gains. Works with DRY/Dynamic Temp/Quadratic samplers for output quality tuning. Requires llama3 or Command-R template; rep penalty 1.02+ recommended.

When it's not the right fit

  • Strict compliance/safety is required: model is intentionally abliterated and uncensored; refusal rates ~9.25%. Wrapping with external safety filters adds latency.
  • Structured data extraction or semantic search: built for prose generation, not ranking, retrieval, or entity parsing. Use alongside specialist models for RAG or tagging tasks.
  • Sub-millisecond latency critical: 50+ tokens/sec is good for creative tasks but not real-time chat or sub-second SLA workflows.
  • General-purpose instruction-following in constrained domains: lower-quality instruction-following vs. Llama 3.1 70B or GPT-4; better for creative flex than rigid task protocols.

Alternatives to consider

Llama 3.1 8B Instruct

Smaller, faster, stronger instruction-following; no MOE overhead; better for strict ops automation. Trade-off: lower creative prose quality, higher refusal rates.

Mistral 7B Instruct

Leaner, easier to deploy; strong instruction-following; better for structured ops tasks. Lacks creative writing optimization and MOE flexibility.

Llama 3.2 1B or 3B (standard)

Single-expert baseline for lower-latency ops pipelines; easier to run on edge hardware. Lower prose quality and context length; no MOE sampling benefit.

FAQ

Can I run this fully private, without any cloud dependency?

Yes. Download the GGUF, deploy via llama.cpp, LMStudio, or WebUI on your infrastructure. All inference, context, and outputs stay on your hardware. No external API calls.

What does 'abliterated' mean, and can I use this commercially?

Abliterated means safety fine-tuning has been partially or fully removed to reduce refusals. Apache 2.0 license permits commercial use, including in products. You are responsible for governing uncensored outputs in production (e.g., content filtering, user policies).

How do I tune output variety or style?

Adjust number of experts (2–8 via CLI or UI), temperature (0–5 supported, 1+ for variety), and sampling method (DRY, Dynamic Temp, Quadratic recommended). Different GGUF quantizations also produce slightly different outputs.

Is this suitable for customer-facing chatbots or support automation?

Only if you add upstream content governance and safety wrapping. Model is uncensored by design. It excels at scenario/persona simulation for internal training; external-facing deployment requires additional filtering and tone controls.

Build Your Private AI Operating System with LLM.co

Deploy this uncensored MOE model as part of a self-hosted, custom AI stack. LLM.co helps you wire open-weight models into ops workflows, keep data in-house, and scale creative or narrative automation without cloud vendors. Let's talk.