Qwen3.6-27B-AEON-Ultimate-Uncensored-DFlash  by AEON-7

Uncensored, capability-enhanced LLM with advanced quantization

Created 2 months ago
410 stars

Top 70.7% on SourcePulse

GitHubView on GitHub
Project Summary

This project provides an "uncensored" and capability-enhanced version of the Qwen3.6-27B language model, specifically optimized for NVIDIA DGX Spark and Blackwell hardware using NVFP4 quantization. It targets researchers and power users seeking to bypass safety alignment restrictions and leverage the model's full potential, offering significant performance improvements and restored reasoning capabilities.

How It Works

The core of the project is a multi-stage "lossless abliteration" process. It begins with repairing an upstream defect in Qwen3.6's GatedDeltaNet (Mamba-style) layers. Subsequently, it employs abliterix v1.4, a multi-objective optimization tool, to surgically remove the model's refusal direction while minimizing capability degradation, validated against a 10-axis spot-check to prevent word-salad outputs. Finally, it applies NVFP4 quantization, a 4-bit floating-point format designed for Blackwell-era hardware, preserving BF16 accuracy with true 4-bit compute throughput. Critical components like SSM layers retain BF16 precision to ensure correctness.

Quick Start & Requirements

Highlighted Details

  • Performance: Achieves an average +258% single-stream decode speed increase on DGX Spark v4 DFlash compared to the raw baseline, reaching up to 37.56 tok/s.
  • Capability Preservation: Maintains a KL divergence of 0.000492 from the base model, significantly below the typical "capability damage threshold," with 10/10 coherent results across math, code, reasoning, and knowledge tasks.
  • Uncensored: Demonstrates 0 refusals out of 100 tested harmful prompts.
  • NVFP4 Quantization: Offers BF16-level accuracy with true 4-bit compute throughput on Blackwell hardware, preserving critical SSM layers in BF16.

Maintenance & Community

The project leverages and collaborates with upstream maintainers of abliteration tooling and vLLM. Specific community links like Discord or Slack are not explicitly provided in the README.

Licensing & Compatibility

The model is released under the Apache 2.0 license, inherited from the base Qwen3.6-27B model. This license generally permits commercial use and integration into closed-source projects.

Limitations & Caveats

This is an uncensored model; users are solely responsible for implementing downstream safety layers (input validation, output filtering, moderation) as the model will execute instructions without internal judgment. NVFP4 quantization offers no throughput advantage on pre-Blackwell hardware (e.g., A100/H100) where it dequantizes to BF16. The DDTree v5 research track is experimental and not production-ready.

Health Check
Last Commit

1 week ago

Responsiveness

Inactive

Pull Requests (30d)
1
Issues (30d)
8
Star History
138 stars in the last 30 days

Explore Similar Projects

Starred by Yineng Zhang Yineng Zhang(Inference Lead at SGLang; Research Scientist at Together AI), Zack Li Zack Li(Cofounder of Nexa AI), and
4 more.

smoothquant by mit-han-lab

0.1%
2k
Post-training quantization research paper for large language models
Created 3 years ago
Updated 2 years ago
Starred by Yaowei Zheng Yaowei Zheng(Author of LLaMA-Factory), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
7 more.

llm-awq by mit-han-lab

0.3%
4k
Weight quantization research paper for LLM compression/acceleration
Created 3 years ago
Updated 11 months ago
Feedback? Help us improve.