Instructions to use prithivMLmods/Qwen3.5-27B-Unredacted-MAX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use prithivMLmods/Qwen3.5-27B-Unredacted-MAX with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="prithivMLmods/Qwen3.5-27B-Unredacted-MAX") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("prithivMLmods/Qwen3.5-27B-Unredacted-MAX") model = AutoModelForImageTextToText.from_pretrained("prithivMLmods/Qwen3.5-27B-Unredacted-MAX") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use prithivMLmods/Qwen3.5-27B-Unredacted-MAX with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "prithivMLmods/Qwen3.5-27B-Unredacted-MAX" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "prithivMLmods/Qwen3.5-27B-Unredacted-MAX", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/prithivMLmods/Qwen3.5-27B-Unredacted-MAX
- SGLang
How to use prithivMLmods/Qwen3.5-27B-Unredacted-MAX with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "prithivMLmods/Qwen3.5-27B-Unredacted-MAX" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "prithivMLmods/Qwen3.5-27B-Unredacted-MAX", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "prithivMLmods/Qwen3.5-27B-Unredacted-MAX" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "prithivMLmods/Qwen3.5-27B-Unredacted-MAX", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use prithivMLmods/Qwen3.5-27B-Unredacted-MAX with Docker Model Runner:
docker model run hf.co/prithivMLmods/Qwen3.5-27B-Unredacted-MAX
Qwen3.5-27B-Unredacted-MAX
Qwen3.5-27B-Unredacted-MAX is an optimized release built on top of huihui-ai/Huihui-Qwen3.5-27B-abliterated. This version focuses on updated model sharding, repository optimization, and compatibility improvements for the latest Transformers releases, while preserving the reasoning and instruction-following capabilities of the base model. The result is a powerful 27B parameter language model designed for stable inference, efficient deployment, and modern ecosystem integration.
This model is intended for research and learning purposes only. Any outputs generated by this model are the sole responsibility of the user. The authors and hosting platform disclaim all liability for generated content. Users must ensure safe, ethical, and lawful usage.
Base Model Signatures:
This model has been re-sharded and optimized for the latest Transformers version from the base model: https://huggingface.co/huihui-ai/Huihui-Qwen3.5-27B-abliterated
Key Highlights
Optimized Packaging & Sharding Improved repository structure for smoother downloads, loading, and deployment workflows.
Stable Transformers Compatibility Updated layout for better compatibility with modern Transformers versions and inference runtimes.
27B Parameter Architecture Built on Qwen3.5-27B, providing strong reasoning capacity and scalability.
Efficient Deployment Design Structured for reliable inference across local, cloud, and multi-GPU environments.
Preserved Model Behavior No changes to weights or core architecture; performance remains consistent with the original model lineage.
Improved Loading Reliability Reduced friction in initialization and distributed inference setups.
Quick Start with Transformers
pip install transformers==5.3.0
# or
pip install git+https://github.com/huggingface/transformers.git
from transformers import Qwen3_5ForConditionalGeneration, AutoProcessor
import torch
model = Qwen3_5ForConditionalGeneration.from_pretrained(
"prithivMLmods/Qwen3.5-27B-Unredacted-MAX",
torch_dtype="auto",
device_map="auto"
)
processor = AutoProcessor.from_pretrained(
"prithivMLmods/Qwen3.5-27B-Unredacted-MAX"
)
messages = [
{
"role": "user",
"content": [
{"type": "text", "text": "Explain how transformer models work in simple terms."}
],
}
]
text = processor.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
inputs = processor(
text=[text],
padding=True,
return_tensors="pt"
).to("cuda")
generated_ids = model.generate(**inputs, max_new_tokens=256)
generated_ids_trimmed = [
out_ids[len(in_ids):] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
]
output_text = processor.batch_decode(
generated_ids_trimmed,
skip_special_tokens=True,
clean_up_tokenization_spaces=False
)
print(output_text)
Intended Use
Multimodal and Language Research Studying large-scale transformer behavior and inference characteristics.
Red-Teaming & Evaluation Testing robustness across complex and adversarial prompts.
High-Performance Deployment Running large models on optimized GPU or distributed inference setups.
Research Prototyping Experimentation with scalable transformer architectures and deployment strategies.
Limitations & Risks
Important Note: This model inherits the behavior and limitations of its base model.
Output Variability Responses may vary depending on sampling settings and prompt structure.
Resource Requirements A 27B model requires significant GPU memory or optimized inference strategies such as quantization or tensor parallelism.
Deployment Constraints Performance depends heavily on hardware configuration and runtime optimization.
General Model Limitations May produce incorrect, incomplete, or inconsistent outputs in complex scenarios.
- Downloads last month
- 12
Model tree for prithivMLmods/Qwen3.5-27B-Unredacted-MAX
Collection including prithivMLmods/Qwen3.5-27B-Unredacted-MAX
Evaluation results
- Abliteration Rateself-reported93.500
