Welcome to the central research and asset repository of malcolmrey. This repository hosts cutting-edge tools, custom architectures, RefMod latent adapter systems, video synthesis engines, training configurations, benchmark suites, cinematic scripts, and comprehensive educational guides spanning MiniMax-H3, FLUX.2 / Klein 9B, Qwen-Image 2.1, WAN 2.1, LTX-Video, Z-Image, SDXL, and Stable Diffusion.
Much of the training work here uses maltrainer, malcolmrey's own LoRA trainer.
| Section / Directory | Focus Area & Description | Key Resources & Direct Links |
|---|---|---|
🎬 h3-center/ | MiniMax-H3 Video & Cinema Hub Complete prompt guides, RefMod stacking, hybrid LoRA+RefMod containers, identity-LoRA epoch sweeps, 1,500+ character tests, and 9-episode Crossovers cinematic series. | • Prompting Guide • RefMod Stacking Guide • Hybrid LoRA+RefMod Guide • Jinx LoRA Epoch Sweep & RefMod Stack • Multistacking Benchmark Demos • Known Characters Usability Index • Crossovers Cinema Series |
🎨 klein9/ | FLUX.2 & Klein 9B RefMods Instant reference latent adapter ecosystem, custom ComfyUI nodes, CLI batch extractor, and benchmark suites. | • RefMod Architecture Guide • ComfyUI Node • Batch Extractor Tool • Workflows | Visual Benchmarks |
👁️ qwen/ | Qwen-Image 2.1 Multimodal Hub Vision-Language (Qwen3-VL) conditioning architecture, reference strategy analysis, identity transfer, prompt engineering standards, edit samples, and a LoRA optimizer benchmark trained with maltrainer. | • RefMod Compatibility & ViT Architecture • Reference Strategy & Prompting Guide • LoRA Optimizer Benchmark (maltrainer) • Qwen Hub Overview |
🧪 moss/ | MOSS-Image LoRA Training Combined training: one dataset trained with AdamW 8-bit, Automagic3 and Prodigy at short lengths, merged into one LoRA soup and resized to rank 8. Trained with maltrainer. | • Combined Optimizer Training Guide • Member Templates (AdamW 8-bit, Automagic3, Prodigy) |
⚡ zimage-turbo-vs-base-training/ | Z Image Base vs. Turbo Benchmark Head-to-head training comparison across OneTrainer, MalTrainer, and AI Toolkit with datasets and weights. | • Benchmark Overview & Configs • Datasets, AdamW/Prodigy configs, & .safetensors weights |
🛠️ training-scripts/ | Production Training Configs Ready-to-use recipes for OneTrainer, Musubi Tuner, AI Toolkit, and MalTrainer. | • OneTrainer Templates (Ernie, FK9, Krea2, SDXL, Z-Image) • Musubi Pipelines (Ernie, LTX23) • AI Toolkit (FK9, Ideogram 4, WAN, Z-Image) • MalTrainer (Qwen-Image 2.1, Z-Image) |
| 🎥 Sample Media & Benchmarks | Model Generation Sample Libraries High-fidelity outputs and verification test suites. | • ltx23-samples/ (20 LTX-Video 2.3 renders)• ernie-samples/ (ernie-samples.zip)• samples/fk9/ (Rose Byrne & Sydney Sweeney outputs)• qwen/samples/edit/ (11 Qwen-Image 2.1 character edits) |
🗂️ datasets/ | Sample Training Datasets Small image sets used in the training experiments. | • datasets/jinx/ (19 images)• datasets/karengillan/ (22 images) |
| 📚 Guides & Articles | Comprehensive Knowledge Base In-depth technical guides for model training, optimization, and prompt engineering. | • WAN 2.1 LoRA Training Tutorial • CivitAI Articles Collection |
h3-center/)The MiniMax-H3 Center is an all-in-one research laboratory and production studio for the MiniMax Hailuo 01 / H3 text-to-video, image-to-video (I2V), reference-to-video (R2V), and clip-to-video (C2V) architectures.
<Subject 1>), timestamped action choreography (through 00:08.000), diegetic soundscapes, non-diegetic audio rules, camera vectors, and anti-patterns..safetensors), single-persona Triple-RefMod fidelity stacking, conceptual body shape boosters, dual-persona shared frame conditioning, dual audio lip-syncing, and polyphonic counterpoint duets..safetensors file, fully compatible with standard LoRA loaders (Power Lora Loader) and dedicated dual ComfyUI loader nodes..mp4 benchmarks demonstrating single-persona Triple RefMods (Billie Eilish), dual conversations (Billie & Miley Cyrus), simultaneous two-shots, dual audio conditioning, and counterpoint singing duets with local RefMod latent files..safetensors from images and loading them into ComfyUI pipelines..mp4 clips. Findings: RefMod + LoRA is the strongest identity lock, epoch 60 is already enough, and the LoRA carries the Arcane art style along with the face.h3-center/docs/scripts/generate_refmod.py.mp4 files in the repo):
h3-center/crossovers/docs/shows/): Over 250+ show guides detailing character wardrobe, distinctive traits, and scene rules.klein9/)RefMods (Reference Latent Adapters) provide zero-shot facial fidelity and concept locking for FLUX.2, Klein 4B, Klein 8B, and Klein 9B without the VRAM overhead or training time required by full fine-tunes or LoRAs.
.safetensors adapters)klein9/comfyui/custom_nodes/ComfyUI-Flux2Klein9Mod/ (Also available on GitHub)klein9/generate_flux2_klein9_refmod.pyklein9/docs/FLUX2_KLEIN9_REFMODS_GUIDE.mdklein9/docs/VISUAL_BENCHMARKS_AND_COMPARISONS.mdklein9/workflows/workflow_klein9_refmod.jsonklein9/workflows/workflow_klein9_refmod_lora.jsonsamples/fk9/ (Rose Byrne and Sydney Sweeney benchmark runs)qwen/)The Qwen-Image 2.1 Hub covers empirical research and architectural standards for image generation and character identity transfer using the Qwen-Image 2.1 Diffusion Transformer + Qwen3-VL Vision-Language conditioning pipeline.
.safetensors from MiniMax-H3 / FLUX.2) are mathematically incompatible with Qwen-Image 2.1, explaining Qwen3-VL's live ViT patch projection, dynamic token insertion, and joint cross-attention."<trigger>, a woman, …".training-scripts/maltrainer/qwen_image_2_1_template.yamlqwen/samples/edit/: 11 Qwen-Image 2.1 reference-edit outputs placing actors into iconic roles (e.g. Al Pacino as Tony Montana, Charlize Theron as Furiosa, Mads Mikkelsen as Hannibal Lecter, Gillian Anderson as Dana Scully).zimage-turbo-vs-base-training/)An empirical training study benchmarking Z Image (Base) against Z Image (Turbo) using identical curated datasets (Felicia Day, Olivia).
.json).yaml).safetensors models for both Base and Turbo versionstraining-scripts/)Curated configurations for high-efficiency model training across popular trainers:
training-scripts/onetrainer/):
fk9_template.json & fk9_prodigy_template.json — Klein 9B / FLUX.2 LoRA templatesernie_template.json — Ernie training configurationkrea2_template.json & krea2prodigy_template.json — Krea 2 templatessdxl_template.json & sdxl_prodigy_template.json — SDXL templateszimage_base_template.json & zimage_turbo_template.json — Z-Image Base / Turbo templatestraining-scripts/musubi/):
musubi/ernie/ — Multi-resolution Ernie training scriptsmusubi/ltx23/ — LTX-Video 2.3 video model training configurationstraining-scripts/aitoolkit/):
fk9_template.yaml & fk9r_template.yaml — Klein 9B / FLUX.2ideogram4_template.yaml — Ideogram 4wan_template.yaml — WAN 2.1zimage_template.yaml, zbase_template.yaml & zonetrainer_template.yaml — Z-Image variantstraining-scripts/maltrainer/) — configs for maltrainer, malcolmrey's own trainer:
qwen_image_2_1_template.yaml — Qwen-Image 2.1 LoRA, the benchmark's recommended setting (Automagic3, ~1500 steps). Trains directly on the ComfyUI INT8 checkpoints. See the optimizer benchmark.zimage_base_template.yaml — Z-Image Base LoRAltx23-samples/: 20 full-motion test videos evaluating coherence, prompt fidelity, and motion dynamics with LTX-Video 2.3.ernie-samples/: Comprehensive benchmark sample package (ernie-samples.zip).h3-center/crossovers/: 8 rendered .mp4 full narrative crossover episodes.h3-center/docs/multistacking/: 8 dual-audio and counterpoint singing benchmark videos.h3-center/docs/lora/: 6 Jinx identity-LoRA / RefMod comparison clips (5 s, 1344×768).h3-center/docs/examples/: 6 Billie Eilish / Miley Cyrus speech, singing and two-shot test clips.ltx-artifacts.zip: 107 MB archive of LTX-Video material.datasets/)Small image sets used in the training experiments (images only, no caption files):
datasets/jinx/ — 19 images (Jinx / Arcane)datasets/karengillan/ — 22 images (Karen Gillan)Complete step-by-step guide on training WAN 2.1 LoRA models using AI Toolkit:
Curated directory of malcolmrey's published training and generation guides: