flux-natural-12-09-int8

This is a LyCORIS adapter derived from black-forest-labs/FLUX.1-dev.

The main validation prompt used during training was:

An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed.

Validation settings

• CFG: 4.0
• CFG Rescale: 0.0
• Steps: 20
• Sampler: None
• Seed: 42
• Resolution: 1344x768

Note: The validation settings are not necessarily the same as the training settings.

You can find some example images in the following gallery:

Prompt

unconditional (blank prompt)

Negative Prompt

blurry, cropped, ugly

Prompt

In this enchanting scene, a colossal full moon, glowing with an ethereal light and drenched in golden hues, dominates the sky in the background, casting reflections on a serene lake below. The moon's surface is intricately detailed with deep craters and luminous spots, creating a surreal, fantastical element. Silhouetted in the foreground, a stately tree with dense foliage stands beside a tranquil shoreline, its branches and leaves intricately outlined against the twilight sky. Further along the horizon, darkened shadows of distant trees create a mysterious and calming expanse, hinting at the wilderness beyond. The sky is dotted with twinkling stars, enhancing the magical ambience of the night. Thick, mystical clouds ripple through the scene, adding depth and dynamism to the atmosphere. The serene water of the lake mirrors the brilliant glow of the moon, creating rippling patterns that shimmer and dance in the night. The overall mood is a blend of tranquility and enchantment, with uniform clarity and vivid colors throughout. The intense otherworldly light from the moon and the detailed textures in the foreground and background together produce a scene filled with harmonious clarity and surreal beauty, making every element stand out in the magical landscape.

Negative Prompt

blurry, cropped, ugly

Prompt

This idyllic alpine scene captures a serene lake nestled between lush green hills and towering mountains capped with snow. A wooden chalet, located on a gently sloping hill, overlooks the vibrant turquoise waters of the lake, its spacious balcony offering sweeping views of the breathtaking landscape. The surrounding meadows are dotted with colorful wildflowers, and tall trees line the hillsides, blending harmoniously with the forested mountains in the distance. Beyond the lake, a small village can be seen, framed by majestic peaks that rise sharply against a bright blue sky adorned with fluffy white clouds. The crystal-clear water reflects the sky and the surrounding greenery, enhancing the tranquility of the scene. Every detail, from the texture of the grass to the snow on the distant mountains, is rendered with vibrant clarity, evoking a sense of peace and natural beauty in this picturesque mountain retreat.

Negative Prompt

blurry, cropped, ugly

Prompt

This picturesque landscape captures a breathtaking view of an alpine valley where a tranquil lake nestles among lush green hills. Snow-capped mountain peaks tower in the background, creating a dramatic contrast with the vivid greenery and deep blue waters. A winding path, flanked by wildflowers and fresh grass, leads the eye through the scene, inviting exploration into this pristine environment. The foreground is dotted with yellow and purple wildflowers, adding splashes of color that enhance the natural beauty of the area. Patches of trees scattered across the hillsides and along the lake's edge provide depth and texture to the landscape. Above, fluffy white clouds float in a clear blue sky, casting soft shadows on the mountains and reflecting the serene atmosphere of this peaceful retreat. The entire scene is bathed in bright, natural light, highlighting the rich details and vibrant colors of this idyllic mountain setting.

Negative Prompt

blurry, cropped, ugly

Prompt

A serene, dreamlike landscape unfolds beneath a massive full moon that hangs low in the sky, casting its silver glow over a tranquil lake. The moon's soft light reflects on the still water, surrounded by lush, evergreen trees that form a dense forest on either side of the lake. In the distance, the silhouettes of rolling mountains are bathed in the vibrant hues of a twilight sky, blending pink, purple, and orange as stars begin to twinkle. The foreground is dotted with wildflowers in shades of pink and white, their delicate petals illuminated by the moonlight. The atmosphere is calm and otherworldly, with the sky's gradient colors and the gentle light creating a peaceful, magical ambiance. Every detail, from the intricate textures of the flowers to the rippling reflections in the water, is vividly highlighted by the moon's ethereal glow, evoking a sense of tranquility and wonder.

Negative Prompt

blurry, cropped, ugly

Prompt

In this enchanting nighttime scene, a serene landscape unfolds under the luminous glow of a full moon, casting a mystical light over the entire setting. Graceful lotuses, adorned with delicate pink and white petals, bloom amidst vibrant green lily pads that float effortlessly on a tranquil lake. The flowers, some in full bloom and others budding, create a harmonious, natural arrangement predominantly in the foreground, extending gracefully towards the right and left edges of the scene. The background reveals a vast, still body of water reflecting the shimmering moonlight, bordered by silhouettes of distant trees and undulating hills shrouded in the subtle haze of the night. Above, a crisp, star-studded sky completes the ethereal atmosphere, with twinkling stars scattered across the deep blue canvas, enhancing the surreal and dreamlike mood of the scene. The entire image is enveloped in vivid colors, consistent magical light, and intricate details that ensure every element, from the reflective water to the delicate petal veins, is equally prominent and clear, creating a vivid, otherworldly ambiance. The lighting accentuates the textures and ethereal tones, producing a surreal atmosphere where the scene appears uniformly crisp and intensely luminous, achieving a harmonious balance of clarity and mystique.

Negative Prompt

blurry, cropped, ugly

Prompt

In an enchanted forest illuminated by a golden light, a cascading series of crystal-clear waterfalls shimmer with an ethereal blue hue as they flow gently down a rocky terrain, meandering through the lush green vegetation and moss-covered stones. The forest floor is alive with bioluminescent plants and flowers glowing in soft shades of purple and blue, creating a magical path that leads deeper into the mystical woods. Ancient trees with enormous, sprawling roots stand majestically, their branches entwined in a canopy that filters the light, casting intricate patterns on the ground. Tiny, luminous fireflies float whimsically throughout the scene, adding to the dreamlike quality. There are also a few rustic lanterns placed along the edge of the stream, their warm light blending seamlessly with the natural glow of the forest. The overall atmosphere is serene and mysterious, evoking feelings of wonder and enchantment in this fantastical world. The scene is portrayed with rich detail and consistent magical light, highlighting the intricate textures of the foliage, the surreal tones of the water, and the delicate luminescence of the fireflies to create a harmonious clarity throughout the image, with vivid colors and an intense, otherworldly light, punctuating the enchanted mood.

Negative Prompt

blurry, cropped, ugly

Prompt

In the center of a calm, mystical lake, a perfectly balanced stack of smooth, rounded stones rises prominently, symbolizing tranquility and balance. This curiously sculpted cairn, composed of stones of varying sizes from large at the base to small at the top, seems to float just above the water, as if defying gravity. The serene waters mirror the arrangement, creating a symmetrical reflection that amplifies its surreal presence. Surrounding the lake, a tranquil forest gently embraces the scene with tall, silhouetted trees that merge into the misty horizon. The setting sun bathes the sky in hues of warm amber, soft pink, and gentle orange, casting an ethereal glow across the entire landscape. The atmosphere is peaceful and meditative, accentuating the magical tranquility that envelops this fantasy world. This ethereal scene is infused with rich detail and color, from the luminous sunset to the subtly reflective water, ensuring that every stone, every ripple, and the distant outlines of trees stand out with vivid clarity. The lighting captures every aspect with a harmonious clarity, bringing out detailed textures and creating a high contrast yet serene atmosphere, filling the scene with an intense, otherworldly light that enhances its magical and surreal qualities.

Negative Prompt

blurry, cropped, ugly

Prompt

In an enchanting, mythical glade, a statue of Buddha sits serenely at the center of the frame, exuding an aura of tranquility and spiritual calm. The Buddha statue, carved from stone and adorned with intricate details, is positioned on a lush green lotus pedestal that floats amidst a serene pond. Vibrant pink and white lotus flowers bloom around the statue, adding a touch of natural beauty to this sacred scene. Surrounding the Buddha, a cascade of ethereal waterfalls glistens in the ambient mystical light, flowing gently from rocky heights covered in vivid green moss and vegetation. The background reveals a secluded, magical forest bathed in soft, soothing light, with towering trees and delicate shafts of sunlight piercing through the foliage, highlighting the surreal beauty of the landscape. The entire scene is adorned with vivid colors, consistent magical light, and detailed textures that make the ethereal tones and intricate background come alive. The harmonious clarity, high contrast, and intense otherworldly light ensure every element is vividly portrayed, creating a scene where nothing is obscured and the serene, surreal atmosphere is palpable.

Negative Prompt

blurry, cropped, ugly

Prompt

An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed.

Negative Prompt

blurry, cropped, ugly

The text encoder was not trained. You may reuse the base model text encoder for inference.

Training settings

• Training epochs: 0
• Training steps: 10000
• Learning rate: 0.0001
• Effective batch size: 1
  • Micro-batch size: 1
  • Gradient accumulation steps: 1
  • Number of GPUs: 1
• Prediction type: flow-matching
• Rescaled betas zero SNR: False
• Optimizer: adamw_bf16
• Precision: Pure BF16
• Quantised: Yes: int8-quanto
• Xformers: Not used
• LyCORIS Config:

{
    "algo": "lokr",
    "multiplier": 1.0,
    "linear_dim": 10000,
    "linear_alpha": 1,
    "factor": 16,
    "apply_preset": {
        "target_module": [
            "Attention",
            "FeedForward"
        ],
        "module_algo_map": {
            "Attention": {
                "factor": 16
            },
            "FeedForward": {
                "factor": 8
            }
        }
    }
}

Datasets

data-12-09-512

• Repeats: 10
• Total number of images: 271
• Total number of aspect buckets: 1
• Resolution: 0.262144 megapixels
• Cropped: False
• Crop style: None
• Crop aspect: None

data-12-09-1024

• Repeats: 10
• Total number of images: 269
• Total number of aspect buckets: 1
• Resolution: 1.048576 megapixels
• Cropped: False
• Crop style: None
• Crop aspect: None

data-12-09-512-crop

• Repeats: 10
• Total number of images: 271
• Total number of aspect buckets: 1
• Resolution: 0.262144 megapixels
• Cropped: True
• Crop style: random
• Crop aspect: square

data-12-09-1024-crop

• Repeats: 10
• Total number of images: 271
• Total number of aspect buckets: 1
• Resolution: 1.048576 megapixels
• Cropped: True
• Crop style: random
• Crop aspect: square

Inference

import torch
from diffusers import DiffusionPipeline
from lycoris import create_lycoris_from_weights

model_id = 'black-forest-labs/FLUX.1-dev'
adapter_id = 'pytorch_lora_weights.safetensors' # you will have to download this manually
lora_scale = 1.0
wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_id, pipeline.transformer)
wrapper.merge_to()

prompt = "An illustration of a serene landscape at night, moonlit mountain scene, tall pine trees on a small island, snow-capped mountains in the background, still lake reflecting trees and full moon, cloud-speckled sky dotted with stars, soft ambient lighting, primary color tones of blue and white, ambient and tranquil atmosphere, high resolution, extremely detailed."

pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu')
image = pipeline(
    prompt=prompt,
    num_inference_steps=20,
    generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(1641421826),
    width=1344,
    height=768,
    guidance_scale=4.0,
).images[0]
image.save("output.png", format="PNG")