Unleash your model Creativity with LoRA AI Model

This AI Experiment involved Lora AI Models technique, textual inversion from Realistic Vision V2 model which was in the GB size. Thanks to Low Rank Adaption Technique it was fine tuned and boiled down to the order of 100mb and performing specific style adaptation. Techniques like VAE (Variational Autoencoders) are also used to give a smooth output.

To increase computational efficiency: ESRGAN superresolution neural networks are used to enhance the resolution of the image. Its faster to increase the superresolution than to generate directly at super high resolution. The Generation time increases exponentially high.

Furthermore, our model is combined with a Variational Auto Encoder trained onto https://laion.ai/blog/laion-aesthetics/ and finetuned from original https://github.com/CompVis/latent-diffusion#pretrained-autoencoding-models.

This finetuning on LAION enables the model to gives this photographic glossy touch. Furthermore we use Low Rank Adaptation to quickly finetune the model with the style of futuristic Avatars and star wars. There is another model merged into (https://github.com/cloneofsimo/lora)

ControlNet was also used as well Monocular Depth Image Estimation to move the characters in the picture and regenerate from OpenPOSE.

AI Futristic Black Dress

Positive Prompt

masterpiece,ultra high res, (photorealistic:1.4), raw photo, casual portrait of (21 year-old girl:1.3), leather jacket, compact body, ((cyberpunk,scifi)), refined detailed lora:add_detail:1

Negative Prompt

Asian-Less-Neg, canvas frame, cartoon, 3d, ((disfigured)), ((bad art)), ((deformed)),((extra limbs)),((close up)),((b&w)), blurry, (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), Photoshop, video game, ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, 3d render, (((nsfw))), (tiara), (crown), (badhands)

Sampler:

DPM++ 2M Karras

Black and White Variation 2

Positive Prompt

photo of young girl, modelshoot style, dirty blonde hair, short hair, (looking at viewer:1.2), (detailed pupils:1.3), (natural light), (seductive), [: (film grain, 25mm, f/1,2, DoF, bokeh, beautiful face, ultra detailed skin, perfect sparkling eyes, skin pores, vellus hair, muscle tone and definition, fabric stitching, fabric texture, wood grain, stone texture, well defined pupils, prominent limbal ring, high contrast eyes, finely detailed features:0.7):0.7]

Negative Prompt

Asian-Less-Neg, canvas frame, cartoon, 3d, ((disfigured)), ((bad art)), ((deformed)),((extra limbs)),((close up)),((b&w)), blurry, (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), Photoshop, video game, ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, 3d render, (((nsfw))), (tiara), (crown), (badhands)

Black and White Variation 3

Positive Prompt

masterpiece,ultra high res, (photorealistic:1.4), raw photo, casual portrait of (21 year-old girl:1.3), leather jacket, compact body, ((cyberpunk,scifi)), refined detailed lora:add_detail:1

Negative Prompt

Asian-Less-Neg, canvas frame, cartoon, 3d, ((disfigured)), ((bad art)), ((deformed)),((extra limbs)),((close up)),((b&w)), blurry, (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), Photoshop, video game, ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, 3d render, (((nsfw))), (tiara), (crown), (badhands)

Variation 4

Positive Prompt

masterpiece,ultra high res, (photorealistic:1.4), raw photo, casual portrait of (21 year-old girl:1.3), leather jacket, compact body, ((cyberpunk,scifi)), refined detailed lora:add_detail:1

Negative Prompt

Asian-Less-Neg, canvas frame, cartoon, 3d, ((disfigured)), ((bad art)), ((deformed)),((extra limbs)),((close up)),((b&w)), blurry, (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), Photoshop, video game, ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, 3d render, (((nsfw))), (tiara), (crown), (badhands)