cragsand, (edited ) to ai

I learned how to train LoRa AI models using open source StableDiffusion...

For the purpose of recreating the appearance of my 3D VR roleplaying character the results I got were amazingly good... almost frighteningly so.

I'll go through the process, results and some thoughts.

🧵 part 1of4

cragsand, (edited )

So much of the majority of AI art I see is terrible, bad looking and deformed. But with the right instruction's it doesn't have to be.

To accurately create fictional characters, this is probably the best method I've seen so far. There's work involved for training a model like this and not something you can just give a bunch of prompts and expect good results.

I started by gathering 64 screenshots of my 3D VRChat model from Blender in various positions and angles in different lighting while wearing select clothing of choice. Then I added proper tags describing each image in a respective text file.

Based on the training data and they keywords I specified, you can input various clothing alternatives including:

  • armor
  • jacket
  • shirt
  • barechest
    Training took about 30 minutes using an RTX2080Ti GPU.

#stablediffusion #loramodel #characterart #ai #aiart #aitraining #sd #lora #tech #technews #vr #3d #vrchat #roleplay #neondivide #wasteland

xalieri, to random
@xalieri@masto.ai avatar
xalieri,
@xalieri@masto.ai avatar
xalieri,
@xalieri@masto.ai avatar
brandont, to random

deleted_by_author

  • Loading...
  • db0,
    @db0@hachyderm.io avatar

    @brandont If you want to talk about concrete functionality: is already accelerating creation of digital art, 100x.

    Copy-editing is being accelerated by LLMs

    Programming is being accelerated by LLMs (I have benefited massively on my own FOSS endeavors from it)

    Animation is already starting to pivot.

    And I don't even want to talk about doing stuff hobbyistically or the porn aspect.

    baldur, to random
    @baldur@toot.cafe avatar

    I wonder how long it’ll take for fans of AI art to discover that it both has a specific aesthetic and that aesthetics eventually fall out of popular fashion?

    “That looks soooo 2023”.

    bornach,
    @bornach@masto.ai avatar

    @baldur
    Well this artist seems to put a tremendous amount of effort into developing his own signature #AIArt aesthetic

    https://youtu.be/K0ldxCh3cnI

    He spends so much time Photoshopping the #StableDiffusion in-painting that the #GenerativeAI now represents about 40% of the whole workflow. Good quality art still requires the artist put in a lot of their own time and effort integrating the new tools into their overall vision.

    HistoPol, to random
    @HistoPol@mastodon.social avatar

    @msquebanh

    What happened?

    All your posts are gone and I am not following you anymore?

    HistoPol,
    @HistoPol@mastodon.social avatar

    @flexghost
    IDK about the setting, but it did even get the grim look right!

    , DALL·E 2,
    or ()?

    @stux @Catmama @paul @noondlyt @calculsoberic

    jake4480, to random
    @jake4480@c.im avatar

    In 1923, a cartoonist imagined that in 2023, an electric machine would generate ideas and draw them as cartoons automatically. With your Idea Dynamo linked up to your Cartoon Dynamo and an adequate supply of ink, this machine would create "hilarious" (?) cartoons like 'How to Torture Your Wife'. 🙄

    skullvalanche,
    @skullvalanche@gladtech.social avatar

    @jake4480 I had to do a bit of work in #pixelmator to combine the generated content, but ... the prophecy is complete.

    #ai #chatgpt #StableDiffusion #humor #comic #dystopia

    lardratboy, to random
    @lardratboy@corteximplant.com avatar

    Written, performed and illustrated by . The other night I fell asleep watching tubi awoke to this streaming... Looks have been around since January, anyone got other examples of automated video production with this level of fidelity for lack of a better description. Curious to see other examples.

    https://tubitv.com/movies/722998/the-ufo-chronicles-a-history-of-mysterious-sightings

    lardratboy,
    @lardratboy@corteximplant.com avatar

    https://layer8.space/@k Here is an example of what the type of images they slowly pan zoom in on between the narrator visual segments. ( )

    eliocamp, to StableDiffusion
    @eliocamp@mastodon.social avatar

    Good evening!

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good night!

    I think I'm starting to learn how to use this. Instead of trying to prompt everything at one, I first prompted the background, then added a picture of a turtle and inpainted it to blend in style (not perfect, though). Then opened in gimp and deleted every shell part, added a city and again, inpainted to get the style. Then, another batch of img2img to blend the overall image a bit more and finally do the upscaling.

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good night!

    #StableDiffusion #AIArt

    eliocamp,
    @eliocamp@mastodon.social avatar

    I reeaally like this new "system" (for lack of a better word).

    I'm now trying to control how much of the original figure I want to be still recognisable in the final image.

    #StableDiffusion

    A map of the southern hemisphere with green and orange areas (which represent positive and negative precipitation anomalies). The shape and location of the coloured areas are similar to the previous picture.

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good night.

    #StableDiffusion

    eliocamp,
    @eliocamp@mastodon.social avatar
    eliocamp,
    @eliocamp@mastodon.social avatar

    Good evening, this time a bit brighter.

    #StableDiffusion

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good evening.

    #StableDiffusion

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good night.

    #StableDiffusion

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good evening again.

    #StableDiffusion

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good evening.

    #StableDiffusion

    eliocamp,
    @eliocamp@mastodon.social avatar

    Testing a new style and also Tiled Diffusion, which supposedly allows you to tell the model where to put different things (in this case, a treehouse on the right). It's a bit finicky, though.

    #StableDiffusion

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good "I can't focus on my thesis" day to you too!

    #StableDiffusion #AIArt

    eliocamp,
    @eliocamp@mastodon.social avatar

    Good evening, I guess..

    #StableDiffusion

    eliocamp,
    @eliocamp@mastodon.social avatar

    I think I liked this whole abstract thing. Now I wanted to have something similar but with a different feel.

    #StableDiffusion

    vitriolix, to random
    @vitriolix@mastodon.social avatar

    Stable Diffusion prompt:

    "hunter biden with long tentacles in the style of hr giger"

    image/png
    image/png
    image/png

    itnewsbot, to programming

    Turning Old Kindles into AI Powered Picture Frames - While we tend to think of Amazon’s e-paper Kindles as more or less single-purpose ... - https://hackaday.com/2023/05/15/turning-old-kindles-into-ai-powered-picture-frames/

    flipsideza, to random
    @flipsideza@fosstodon.org avatar

    Been playing with #stablediffusion with #controlnet lately. Its surprisingly addictive... Ive been leaving the seed on -1 and getting random new images in the same pose. Very entertaining

  • All
  • Subscribed
  • Moderated
  • Favorites
  • JUstTest
  • kavyap
  • DreamBathrooms
  • cisconetworking
  • khanakhh
  • mdbf
  • magazineikmin
  • modclub
  • InstantRegret
  • rosin
  • Youngstown
  • slotface
  • Durango
  • tacticalgear
  • megavids
  • ngwrru68w68
  • everett
  • tester
  • cubers
  • normalnudes
  • thenastyranch
  • osvaldo12
  • GTA5RPClips
  • ethstaker
  • Leos
  • provamag3
  • anitta
  • lostlight
  • All magazines