• 0 Posts
  • 10 Comments
Joined 1 year ago
cake
Cake day: July 31st, 2023

help-circle





  • I have used it mainly for dreambooth, textual inversion and hypernetworks, just using it for stable diffusion. For models i have used the base stable diffusion models, waifu diffusion, dreamshaper, Anything v3 and a few others.

    The 0.79 USD is charged only for the time you use it, if you turn off the container you are charged for storage only. So, it is not run 24/7, only when you use it. Also, have you seen the price of those GPUs? That 568$/month is a bargain if the GPU won’t be in continuous use for a period of years.

    Another important distinction is that LLMs are a whole different beast, running them even when renting isn’t justifiable unless you have a large number of paying users. For the really good versions of LLM with large number of parameters you need a lot of things than just a good GPU, you need at least 10 of the NVIDIA A100 80GB (Meta’s needs 16 https://blog.apnic.net/2023/08/10/large-language-models-the-hardware-connection/) running for the model to work. This is where the price to pirate and run yourself cannot be justified. It would be cheaper to pay for a closed LLM than to run a pirated instance.



  • Why not build a new PC or buy an old pc? One with ryzen 5 5600G, 8gb Ram, 250GB ssd should cost ~250USD whether you buy new/old, i recently checked the prices, cause I needed one and they were similar. This should take you a long way. As for storage just pick a case with enough ssd/harddisk slots.

    You can also go much cheaper depending on what you get.

    The advantage is you can add a GPU like the intel A380 for av1 encoding of video if you feel like you need it.

    For OS depending on what you are doing there are a few choices:

    • True nas: mid difficulty
    • debian: i just use this with docker, does the job
    • alma linux/Rocky linux
    • ubuntu
    • yunohost: if you would be interested in hosting activitypub apps, easy
    • casaos: easy

  • Just go Cloudflare. The dot.win told they have is incredible value ~3$ per annum if i remember correctly.

    Other pros of using Cloudflare:

    • Cloudflare ddns
    • Cloudflare tunnels
    • Cloudflare proxy

    It does a a few cons, like not being able to use custom nameservers if you aren’t paying 200$ a month. Also the fact of Cloudflare being an internet gatekeeper may not be to your liking.