• 1 Post
  • 12 Comments
Joined 1 year ago
cake
Cake day: July 28th, 2023

help-circle

  • I run a lot of LLMs locally, as well as doing image generation locally with Stable Diffusion.

    The most important factor is the GPU. If you’re gonna do AI stuff with your GPU it basically has to be a CUDA GPU. You’ll get the most bang for the buck with a 3090 TI, (amount of VRAM is also important). And get at least 64 GB of RAM.

    If you get this you’ll be set for a year until you learn enough to want better hardware.

    A lot of people try to buy their way out of a lack of knowledge and skill about these things, don’t do that. I’m able to get better results with 7B models than many get with 70B models.

    Get LM Studio for the LLMs and get A1111 (or ComfyUI or Foooocus) for image generation.










  • It is profitable right now and has been for a long time, anywhere in the world. What’s lacking is knowledge that it could be profitable and investment will.

    Take the US as an example. You get about 550 kWh of electricity per ton of burnt waste, that’s $20-30 per ton. And If you’d have district heating, which only a few places do you’d get a lot more.

    But counting low. $20 per ton, multiplied by ~150 million tons of trash per year and you get 3 billion dollars per year that you’re burying instead of just burning.

    Now this isn’t even accounting for the fact that about 20% of that is plastic, and that plastic is worth anywhere from 1 cent to 70 cents per pound. Let’s really lowball it and say that it’s worth $5 cents per pound on average. That’s $100 per ton. That multiplied by by the roughly 30 million tons of plastic that goes to landfills is worth another 3 billion. And we’re not even discussing metals, paper glass and all the other things that have surprisingly great value.

    And let’s discuss compost. Here in Sweden we have a separate bin for that. It’s all collected and the methane is collected and sold as well as the nutrient compost when it’s done.

    Yes! Reduce, Reuse, Recycle! But people aren’t doing that and the slogan has had very limited impact in the last 53 years.