• 43 Posts
  • 38 Comments
Joined 2 years ago
cake
Cake day: June 9th, 2023

help-circle













  • I think it’s that you need to be able to throw parallel processing at a lot of RAM. If you want to do that on a PC you need a GPU that has a lot of RAM, which you can only really buy as part of a beefy GPU. You can’t buy a midrange GPU and duct tape DIMMs onto it.

    The Apple Silicon architecture has an OK GPU in it, but because of how it’s integrated with the CPU, all the RAM in the system is GPU RAM. So Apple Silicon Macs can really punch above their weight for AI applications, because they can use a lot more RAM.





  • I tried it with LoRas; it works OK but the LoRa applies over the whole image, and I found that the LoRas seem to make the model less good at reading comprehension, which is what I am fighting with the regional prompter in the first place.

    Really what I want is to use the LoRa for some generation steps but not use it for others, but I haven’t worked out how to do that yet.