Comments by "clray123" (@clray123) on "This new AI is powerful and uncensored… Let’s run it" video.

  1. The code which uses the weights is open source. What's not open is the training data or the training code (in the sense in which order they trained their model with what data, which also matters for the final result). In other words, you cannot reproduce Mistral from scratch. But then, even if they disclosed all details, unless you have $100-200K to throw at it (estimated, based on the reported training cost of an earlier MPT model) it would not be possible for you either.
    2
  2. Of course you want to use as much VRAM (GPU) as possible, only then is the generation fast. If you have a 24 GB GPU like RTX3090 or RTX4090, you can run the Q4_K_M quantized version from TheBloke with only 16 GB of CPU RAM (probably even less) at good speed.
    1
  3.  @imyourocd ALL models can utilize any kind of RAM. It's just that CPU RAM is slow af in comparison to VRAM. And you can very much run this AI on your PC.
    1
  4. To generate (text) porn you do not need this huge model, Mistral-Orca-7B will do just fine.
    1
  5.  @Ux1.73c Right, I finetuned that one myself with splendid results.
    1
  6. That is what the finetuning part is for. In about 30 minutes I was able to retrain Mistral-Orca-7B to produce "taboo" porn by feeding it assorted text examples from Internet's renowned story archives. The funny part is that it still has some remnants of the original censorship, cooking up some bizarre plots (sort of putting a happy-cynical spin on what it generates).
    1
  7. This is an artificial problem created by the makers in a desperate attempt to build a government-supported moat around their funny product. Idiots who want to harm other people already have a myriad of ways of doing so. And the supposedly sinister new ways to abuse AI all require tons of resources, which common idiots typically don't have. In other words they can do the good old stabby-stabby/shoot your neighbor or make-a-poison-for-your-fiance without any AI, but they cannot build an atom bomb or create a killer virus even if they were told all the necessary steps.
    1
  8. Which quantized version? And with how much RAM on top?
    1
  9. Like Sam Altman shitting his pants because of competition while rolling his Manson lamps... certainly counts as man-made horror to me.
    1