Comments by "Posthumanist" (@thornelderfin) on "The AI Advantage" channel.

How exactly are you going to host localy a model that requires 720 GB VRAM? (671B parameters)
7
How exactly is DeepSeek free? Every AI has to run inference on extremely expensive GPU/TPU cards. It cannot possibly be free - someone is paying for you, and it's not out of goodness of his heart.
5
I knew Igor is from Slovakia but grew up in Austria. I just expected him to have heavier German accent when he speaks Slovak, but he doesn't have any. In any case, this was highly entertaining to watch! :D
5
@JDSpartan2007 How areo you going to run 671B parameter model locally? Do you have 720 GB VRAM? So you go for the distilled tiny versions like 32B parameter, but that's 20x smaller (and dumber). That is no longer competitive with the large smart models. So if you want safe version, you need to run it on some servers. Providers outside of China charge around $8 per 1M input and output tokens. China (DeepSeek) charges 10x less (which is absolutely not possible without someone sponsoring your 10x cheaper API, because they are not getting 10x cheaper NVIDIA GPUs, servers / datacenters, and of course massive amounts of electricity subsidiezed by the CCP). Nothing in life is free and miracles do not happen. People should think about why China offers exactly the same API for exactly the same model 10x cheaper when they have costs with NVIDIA that are higher than that. If someone is paying for you, that is always some agenda behind it. Just be careful.
3
@ji9306 I still don't understand how a Chinese "Wall Street" billionaire firm (DeepSeek) supported by the largest government in the world (CCP) is "the underdog" for these people.
1
@ You sound like a Wumao
1
So if you worked at OpenAI, you would like to work hard for 3 years non-stop, even weekends, and then not get paid at all for entire 3 years. Because customers wanted everythning for free. What about manufacturing NVIDIA cards - the workers should also work for free? What about manual worker at the power plant supplying energy to the datacenter? But customers want everything for free, so those workers should also work there for free and bring their own material (coal, gas, nuclear fuel).
1
@ So what was the point of your post? China is stealing synthetic data so there should be no new models from the west, just to be sure.
1
@ Yes, absolutely, I understand and I see it the same way as you with China. I just want to note that the 8B model is not a miracle. When you test it you will find out that it's a nice competent model in its lightweight category, but it's not a miracle breakthrough (I am reacting to the absurd DeepSeek hype that is everywhere right now).
1
@LBDluxe Those $2 million didn't come from you and me, they came from investor money (and he was a billionaire even before joining OpenAI, he was president of Y-Combinator). Of course he is greedy, he is a corporate CEO and a billionaire. They all pretned to be altruists and humanists, it's a popular hobby over there. But OpenAI's products are not greedy. Costs of running those models are very very high, and I even believe they are losing money on the $200 tier because they gave unlimited use of o1-pro and Advanced Voice Mode and they didn't think people would overuse it so much, a miscalculation. Yet I see daily people saying $200 a month is absurd and it's pure greed.
1
@francisco444 I think people got used to get everything for free, even products and services that cost billions to develop. It all started with free email 25 years ago, and since then it has just gone downhill. Now we have free all social media, free video streaming platforms (like this one, that costs billions and billions in costs just to operate, but people feel entitled to get if FREE, or else!). I think we are all extremely spoiled and demand everything to be completely free, even when it was very expensive to make and maintain. That is unless you are the one who has been working on it extremely hard for 5 years non-stop and then hear opinions online that you should give it away for free otherwise you are a greedy bstrd.
1
@AllenHorn0507 That's like complaining that cars that cost 1 million exist, let's say industrial vehicles. It's not a product for you, you don't need it, and for the specific industry such vehicle for such price makes sense. I know several people who pay $200 per month for the program, two of them have a business and three are freelancers (coding). For them, it's just a business expense of less than $7 per day. It's like hiring an intern for less than $1 per hour. Unlimited o1-pro and unlimited Advanced Voice Mode.
1
@AllenHorn0507 That's like complaining that cars that cost 1 million exist (some industrial vehicles). It's not a product for you, you don't need it, and for the specific industry such vehicle for such price makes sense. I know several people who pay $200 per month for the program, two of them have a business and three are freelancers (coding). For them, it's just a business expense of less than $7 per day. It's like hiring an intern for less than $1 per hour. Unlimited o1-pro and unlimited Advanced Voice Mode.
1