Xueba's computing system

Chapter 266 Looking for a Partner 4
Lin Yuan and Zhang Yan were slurping noodles together.

"Senior Brother, do you plan to live in seclusion?" Zhang Yan suddenly asked for no reason.

"What?" Lin Yuan was stunned. "Recluse? That doesn't fit your crazy personality. I'm only 25 years old now. Do I have to retire early?"

"Look at it now." Zhang Yan held the bowl and pointed around, "I dare not open the curtains. I have to be very careful when I go to bed at night for fear of making any noise. There are colleagues on duty upstairs and downstairs.

What kind of life are we living?

I can imagine our future life, where someone will follow us wherever we go."

Lin Yuan put down his bowl and chopsticks. "I didn't expect it to be like this. I just wanted to do something good, so I made the code open source on impulse. To be honest, I regret it now. The happiest time for me was when I earned my first million.

At that time, I felt that I was rich and had no burden of fame and fortune.

Now that I think about it, it’s pretty good to be content with a small fortune.

But if I were like that, you probably wouldn’t like me anymore.”

Zhang Yan thought for a moment and said, "That's true. I hope the person I follow is different from others, but now I realize that being different has its price.

But," Zhang Yan suddenly looked at Lin Yuan with burning eyes, "Since we are here, we should make the best of it. We will go through mountains of swords and seas of fire together."

"That's right. I'll go check if the stuff has been downloaded. I found a good small AI company. I can't rely on big companies, so I want to try to promote these small companies."

"Go ahead and do your work. Leave the dishes here and I'll clean up."

"Just order takeout next time. It's too much trouble to wash dishes and chopsticks."

"It's not a problem. It's good like this now. My dad said it's a good opportunity to temper my character." In fact, Zhang Yan had never done housework so intensively since he was born.

Lin Yuan returned to the room. Even with the support of gigabit fiber, the DS-LLM general large language model was still downloading.

[Speed: 986Mbps, Process: 67.2%]

In the black command line window, the cursor flickered. Seeing that the download would not be finished in a few minutes, Lin Yuan simply ran out to help Zhang Yan with the housework.

"Huh? You finally remembered me? And you still remember to help me. A sweet and soft wife is better, right?" Zhang Yan said happily.

"Well~~, the main reason is that the file of the entire model is too large and it hasn't been downloaded yet."

"Fuck you." Zhang Yan was angry. "Your computer mistress is busy, and you come to entertain me? You know how to save time."

Lin Yuan just smiled and went to wash the dishes.

Whenever he was busy with work, Zhang Yan would take care of the housework. Seeing a rich girl like Zhang Yan rolling up her sleeves to wash dishes, Lin Yuan felt a little guilty. So he would go to help whenever he had time.

After the two of them finished playing around, the kitchen counter was covered with white detergent foam.

"Look at you, you're making things worse." Zhang Yan complained as she wiped the splashing foam. Of course, she was actually very happy.

"You go ahead and do your work. I appreciate your kindness. By the way, what do you want to eat tonight? Don't just say whatever you want."

"Eat you!" Lin Yuan said for no reason. What he hated most was thinking about what to eat next. Anyway, nowadays, they eat specially supplied meat, vegetables, eggs and milk, which highlight the original flavor and green and pollution-free. Everything tastes good.

"Still eating me?" Zhang Yan pouted, "How long has it been since you last ate me?"

"Uh..." Lin Yuan suddenly remembered that he had been feeding all his energy into the computing system recently and had indeed ignored Zhang Yan. "I'm busy recently. I'll leave first."

"Take it easy!" Zhang Yan's voice came from behind him, "I still want to live a long life with you."

Zhang Yan obviously took Lin Yuan's inability to do the task as proof of physical exhaustion.

Lin Yuan returned to the room again, and this time the download was finally completed.

272GB!!!

The model weight files, source code, various tool chains, and documentation of DS-LLM 67B add up to 272 GB.

Lin Yuan looked at the scary model weight file, which had to be loaded into the GPU. As a result, the size of this thing reached 268GB. Even if the size of the model weight file can be reduced by reducing the precision, the minimum size of this thing is 126GB. "Okay! AI is really expensive."

Even though DS-LLM is claimed to be much smaller than OpenAI's chat-GPT4 model weight file, after all, the size of similar files of the latter is calculated in TB, it still reaches the level of hundreds of GB.

Model weight file, which is the most important thing for AI model.

You spend a lot of money to buy a bunch of GPUs, and then burn a lot of electricity, and in the end, this is what you train.

All the secrets of how the AI model understands and responds to language are contained in the model weights file.

But do you think you can understand the AI's reasoning process just by having the file? Don't even think about it.

Taking chat-GPT4 as an example, its parameter scale has reached trillions, and the DS-LLM in front of Lin Yuan also has 670 billion parameters.

Do you want to understand the specific role of a certain parameter in the AI model reasoning process? Forget it, it is impossible.

If we reverse the reasoning process of the AI model, we will only see vectors. Humans can only understand a small part of the association process, and the human brain can no longer keep up with most of the AI reasoning process.

AI has become a reality, working according to human deployment. Humans provide ideas, and AI completes the work. As for the specific process, it is a black box, a completely invisible black box.

Lin Yuan was shocked by the scale of parameters of the large AI model.

He suddenly realized, shouldn't this be a natural thing? Why should I be surprised?

It suddenly occurred to him: Why should I be surprised?

The parameters of the most advanced AI models have already reached the trillion level. Shouldn’t we be mentally prepared for the size of the model weight files?

'So why would I want to use a laptop to run such a large language model?'

Lin Yuan cried because of his own stupidity.

After thinking about it carefully, he finally figured out the reason. This was because he had become accustomed to the strength of the model outlined by the computing system.

Lin Yuan is accustomed to the simplicity of the models produced by the system, and habitually ignores the crude AI model methods currently used by humans on Earth.

According to the current extensive route of stacking computing power, the model weight file must be this large.

林远简单算了下，DS-LLM 67B的满血版需要268GB的显存，那特么3块H100都不够哇。每块H100的显存是80GB，那至少要准备4块。

He doesn't plan to buy it. It is more convenient to directly rent cloud computing power these days.

"Xiao Zhang," Lin Yuan called Zhang Yan over loudly, "Do I need to go through the approval procedures to buy cloud computing power?"

Due to Lin Yuan's sensitive identity and the fact that he is under the protection of a security team, all his actions must be reported in advance.

"What? Cloud computing power."

“It’s almost like buying a cloud server.”

"Oh, then we must report it."

So Lin Yuan began to fill out the application form reluctantly.

"What the hell does my purchase of cloud computing power have to do with my personal safety? Can someone beat me up through the Internet?"

"Don't make a fuss. Rules are rules. If you find it troublesome, I'll fill it out. Just tell me what it's for."

"Purpose? The ultimate purpose is to use it to short the stocks of technology companies on the other side of the strait."

"Uh..." Zhang Yan obviously couldn't write like that. "I will write to you... to engage in scientific research and strive to achieve greater success for the country and the people."

"I just want to short the tech stocks on the other side of the strait to vent my anger. Of course, I want to make some money by the way."

"Just shut up and stop making trouble."

(End of this chapter)