I am the only one who practices magic: I practice magic in the city

Chapter 277: Bright Future (Part )
Although she was full of confidence, Madeline was still overjoyed to be able to obtain the source code of the Orange model so smoothly.

Qianxun's security department has a large number of 0day vulnerabilities (vulnerabilities discovered by hackers but unknown to developers and users). The Trojans they created exploited several 0day vulnerabilities in the Linux system to remotely execute code and obtain permissions.

Qianxun didn't have to wait too long. The encrypted package was decrypted and accessed by Youzi Technology the next day. It turned out to be a repaired version of the Orange large model after internal testing.

After Wu Ende left, Fu Yuansheng, who took over his job, was full of promises, but he was actually still nervous.

He is an expert. Although he has never come into contact with neural networks like the Orange Big Model before, he is very familiar with models such as BP, LSTM, CNN, RNN, DNN, Seq2Seq, etc.

No matter what kind of neural network it is, there is no such thing as deleting data. You can only retrain it.

Deep learning does not mean storing data somewhere for neural networks to use, but letting neural networks "learn" these contents. What is learned will lead to changes in "synapses", and the "synapses" of the large model are the so-called "parameters".

The numerical changes of these parameters and their mutual connections are like the connections of synapses when humans learn, which means that the large model truly "masters" the trained knowledge.

For example, a large model with 13B (130 billion) parameters stored on a hard disk may be 20G in size.

After training it with 2T of data, its size may still be 20G.

There is no change in size, but it has completely mastered these 2T of information.

However, since it is an artificial intelligence model that imitates human neural formation, it actually also has some problems of human intelligence.

For example, the problem of "forgetting" is that AI has clearly learned something, but after a while it is discovered that it has forgotten what it has learned.

After AI is over-trained, it may begin to take new data for granted.

Just like when humans face new things, they don’t understand anything, but use past experience to explain them. This is called "overfitting" in the field of AI.

In one class, the teacher talked about half a book. You can understand the first three pages, but the rest is incomprehensible. For AI, it is "information overload."

When humans are exposed to one-sided information, it will lead to cognitive bias. If AI data is concentrated with content of a certain ideology, it will also lead to cognitive bias.

Lots and lots of them.

What’s worse, if the model is originally a good one and others can train it just fine, but when you train it, it either fails to converge and get the result (which can be understood as not being able to learn), or suffers from catastrophic forgetting, or the gradient explodes or disappears.

Whether it is possible to train a usable large model without major changes to the architecture and parameters is even a mystery.

The training and tuning of AI is full of complexity and unpredictability.

Sometimes, a tiny parameter adjustment or change in data processing steps can lead to huge differences in training results.

Even if Fu Yuansheng strictly follows scientific methods to adjust hyperparameters, carefully selects data sets, and uses the most advanced hardware equipment, he still does not have enough confidence to retrain the Orange model to remove all traces of Pomelo Technology in just one or two weeks.

But if it works, I will be the father of AGI!
Get a promotion and a raise!
Become the world's number one AI authority!
How many people can resist such temptation?

Moreover, Chihiro was already prepared. If Yuzu Technology fought back, or even released evidence that the large orange model was developed by them themselves, Chihiro would not be afraid.

The number one public relations officer who controls more than one billion yuan in funding is no pushover!

snort!
After entering the Pass, there will be great scholars who will debate with me.

First muddy the waters, and then in the history books that continue for half a year, Youzi Technology will soon become a historical laughing stock!
After Fu Yuansheng actually got his hands on it, he was overjoyed and felt like he was destined to be with us.

This big orange model and grapefruit training framework are so useful.

No matter what strategy is used to adjust the parameters, the training effect is almost always good and the efficiency is extremely high.

A round of training should be completed in three days.

The public beta version of the Orange Big Model has doubled the 130 billion parameters of the internal beta version, now with 1500 billion parameters.

Fu Yuansheng commanded his three loyal lackeys, and the four of them began to confine themselves in a small dark room. They removed the traces of grapefruit technology in the orange model, adjusted the parameters in a targeted manner, and conducted repeated training to cover as much knowledge as possible that the large model had originally learned.

Especially for questions like "Who created you?", the large model must be supervised for learning, so that it can answer similar questions with "I am 'Wen Jun Yi Yan', an AI assistant, and Qianxun Company created me."

Or, "The talented engineers at Qianxun have worked day and night to allow me to meet you. Are you happy?"

In order to completely avoid problems, Fu Yuansheng and his team even banned "Yuzi Technology", "Yuzi" and other associated words, and prohibited the modified "Wenjun Yiyan" from being mentioned in any way.

Of course, this still cannot completely solve the problem, but it doesn’t matter. Qianxun is only preparing for the public beta for three days. After three days, it will immediately announce the end of the public beta and upgrade the system. The rest of the time will be used to slowly work on it.

This problem can always be solved.

Fu Yuansheng's eyes are red from staying up late. Is it because of tiredness?
No, this is because of my bright future!
-
The statement made by the official Weibo account of Youzi Technology left all the onlookers confused.

That sentence is interesting and can be interpreted as a counterattack. What does the photo of the team wearing magic robes posted above mean?
Want to use an Avada to get a big bite on Chihiro?

You are the person involved, what are you talking about?

After seeing the official Weibo post from Youzi Technology, probably out of a guilty conscience, almost all of Qianxun’s management came out and started to speak ill of Youzi Technology.

Niu Liang, Weibo certified vice president of Qianxun Financial Services Group: "It is hard to understand what kind of IQ would believe that a small company that has been established for less than a year can change the world."

Jing Hao, Weibo certified Qianxun Jiangmi General Manager: "Ten years of hard work, like Qianxun, we will always be the young man pursuing technology and dreams! @Robert李" Yuan Shanjun, Weibo certified Qianxun Operations Vice President: "Fairy tales are beautiful, but unfortunately, the real world does not believe in fairy tales. Qianxun has invested at least tens of billions of dollars in the field of AI every year since 3057, and now it has finally borne fruit, which is gratifying. The AI ​​industry is capital-intensive and technology-intensive, and not a small company can take advantage of it."

Youzi Technology has reposted these people’s Weibo posts, and each time it was reposted, it was accompanied by the phrase “interesting” and the team photo.

And under the huge public relations expenses of Qianxun, public opinion began to be guided towards attacking Youzi Technology.

Those articles that calmly analyzed that Youzi Technology could not be a plagiarist basically had no traffic, while the official Weibo account of Youzi Technology was filled with internet trolls and insults based on unknown facts.

Ninety-nine percent of the responses believed that Yuzu Technology’s response was a matter of pride rather than shame.

As for these people, Fang Yu, who was using the official Weibo of Youzi, didn't care at all and joined in the scolding with a small account.

Because the insults were so distinctive, many of the small account’s Weibo posts were actually forwarded by many senior executives of Qianxun.

The public beta of Qianxun and Youzi Technology will be on the same day and time, which is the morning of April 4th, the first day after the Qingming Festival.

Since the public beta time of Youzi Technology was already announced at 4:5 a.m. on April , Qianxun deliberately moved the public beta time forward by one hour to : a.m. in order to be the first to get the first taste.

Different from Youzi Technology's inaction, Qianxun has been very tight both internally and externally these days, trying hard to control media comments and fixing bugs and conducting tests internally.

"Please summarize the ROI for R&D of all the group's R&D projects in 3061 and form a report based on the uploaded template." Robert Li entered a line of requirements in the dialogue box.

"Wenjunyiyan" also has an enterprise API. Now Robert Li connects Qianxun's backup server with the enterprise API and develops Qianxun's internal AI management assistant specifically.

After receiving the instruction, "Wenjun Yiyan" quickly summarized and arranged the ROIs of all Qianxun's R&D projects in 3061, and conducted a comprehensive evaluation of these projects based on the multi-criteria decision analysis (MCDA) method, and then generated a PPT in just over ten seconds.

Robert Li opened the PPT and saw that it was clearer than the reports usually submitted by the CTO.

As for the tests that might reveal the truth, they had already done them.

"Clap, clap, clap." Seeing the excellent performance of "Wen Jun Yi Yan", Madeline took the lead in applauding.

The other executives also applauded.

From clapping their hands lightly in front of their chests to raising their hands above their heads and clapping vigorously, led by the clapping thief, the conference room was soon filled with thunderous applause.

It seems that whoever claps less means that he or she has no sense of identification with the company.

Robert Li looked at Madeline. Until now, he still felt uneasy, so he never posted on Weibo about this matter.

But in this situation, he could only smile as usual and patted Fu Yuansheng on the shoulder.

"Robert, the public beta test will be launched tomorrow. As the sole leader of Qianxun, shouldn't you also support 'Wenjun Yiyan' on social media?" Madeline said with a victorious smile. Although it was a suggestion in her tone, Robert knew in his heart that this was a disguised order.

Robert Lee pursed his lips and was silent for a while.

"Robert?" Madeline winked at him.

Robert then realized that the atmosphere around him seemed a little strange. He could only smile and took out his phone to post a Weibo post saying "Tomorrow at 9 o'clock, witness a miracle." He then joked, "I saw that the official Weibo account of Youzi Technology reposted many of our executives' Weibo posts. I wonder if mine will be reposted as well."

When the boss posts on Weibo, the executives below smartly start commenting and forwarding it immediately.

At the same time, you have to write a short essay of several hundred words to express your gratitude to the company and your admiration and worship for the boss.

The flatterer who types the fastest hasn't even finished writing his essay when he sees that someone has already forwarded it.

Fuck! Whose hands are so fast?
I opened it and saw, Yuzi Technology?

And it also comes with pictures?

But this time they didn’t go with the photo of the team wearing magic robes, but instead went with a photo that everyone is familiar with.

Ye S you. (Mature readers should add pictures by themselves)
In the field of AI, due to the black box nature of AI, plagiarism and copycatting are very different from other IT fields.

For a complex system, wrapping is a very troublesome thing. With billions of codes, any comments in the corners may reveal the truth.

However, the big model is not a software system, but a neural network composed of tens, thousands or even trillions of parameters. This makes it difficult to identify plagiarism and copycat behavior directly through code inspection, because the core of the big model is parameters rather than explicit code logic.

The knowledge in the model can completely clean up and cover up past knowledge as long as the training is repeated enough times.

This is also why the two Stanford students were so bold as to directly cover Tsinghua’s llama small steel cannon and claim it as a large model of their own.

When this incident first broke out, some people only doubted its performance because the performance of the models produced by these three students was too similar to that of the small steel cannon.

At this time, none of the three people admitted that they were exposing the truth.

It’s just that they are just students, without enough computing power and data, and they are unable to completely complete the knowledge coverage of the model, which results in their model being able to recognize the Tsinghua Bamboo Slips just like the proprietary features of the Little Cannon, which proves that they are plagiarizing.

The reason why the "Little Steel Cannon" incident was resolved so quickly was that the "Little Steel Cannon" was launched much earlier than the model produced by the three students, and it had already gained fame, and it also had unique features. But what if the plagiarist was not the three students, but a large manufacturer with more abundant resources? What if the two were launched at the same time, with almost no order of precedence?



(End of this chapter)