White Star Technology office.

Song Zhi tossed the summary report of overseas failures onto the desk and let out a long breath.

"President Jiang, good news, those knockoff versions have completely collapsed."

"Market interest has directly cooled down, and the foreign media's tone is also starting to reverse."

Hearing this, Jiang Huaixing never took his eyes off the computer screen and said.

"This is only the first batch."

"There will be a second and third batch coming up."

"They won't stop."

"So we cannot stop our steps; we must let them stay forever behind us."

Song Zhi nodded.

Then his phone lit up, and he glanced down at it.

"There is one more thing, President Jiang."

"Because of this wave of overseas manufacturers' replica failures, several domestic major tech giants and research institutes that were previously watching from the sidelines suddenly changed their mentality."

"Three domestic top-tier companies have proactively approached us, wanting to access the Xinghan SG cluster built together with us and pilot the migration of their self-developed models."

Hearing this, Jiang Huaixing raised an eyebrow.

"Alright! Have them come tomorrow!"

...

The next day

In Meeting Room Number One of White Star Technology, both sides of the long table were filled with visitors.

The technical heads of the three domestic top-tier tech enterprises brought their teams and came here specially.

As mentioned earlier, their purpose was to negotiate the computing power migration pilot.

On the desktop projection, one side was Nvidia's mature CUDA ecosystem toolchain, and the other side was the self-developed inference framework matching the Xinghan SG series graphics cards.

The chief engineer of the leading research institute tapped the screen with his finger and said cautiously.

"President Jiang, to be honest."

"We did come this time specifically to learn about your esteemed company's computing power cluster."

"After all, the news of the tightening of overseas high-performance GPU quotas has already spread."

"So we must prepare a new computing power foundation in advance."

"We have also done a preliminary internal evaluation, and the hardware computing power paper parameters of Xinghan's SG-D3 are indeed very impressive."

"But we all know that computing power is never the only point that needs attention."

"Especially after all these years, all our model code, fine-tuning scripts, and operator libraries are written based on CUDA."

"A large number of operators do not natively adapt to the SG architecture."

"Therefore, if we want to migrate over, it's not as simple as just changing the graphics card and plugging it in to run."

"Instead, there is a lot of code that needs to be rewritten and tuned, and the workload is extremely huge."

An architect from a certain internet tech giant nearby also added.

"Not only that, there are also compatibility risks."

"The exact same piece of model inference code runs stably on the A100, but if ported to the SG-D3, it might experience latency jitter, abnormal video memory allocation, and so on."

"In case the online business suddenly crashes, we cannot afford the losses."

"So I want to ask, President Jiang, does your White Star Technology have a solution?"

Several people spoke one after another, laying their respective concerns out in the open.

It wasn't that they didn't trust White Star Technology and Xinghan Semiconductor, but by now, their massive historical technical debt had directly trapped them.

Even when news of Nvidia's export controls came out, most companies still didn't dare to rashly switch their computing power foundation.

Song Zhi turned his head to look at Jiang Huaixing,

and Jiang Huaixing leaned forward slightly.

"We understand everyone's concerns, and we have thought about them before."

"If we purely only sell hardware, we cannot solve the problem of ecological content."

"Then this SG series computing power card would just be an isolated chip."

Saying this, he raised his hand to signal the technical engineer to switch the presentation page.

"Therefore, we at White Star have prepared two sets of solutions."

"First, we will open up the underlying operator library of Xingyu AI adapted to the SG series, directly open-sourcing and sharing the universally verified and mature operators to reduce the cost for everyone to rewrite code."

"Second, supporting migration tools."

"Automatically converting most CUDA operators and performing pre-performance testing."

"Before going live, we will first conduct a 72-hour stress test in our computing power cluster to identify hidden dangers of video memory and latency in advance."

...

Hearing this, the chief engineer of the research institute finally relaxed his brows slightly.

But he still had concerns in his heart, yet instead of hiding them, he directly spoke out.

"Then, President Jiang, what is the approximate performance loss of this automatic conversion tool?"

"For general scenarios, the loss is about 8% to 15%."

Jiang Huaixing did not deliberately beautify it right now, but frankly stated the real data.

"However, we will team up with Xinghan Semiconductor to continuously iterate the operators."

"For large model inference scenarios, after subsequent optimizations, we are confident in compressing the gap to within 5%."

"For core operators that are truly sensitive to performance, our team can join hands with your engineers to manually tune them."

"How is risk-sharing calculated?"

The head of the major tech giant pursued the question.

"You must know that the cost of migration trial and error is still very high."

"For this pilot, the computing power cluster testing resources are provided free of charge."

Jiang Huaixing spoke up.

"If the migration is completed and the business goes live stably, then the hardware and technical service fees will be settled."

"During the pilot period, the technical support teams of Xinghan and White Star will also be stationed on-site to coordinate and troubleshoot faults."

As soon as this condition came out, the few people opposite each other exchanged glances and then nodded slightly.

But before they could go deeper, Song Zhi's phone received a backend alarm push.

He glanced at it, his expression slightly tightening.

Jiang Huaixing saw his change and asked in a low voice.

"What's wrong?"

"Over overseas, the second batch of replica teams hasn't given up."

Song Zhi forwarded the message to Jiang Huaixing.

"This time, they abandoned directly copying the leaked weights and switched to using distillation methods instead."

"They took the data returned by our public API to train a brand new small model."

"This even bypassed the legal issues of weight plagiarism."

"Distillation?"

Jiang Huaixing raised an eyebrow.

"This method is indeed more clever than before."

"Instead of directly stealing our weights, they only use a large number of QA samples to train a new model."

"In this way, it would be very troublesome even if we wanted to sue them for plagiarism."

"That's right."

Song Zhi replied.

"Previously, our steganographic watermarks were mainly aimed at model output text."

"And because the distilled model did not directly inherit the weights, it is difficult for the old traceability methods to directly lock onto evidence."

The chief engineer attending the meeting opposite heard the conversation, looked thoughtful, and said.

"Many small teams overseas are currently researching this approach."

"It's equivalent to using your model as a teacher to batch-generate teaching data and train their own student models."

...

Subsequently, the meeting was suspended.

Jiang Huaixing thought for a moment and quickly determined the direction.

"Have the technical team add a new task: develop a traceability solution targeting model distillation."

"Not only must we embed markers in the final text, but we also need to implant characteristic samples into the teaching data."

"As long as they use the data produced by our API to train the distilled model,"

"then when the new model answers, the specific test samples we designed will appear..."

Song Zhi noted down the main points and said.

"Alright, President Jiang, I understand."