❌

Normal view

HS Hyosung Information Systems Holds Data Center Modernization Conference 2026

16 September 2026 at 02:12

HS Hyosung Information Systems, an AI and data infrastructure solutions provider, held its Data Center Modernization Conference 2026 at Lotte Hotel Busan on Sept. 15. The conference is an annual event that HS Hyosung Information Systems has held for IT professionals in the Busan and South Gyeongsang region for more than a decade.

HS Hyosung Information Systems said it shared strategies and insights for data center modernization in the AI era, including data and infrastructure strategies for enterprise AI, more efficient private cloud operations and ways to strengthen cyber resilience.

According to HS Hyosung Information Systems, data center infrastructure is increasingly required to reliably process and operate large-scale AI workloads and vast amounts of data, driving a shift toward redesigning overall infrastructure to integrate AI infrastructure, cloud operations and data protection.

In response to these changes, the conference broadly covered key infrastructure strategies required for data centers, including data and infrastructure development for enterprise AI, modernization of AI training and inference environments, greater efficiency in private cloud and data center operations, and security and data protection.

Dong-soo Kwon, a senior expert at HS Hyosung Information Systems, delivered a keynote presentation titled "Data and Infrastructure Strategies for Enterprise AI in the Agentic AI Era of 2026." Go-hoon Jung, a project manager at HS Hyosung Information Systems, then outlined the company's capabilities and strategies for building private clouds through a smart city development project case study. Dong-hyuk Kim, a team leader at HS Hyosung Information Systems, also presented data protection and recovery strategies designed to support uninterrupted business operations amid disasters and cyber threats.

Major technology partners also participated. FuriosaAI showcased its RNGD neural processing unit (NPU), which supports high power efficiency and high-performance inference, while Lablup presented modernization tools for efficient AI training and inference.

VMware by Broadcom shared ways to reduce data center costs using VMware Cloud Foundation (VCF), while Veeam Software presented next-generation service recovery strategies for zero-trust environments. Palo Alto Networks Korea presented a data center modernization strategy using its Precision AI-based security platform.

The venue also featured exhibition booths where attendees could explore technologies and solutions from major partners including C Platform, Ocean Technology, Gensys and Union Biometrics.

SK Telecom Proposes RCS Standard for AI Payments

16 September 2026 at 02:12
A GSMA RCS standardization meeting at SKT Tower. (Photo: SK Telecom)
A GSMA RCS standardization meeting at SKT Tower. (Photo: SK Telecom)
A GSMA RCS standardization meeting at SKT Tower. (Photo: SK Telecom)
A GSMA RCS standardization meeting at SKT Tower. (Photo: SK Telecom)

SK Telecom (SKT) said it is hosting an in-person standardization meeting of the GSMA Rich Communication Services (RCS) group at SKT Tower in Seoul from Sept. 15 to 18, where participants will discuss ways to combine artificial intelligence (AI) with messaging services.

As AI's capabilities expand into real-world actions such as reservations and payments, SKT is seeking to redefine the role of messaging. The company envisions using messages as a channel through which AI agents obtain users' final approval before carrying out actions.

The GSMA RCS group is a body under the GSMA where global telecommunications carriers, device and platform companies, and business messaging providers discuss RCS technical standards and service specifications. The SKT-hosted meeting is attended by 33 representatives, including staff from 16 companies — global carriers AT&T, T-Mobile, Vodafone and Orange, as well as Apple, Google and Samsung Electronics — along with GSMA officials. RCS is a next-generation messaging standard that supports features such as photo and video transmission through smartphones' native messaging apps.

An AI special session has been added to the meeting alongside regular standardization topics. SKT proposed the AI agenda to the GSMA and agreed to hold a special session titled "AI and the Evolution of Messaging" on Sept. 17. SKT also led the organization of the session and recruitment of participating companies.

The session will cover the integration of RCS and AI agents, trust in AI and user control, improvements to brand registration using AI, and AI-based spam prevention for business messaging. Participants will share their technologies and service experience and discuss the functions and roles messaging will require in the AI era.

User control is at the heart of discussions about connecting AI with RCS. As AI agents increasingly execute actual transactions, users need to directly review and approve key information such as order details and payment amounts before a transaction is finalized. If that confirmation takes place within the AI service itself, however, it could be affected by malfunctions or external manipulation. Different approval methods among AI agents could also make it difficult for users to determine whether a request is legitimate.

To address the issue, SKT has proposed "AI Agent Approval over RCS" as a standardization agenda, using RCS as a separate channel outside the AI service where users can make the final decision. RCS can verify that the company requesting approval is legitimate because only pre-registered and verified businesses can display their names and logos.

Messages can also include product images and an "Approve" button, allowing users to respond without opening another app. Approval requests and results remain in the conversation history of the smartphone's native messaging app for later review.

Example of an RCS-based AI agent approval process. (Source: SK Telecom)
Example of an RCS-based AI agent approval process. (Source: SK Telecom)

For example, when an AI agent requests a product payment, the user can review the order details and payment amount in an RCS message and approve the transaction. This preserves the convenience of having AI perform tasks while leaving the final transaction decision to the user.

SKT said the role of telecommunications in the AI era will expand to connecting people with AI agents and that it plans to use its connectivity and authentication capabilities to build "AI trust infrastructure."

SKT said it has operated its own RCS network and services while working to incorporate features needed in Korea into global standards. Rich Text Formatting, which SKT proposed at a Seoul meeting in May last year, was incorporated into RCS Universal Profile 4.0 earlier this year. The company said the latest meeting will expand discussions to the convergence of RCS and AI while seeking opportunities for technical exchanges and cooperation with global carriers, device makers and messaging providers.

OpenAI Buys Glass Imaging for More Than $300 Million

16 September 2026 at 02:12
Glass Imaging's website. (Photo: Glass Imaging)
Glass Imaging's website. (Photo: Glass Imaging)

OpenAI has acquired smartphone camera artificial intelligence (AI) and imaging startup Glass Imaging Inc. for more than $300 million, The Wall Street Journal reported on Sept. 14. Neither OpenAI nor Glass Imaging has officially confirmed the deal, while foreign media have viewed the acquisition as a further expansion of OpenAI’s push into consumer hardware.

Glass Imaging develops AI-based image processing technology designed to overcome the physical limitations of smartphones’ small image sensors and lenses. The acquisition is drawing attention because OpenAI is developing consumer devices with renowned former Apple designer Jony Ive.

Ive led the design of Apple products including the iPhone, iPad and iPod. OpenAI has been developing new AI devices with Ive and his design firm LoveFrom since the fall of 2023.

Ive founded io Products Inc. in 2024 with Scott Cannon, Evans Hankey and Tang Tan, and OpenAI entered the consumer hardware market by acquiring io Products in May last year. OpenAI announced an all-stock transaction valuing io Products at $6.5 billion and completed the acquisition in July of the same year.

Following the acquisition, 55 hardware, software and product development employees, including former Apple staff at io Products, joined OpenAI. No new AI device has been officially announced, but Bloomberg reported last month that the first device under development by OpenAI and Ive is a donut-shaped, screenless smart speaker, with a price of $300 to $400 under discussion.

The industry is paying attention to OpenAI’s move to acquire AI camera technology.

If AI agents are embedded in smartphones, glasses, earbuds or other personal devices, cameras can serve as key sensors that allow AI to perceive the physical world. Current smart glasses allow users to show AI particular objects or places through a camera, enabling the AI to recognize, explain or analyze them.

Glass Imaging Uses AI Trained on Optical Characteristics to Overcome Smartphone Camera Limits

Founded in 2019, Glass Imaging is headquartered in Los Altos, California, and has raised $30 million in external funding. The company was valued at $100 million in a funding round last year. The latest acquisition represents a threefold increase in valuation.

Its co-founders, Ziv Attar and Tom Bishop, are also former Apple engineers. Attar founded Israeli camera startup LinX Imaging, which Apple acquired in 2015 for $20 million, bringing Attar to Apple.

Glass Imaging's website. (Photo: Glass Imaging)
Glass Imaging's website. (Photo: Glass Imaging)

Foreign media have reported that the two co-founders led the team that developed Apple’s Portrait Mode. Apple’s Portrait Mode brought the so-called bokeh effect to smartphones by distinguishing a subject from the background and blurring the latter.

Bokeh is a photography term referring to blurred areas, points of light or out-of-focus regions in the background of a photo or video. The term derives from the Japanese word “boke,” meaning blur or haze. Computational photography is a digital imaging technology that uses software calculations, algorithms and AI to overcome the physical limitations of optical lenses and sensors and to synthesize and improve images. It enables thin devices with small lens apertures and sensors, such as smartphones, to produce images approaching the quality of large DSLR cameras.

Glass Imaging’s technology takes original RAW data captured by a camera sensor and processes the entire post-capture imaging pipeline through a neural network.

A key feature is that the neural network is trained in advance on the specific camera system used in each smartphone model. It learns the characteristics of the camera types, sensors, lenses and other components of a particular camera system.

GlassAI Trains Neural Networks on Individual Camera Modules

At the core of Glass Imaging’s technology is GlassAI, a neural network-based image signal processor (ISP) software. Unlike conventional ISPs, which process RAW data through multiple stages including demosaicing, noise reduction, sharpening and frame fusion, GlassAI uses an end-to-end neural network to process RAW data into red, green and blue (RGB) images.

GlassAI performs those processes at once while also modeling the optical characteristics of individual lenses. The neural network is trained to reflect the optical and sensor characteristics of each smartphone camera module, allowing it to produce images tailored to that particular camera system during capture.

An Honor 600 smartphone equipped with Glass Imaging technology. The device uses a 200-megapixel camera and GlassAI for zoom photography without a telephoto lens. (Source: Honor)
An Honor 600 smartphone equipped with Glass Imaging technology. The device uses a 200-megapixel camera and GlassAI for zoom photography without a telephoto lens. (Source: Honor)

While conventional AI photography technologies focus on improving the quality of images after they are captured, GlassAI learns the physical characteristics of camera lenses and sensors and uses a neural network for the entire process of converting RAW data into images.

According to SiliconANGLE, GlassAI measures the point spread function (PSF) for each lens-and-sensor combination, along with sensor response and noise profiles, and trains the neural network to address the shortcomings of that specific combination. A PSF mathematically describes how a perfect point of light spreads after passing through an optical system such as a camera, telescope or microscope. As a result, a change in smartphone model requires training and tuning for the specific camera module.

Glass Imaging says the resulting detail is not newly generated by AI but information captured by the sensor that would otherwise be lost during conventional ISP processing. The company also says the technology becomes more effective as pixel sizes decrease.

According to an interview Glass Imaging machine-learning engineer Shivansh Rao gave to photography publication PetaPixel, submicron pixels contain fine details that conventional approaches cannot properly decode. Tests showed that as pixel size decreased from 0.75 micrometers (μm) to 0.35μm, the neural-network approach improved MTF50, a resolution metric, by more than 50%.

A comparison of zoomed images of the same subject taken with the Honor 600 and iPhone 17. Left, the Honor 600 processed with the GlassAI neural network; right, Apple’s iPhone 17. (Source: PetaPixel)
A comparison of zoomed images of the same subject taken with the Honor 600 and iPhone 17. Left, the Honor 600 processed with the GlassAI neural network; right, Apple’s iPhone 17. (Source: PetaPixel)

The technology is being used for zoom functionality in the 600 series from Chinese smartphone maker Honor Device Co. The Honor 600 uses a 200-megapixel main camera to provide zoom without a dedicated telephoto camera. It uses a 16-in-1 Hexa Bayer configuration that combines 16 0.56μm pixels into the equivalent of a 2.24μm superpixel for regular photography.

The challenge arises when zoom is used. Cropping part of the sensor rather than using its entire area to magnify an image requires information from the small native 0.56μm pixels. As pixels become smaller, they capture less light and become relatively more susceptible to optical limitations, noise and blur. The structure is inherently disadvantaged compared with using a dedicated telephoto lens.

Glass Imaging uses neural networks to compensate for those limitations. GlassAI, trained in advance on the lens and sensor characteristics of a camera module, analyzes RAW data from the sensor and restores details lost in conventional image processing. Glass Imaging says this allows high-resolution main-camera pixels to deliver higher-quality zoom images without adding a separate telephoto camera.

Zoom remains an area where smartphone cameras face physical limitations. Smartphones, constrained by thickness and size, cannot accommodate long optical systems like those used in DSLRs. Even with multiple cameras, each has a limited focal length, while digital zoom results in image-quality degradation.

The Honor 600 uses GlassAI to correct the effects of optical aberrations and sensor noise during smartphone zoom photography and restore image detail. Glass Imaging’s technology uses AI to compensate for the physical limitations of small sensors and lenses, enabling higher-quality zoom images in compact devices.

DeepSeek-V4.1-Flash Outpaces GPT-5.6 Sol on Some Agentic, Coding Tests

16 September 2026 at 02:12
DeepSeek-V4.1-Flash performance comparison with major frontier models on agentic benchmarks. (Source: Hugging Face model card)

DeepSeek has unveiled its latest artificial intelligence model, DeepSeek-V4.1-Flash. Although it has fewer parameters than DeepSeek's top-tier V4-Pro model, the new model showed advantages in performance, cost and speed that could make it a practical substitute for the flagship. It also outperformed V4-Pro on some agentic and coding benchmarks.

DeepSeek-V4.1-Flash sharply reduces not only the number of active parameters but also its key-value (KV) cache, while posting agentic and coding performance ahead of V4-Pro and, on some benchmarks, several frontier models. DeepSeek said Monday that it would begin consolidating its existing V4-Pro application programming interface (API) service into V4.1-Flash.

DeepSeek-V4.1-Flash uses a Mixture of Experts (MoE) architecture, which activates only selected expert networks depending on the input to improve computational efficiency. The model has 552 billion parameters in its backbone, with 8 billion active parameters during input processing and 16 billion during output generation.

The previous V4-Flash had 284 billion parameters and 13 billion active parameters. The top-end V4-Pro had 1.6 trillion parameters and 49 billion active parameters. Despite that difference, DeepSeek says V4.1-Flash delivers better performance than V4-Pro in agentic and coding tasks. The distinction between active parameters for input and output in DeepSeek-V4.1-Flash is particularly notable.

DeepSeek-V4.1-Flash is designed with a focus on agents and coding. According to DeepSeek, at the maximum reasoning intensity, or reasoning_effort=100, V4.1-Flash outperformed OpenAI's GPT-5.6 Sol and Anthropic's Claude Opus 5 on Terminal-Bench 2.1. DeepSeek also claims an advantage over the two models on DeepSWE v1.1 and AutomationBench.

DeepSeek-V4.1-Flash performance comparison with major frontier models on agentic benchmarks. (Source: Hugging Face model card)
DeepSeek-V4.1-Flash performance comparison with major frontier models on agentic benchmarks. (Source: Hugging Face model card)

Outside agentic and coding tasks, however, the model posted relatively lower scores on difficult general reasoning. Artificial Analysis (AA), an independent AI model evaluation platform, gave the model an Intelligence Index score of 40. That was well above the average for open-weight models but below the leading frontier models.

AA calculates its Intelligence Index by combining multiple evaluations, including GDPval-AA, AutomationBench-AA, SciCode, Humanity's Last Exam (HLE), CritPt and AA-LCR. DeepSeek-V4.1-Flash recorded scores including 1,632 on GDPval-AA v2, 69% on AutomationBench-AA, 52% on SciCode and 39% on HLE, leaving the model in the upper-middle range overall. The results indicate that the model can be highly efficient when deployed for coding-focused applications.

The score of 40 also reflects AA's recent changes to its evaluation methodology, which have lowered the overall scale of the index. AA upgraded its Intelligence Index from v4.2 to v4.3, making the evaluation set more difficult.

As a result, frontier models that previously scored well above 60 have been moved into the 50s under the revised methodology. Anthropic's Claude Fable 5.1, which had scored 66 under the previous v4.2 evaluation, now scores 53 under the revised system, alongside OpenAI's GPT-6 Astra.

DeepSeek's performance comparison between V4.1-Flash and other AI models, highlighting the model's claimed advantage in coding. (Source: Hugging Face model card)
DeepSeek's performance comparison between V4.1-Flash and other AI models, highlighting the model's claimed advantage in coding. (Source: Hugging Face model card)

AA's upgrade was driven in part by the replacement of Terminal-Bench 2.1 with Terminal-Bench 4.0. DeepSeek-V4.1-Flash outperformed GPT-5.6 Sol and Claude Opus 5 on Terminal-Bench 2.1, but fell behind them on Terminal-Bench 4.0.

Terminal-Bench 4.0 consists of 66 complex terminal tasks spanning software, machine learning, science, operations, security, hardware and media. It revised computing and time allowances and improved task descriptions, environments and verification logic to more finely distinguish performance among frontier models.

In terms of parameter size, DeepSeek-V4.1-Flash's Intelligence Index score is slightly below the 42 points recorded by GLM-5.3-Flash but is well above the median score of 18 for other open-weight models of a similar size. Under AA's stricter Intelligence Index, GLM-5.3-Flash ranks first among open-weight models, while Alibaba's Qwen 3.8 Max and DeepSeek-V4.1-Flash share second place at 40. DeepSeek V4 Pro 0813 scored 36.

DeepSeek-V4.1-Flash is also fast, as DeepSeek claims. Its output speed is about 214.4 tokens per second, while time to first token (TTFT) is 1.13 seconds. The median for comparable models is 65.4 tokens per second and 2.34 seconds for TTFT, making V4.1-Flash more than three times as fast by the output-speed measure. AA also rated it as “notably fast.”

Artificial Analysis' overall evaluation of DeepSeek-V4.1-Flash, including intelligence, speed, cost and verbosity metrics. (Source: Artificial Analysis)
Artificial Analysis' overall evaluation of DeepSeek-V4.1-Flash, including intelligence, speed, cost and verbosity metrics. (Source: Artificial Analysis)

The model has reduced its KV cache to 890 bytes per token. AA also viewed this as a significant strength. The reduction becomes more consequential when combined with DeepSeek-V4.1-Flash's pricing structure.

According to AA, DeepSeek-V4.1-Flash is priced competitively for input and output tokens, with an overall cost below the median of comparable models. Cache-hit pricing receives further reductions, while off-peak periods receive an additional 50% discount.

AA, however, said the model is “very verbose.” Its Intelligence Index evaluation used 250 million output tokens, substantially more than the 130 million median for similar open-weight models. The total cost of the evaluation was also recorded. Although the model is fast, the length of its responses can affect actual cost and completion time.

Still, AA said the model reaches the Pareto frontier on a cost-per-task basis. In other words, it is among the least expensive models at a comparable level of intelligence.

Artificial Analysis' AI model evaluation as of Sept. 14, with DeepSeek-V4.1-Flash indicated by the red arrow; lower task cost is better. (Source: Artificial Analysis)
Artificial Analysis' AI model evaluation as of Sept. 14, with DeepSeek-V4.1-Flash indicated by the red arrow; lower task cost is better. (Source: Artificial Analysis)

The reason DeepSeek-V4.1-Flash separates active parameters for input and output, unlike a conventional MoE model, lies in its Causal Encoder-Decoder (CED) architecture.

The term CED, or the concept behind it, was not created by DeepSeek. The term has been used since the late 2010s in fields including speech, time-series modeling and generative models. A paper on Alibaba's Qwen-Audio-VAE, published in July, also discusses CED. However, the CED used by DeepSeek in V4.1-Flash appears to be a different technology despite sharing the same name.

DeepSeek's CED makes the encoder causal rather than bidirectional and eliminates the need for cross-attention by projecting the encoder's final representation into the decoder's KV cache in a single operation. The structure appears to have been designed and named by DeepSeek for V4.1-Flash, and DeepSeek identifies it as a new architecture for its model in the official Hugging Face model card and technical documentation.

DeepSeek's CED in V4.1-Flash does three things: it changes the originally bidirectional encoder into a causal, sequential structure so it follows the same basic pretraining pattern used by today's autoregressive models; it eliminates the need for the decoder to query the encoder repeatedly through cross-attention by transferring the encoder's final output into the decoder cache in one operation; and it repurposes the architecture as a cost- and memory-saving mechanism inside a conversational chatbot.

Artificial Analysis' upgrade from Terminal-Bench 2.1 to Terminal-Bench 4.0; DeepSeek-V4.1-Flash led frontier models on Terminal-Bench 2.1 but ranked lower on Terminal-Bench 4.0. (Source: Artificial Analysis)
Artificial Analysis' upgrade from Terminal-Bench 2.1 to Terminal-Bench 4.0; DeepSeek-V4.1-Flash led frontier models on Terminal-Bench 2.1 but ranked lower on Terminal-Bench 4.0. (Source: Artificial Analysis)

According to DeepSeek's technical report, the 40 Transformer layers in V4.1-Flash are divided into 20 causal encoder layers and 20 decoder layers. Instead of generating global KV separately at each decoder layer, the model projects the decoder's global KV from the final hidden state of the encoder.

DeepSeek's CED architecture does not correspond directly to either the original Transformer encoder-decoder architecture or the decoder-only architecture used by most modern large language models (LLMs). According to DeepSeek's technical documentation, it differs in three key ways.

First, the encoder itself is causal. In the original encoder-decoder architecture, the encoder reads a sentence bidirectionally, looking both forward and backward. In DeepSeek's CED, the encoder also reads sequentially, from left to right. This is why it is called a causal encoder. Making the encoder causal in the same way as the decoder allows all 40 layers to operate under a consistent causal scheme, simplifying training.

Second, DeepSeek eliminates cross-attention, through which the decoder would otherwise query information from the encoder in real time at every layer and for every generated token. Cross-attention is an attention mechanism in which one part of a model references information held by another part rather than relying only on its own representations.

How DeepSeek CED Differs From Encoder-Decoder and Decoder-Only Models

Early Transformer-based models used an encoder-decoder architecture, while most generative large language models (LLMs) today use a decoder-only architecture.

In an encoder-decoder model, dozens of layers are stacked sequentially. When a user submits a question or instruction, the input passes through the layers from the first to the last, becoming progressively more refined and processed. The process of understanding the user's prompt and the process of generating a response are handled through the same architecture, requiring the model to pass through all of those layers during processing.

If a user attaches a very long document, or an AI agent performs a continuous sequence of tasks over an extended period as the conversation history keeps growing, the AI must repeatedly process that information through dozens of layers. Each layer leaves key-value (KV) cache states to retain important information. In general, the more layers a model has, the more KV states need to be stored. That is why KV cache is considered a major bottleneck and a significant source of rising costs in AI service operations.

This traces back to the Transformer introduced by Google researchers in 2017, when machine translation was presented as a key application. In an English-to-Korean translation example, the architecture can broadly be divided into an encoder, which reads the entire English source sentence, and a decoder, which uses that understanding to generate the Korean translation.

The key point is that the encoder reads the sentence bidirectionally. For example, when processing the fifth word of a sentence, the encoder can refer not only to the first four words but also to all words after the sixth. This is similar to a person reading an entire sentence before determining its context.

Once the encoder has fully processed the source sentence in both directions, the decoder uses that representation to generate the translation one word at a time. The decoder operates only from left to right, or causally. To generate the next word, it can refer to words it has already produced, but cannot see words that have not yet been generated.

When generating each word, however, the decoder does more than look at the words it has previously produced. It also references the representations generated by the encoder from the input tokens. This process is known as cross-attention. Crucially, cross-attention occurs at every decoder layer and each time a word is generated.

In other words, whether at the fifth decoder layer or the 20th, the decoder repeatedly references information produced by the encoder in real time. This architecture is useful for tasks such as translation and summarization, where the input and output may be in different languages or have substantially different formats.

Today's widely used models, including GPT and Claude, generally use a decoder-only architecture rather than the traditional encoder-decoder structure. The encoder and decoder are not separated. Instead, the user's question and the AI's response are combined into a single long sequence of text, which is processed by one set of layers entirely in a causal, left-to-right manner.

The process of understanding the question and the process of generating the answer therefore share the same layers and parameters. The architecture is relatively simple and efficient to train, helping decoder-only models become an industry standard following the GPT series. Its drawback is that a long input must pass through all layers when it is initially processed to generate the KV cache, while the memory burden of storing and managing the cache increases as conversations grow longer.

DeepSeek's Causal Encoder-Decoder (CED) architecture attempts to reduce this repeated processing. The basic idea is relatively straightforward: instead of treating all 40 workstations as a single processing line, the model divides them into two groups of 20 with distinct roles.

The first 20 workstations, or encoder layers, process the input and produce the final hidden states. The user's question or document is read once and transformed into a representation that can be used by subsequent computations. The second 20 workstations, or decoder layers, generate the response based on that information and construct the KV states needed during generation.

Third, the roles of the encoder and decoder are changed. The model separates input understanding from response generation while continuing to operate as a single conversational chatbot from the user's perspective. Internally, the input-processing portion activates 8 billion parameters, while the output-generation portion activates 16 billion.

Early Transformer-based models used an encoder-decoder architecture, while most current generative LLMs use a decoder-only architecture.

GDPval-AA evaluation of DeepSeek-V4.1-Flash, measuring performance on complex professional tasks across industries and occupations. (Source: Artificial Analysis)
GDPval-AA evaluation of DeepSeek-V4.1-Flash, measuring performance on complex professional tasks across industries and occupations. (Source: Artificial Analysis)
SWA and DeepSeek’s SWA Bounded Replay

AI models broadly rely on two types of information when generating a response: global memory and local memory. Global memory maintains information across a long context. In DeepSeek's Causal Encoder-Decoder (CED) architecture, the encoder processes the entire input and uses its final hidden states to generate the decoder's global key-value (KV) cache. This global KV cache maintains an overall representation of the long context.

But when a large language model (LLM) generates a response, it needs more than an understanding of the entire context. It also needs fine-grained information within a very narrow context, such as which word it has just used or how the preceding sentence ended. Information from the full long context alone may not adequately preserve such details, making a separate form of local memory necessary. Sliding Window Attention (SWA) is a mechanism that allows tokens within only a recent portion of the sequence to attend to one another.

In DeepSeek's CED architecture, however, the decoder does not retain its SWA local state in full. DeepSeek therefore uses a separate mechanism called SWA Bounded Replay to compensate for the missing local state.

In DeepSeek's CED architecture, the decoder does not repeatedly process the entire prompt as conventional decoder layers would. The first 20 encoder layers process the full prompt and produce the final hidden states, which are then used to construct the global KV cache for the following 20 decoder layers. The decoder can therefore access information from the entire input processed by the encoder through the global KV cache.

That does not mean the model lacks local context information. Response generation still requires fine-grained information from a narrow context, such as the word just generated or the immediately preceding sentence. DeepSeek-V4.1-Flash addresses this by maintaining SWA state only for the most recent 128 tokens. Rather than continuously storing local KV on a solid-state drive (SSD), the model can reprocess the most recent 128 tokens when needed to reconstruct the local state. This is the role of SWA Bounded Replay.

With SWA Bounded Replay, DeepSeek-V4.1-Flash performs a short replay process in which only the final 128 tokens of the prompt pass through the 20 decoder layers. This allows the decoder to recover local memory, or SWA state, for the immediately preceding context. The process is called “bounded” because the replay is limited to the most recent 128 tokens rather than the full prompt, and “replay” because the decoder recalculates the information to recover the recent context. The approach is a key part of DeepSeek's effort to improve cost efficiency.

Under a conventional decoder architecture, preserving local memory would require an SWA cache containing recent-context information to be retained for the full length of the prompt. As conversations become longer and prompts grow, the amount of storage required also increases, eventually creating a need to move the cache to disk or an SSD.

SWA Bounded Replay significantly reduces the need for such local-memory storage. When the local state is needed, just before response generation, the system can immediately recalculate the most recent 128 tokens, use the resulting state and then discard it. Instead of storing the SWA KV state on an SSD, the system reconstructs it by replaying the most recent 128 tokens when required.

DeepSeek says this approach eliminates persistent SSD storage for SWA KV and, as a result, reduces the overall persistent KV cache footprint to about one-eighth that of the previous V4-Flash. While CED's reuse of global memory reduces computation and the amount of global cache that needs to be maintained, SWA Bounded Replay serves as a complementary mechanism that fills the structural gap in local memory at a small, fixed computational cost while also reducing storage requirements.

Another technology used to reduce the KV cache is △Compressed Sparse Attention 2 (CSA2), △along with FP4 quantization. CSA2 allows multiple layers to share and reuse KV and attention indices, reducing the duplication that would otherwise occur when each layer maintains its own cache. FP4 quantization stores the global KV cache using four-bit floating-point values, reducing storage requirements compared with FP8.

DeepSeek introduced the first version of Compressed Sparse Attention (CSA) in V4. While DeepSeek Sparse Attention (DSA) selects important KV entries and performs attention only on a subset of them in long contexts, CSA first compresses the KV representations of multiple tokens into shorter representations and then sparsely selects the information it needs. In other words, CSA combines KV compression with sparse selection to reduce both KV cache size and attention computation for long contexts.

V4.1-Flash advances the approach to CSA2. Each attention layer is assigned one of three modes — Full, Reindex or Reuse — allowing multiple attention layers to share and reuse KV and the locations of important information rather than recalculating the same information at every layer. Some layers perform new calculations while others reuse existing results, reducing the memory and computation required for long contexts. Combined with FP4 KV caching, the global KV cache is reduced to 890 bytes per token, about one-quarter the size of the V4-Flash cache.

Reducing the number of active parameters while maintaining performance lowers the GPU memory and computational resources required to run an AI model. That can reduce server operating and power costs and allow the same GPU resources to handle more simultaneous requests. Lower computational requirements can also reduce latency and make deployment on lower-end GPUs, on-premises servers rather than cloud infrastructure, and edge AI systems easier.

AutomationBench-AA evaluation of DeepSeek-V4.1-Flash, which measures an AI agent's ability to integrate with business software and complete automated tasks. (Source: Artificial Analysis)
AutomationBench-AA evaluation of DeepSeek-V4.1-Flash, which measures an AI agent's ability to integrate with business software and complete automated tasks. (Source: Artificial Analysis)

If total parameters can be reduced while maintaining the same performance, the model's weight memory can also be reduced, which is the ideal outcome. If that is not possible, reducing the active parameters in an MoE model is the next-best option because fewer active parameters also mean fewer computations.

DeepSeek-V4.1-Flash has a total of 552 billion parameters, which is substantial, but activates only 8 billion parameters for input and 16 billion for output. CSA2 also sharply reduces the KV cache, allowing GPU memory to be used more efficiently. The fact that DeepSeek developed and actively deployed technologies such as CSA2 and CED in the model is particularly notable.

DeepSeek is not alone. Chinese AI companies including Moonshot AI, developer of the Kimi family, and Alibaba, developer of Qwen, are expanding model parameter counts or advancing their models through proprietary technologies. Questions remain, however, over allegations that some Chinese AI companies illegally distilled capabilities from U.S. frontier models.

Anthropic recently said that seven Chinese AI companies had attempted to extract capabilities from its Claude models without authorization, and disclosed cases involving Alibaba, Moonshot AI and DeepSeek.

According to Anthropic's findings, Alibaba linked more than 151 million interactions with Claude to its own models. Anthropic said Alibaba created large numbers of accounts to send queries to Claude and collect its responses, then used the data to train or improve its own AI models. In effect, Claude's responses were used as teacher-model data.

In Moonshot AI's case, more than 23 million interactions were identified. Particularly problematic, according to Anthropic, was that Moonshot forwarded questions entered by actual Kimi users to Claude and then displayed Claude's responses to those users as if they had been generated by Kimi. Anthropic also said Moonshot subsequently used the collected user questions and Claude responses in developing its own models.

For DeepSeek, Anthropic said it identified about 12.1 million interactions. Anthropic alleged that DeepSeek also sent large numbers of queries to Claude to collect responses and used them for model distillation.

❌