arXiv subjects

Y. Charles

Publications and source records attributed to Y. Charles.

At least 19 recordsLinked to original sources

arXiv2026

Kimi K3: Open Frontier Intelligence

We introduce Kimi K3, a 2.8T parameter Mixture-of-Experts model with 104 billion activated parameters, native vision capabilities, and a 1-million-token context window. Kimi K3 is built on Kimi Delta Attention and Attention Residuals, which improve information flow across sequence length and model depth. Together with Stable LatentMoE, which effectively activates 16 of 896 routed experts per token, and refined training and data recipes, these advances yield an approximately 2.5x improvement in overall scaling efficiency over Kimi K2. Post-training highlights reinforcement learning across general, agentic, and coding domains and multiple reasoning-effort levels, enabling compositional generalization and robust long-horizon execution. At 2.8T scale, Kimi K3 is supported by infrastructure advances in multiple areas: algorithm-system co-design for KDA, perfectly balanced expert-parallel training with efficient memory management, million-token agentic RL with persistent rollout and sandbox states, and deployment innovations. Extensive evaluations show that Kimi K3 achieves frontier-level performance across long-horizon coding, agentic, knowledge, reasoning, and vision tasks. While its overall performance still trails the most powerful proprietary models, namely Claude Fable 5 and GPT-5.6 Sol, Kimi K3 consistently outperforms other open and proprietary models evaluated in our suite. We release the full Kimi K3 model weights to facilitate future research and accelerate the broader deployment and adoption of frontier intelligence.

cs.CL↗

arXiv2026

PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models

We introduce PerceptionBench, a benchmark specifically designed to evaluate the atomic visual perception capabilities of Multimodal Large Language Models (MLLMs). Existing benchmarks often fail to isolate perception: holistic evaluations conflate perceptual errors with failures in reasoning or domain knowledge, while application-driven benchmarks only cover narrow, fragmented domains shaped by heuristic designs. To address these limitations, PerceptionBench adopts a bottom-up approach: by diagnosing the earliest failure points in the responses of frontier MLLMs across 42 existing benchmarks, we construct an error taxonomy whose perception branch defines ten atomic perceptual capabilities. Guided by this taxonomy, we construct 3,000 verified questions with short, unambiguous answers, each isolating a single capability, with difficulty stemming from perception rather than reasoning or knowledge. Benchmark results across sixteen frontier MLLMs reveal that atomic perception remains largely unsolved---no model reaches 60\% accuracy, perception-related hallucination is the weakest capability on average, and similar overall scores conceal sharply divergent capability profiles. PerceptionBench thus provides a capability-level standard for measuring and diagnosing the visual perception boundaries of MLLMs.

cs.CV↗

arXiv2026

Attention Residuals

Residual connections with PreNorm are standard in modern LLMs, yet they accumulate all layer outputs with fixed unit weights. This uniform aggregation causes uncontrolled hidden-state growth with depth, progressively diluting each layer's contribution. We propose Attention Residuals (AttnRes), which replaces this fixed accumulation with softmax attention over preceding layer outputs, allowing each layer to selectively aggregate earlier representations with learned, input-dependent weights. To address the memory and communication overhead of attending over all preceding layer outputs for large-scale model training, we introduce Block AttnRes, which partitions layers into blocks and attends over block-level representations, reducing the memory footprint while preserving most of the gains of full AttnRes. Combined with cache-based pipeline communication and a two-phase computation strategy, Block AttnRes becomes a practical drop-in replacement for standard residual connections with minimal overhead. Scaling law experiments confirm that the improvement is consistent across model sizes, and ablations validate the benefit of content-dependent depth-wise selection. We further integrate AttnRes into the Kimi Linear architecture (48B total / 3B activated parameters) and pre-train on 1.4T tokens, where AttnRes mitigates PreNorm dilution, yielding more uniform output magnitudes and gradient distribution across depth, and improves downstream performance across all evaluated tasks.

cs.CL↗

arXiv2026

Cold and eccentric: a high-spectral resolution view of 51 Eri b with VLT/HiRISE

Discovered almost 10 years ago, the giant planet 51 Eridani b is one of the least separated (0.2 arcsec) and faintest (J = 19.74 mag) directly imaged exoplanets known to date. Its atmospheric properties have been thoroughly investigated through low- and medium-resolution spectroscopic observations, enabling robust characterization of the planet's bulk parameters. However, the planet's intrinsically high contrast renders high-resolution spectroscopic observations difficult, despite their potential to yield key measurements essential for a more comprehensive characterization. This study seeks to constrain the planet's radial velocity, enabling a full 3D orbital solution when integrated with previous measurements. We have obtained 4 high-contrast high-resolution (R = 140000) spectroscopic datasets of the planet, collected over a two-year interval with the HiRISE visitor instrument at the VLT to derive the planet's radial velocity. Using self-consistent models of atmosphere, we were able to derive the radial velocity of the planet at each of the 4 epochs. These radial velocity measurements were then used in combination with all existing relative astrometry in order to constrain the orbit of the planet. Our radial velocity measurements allow us to break the degeneracy along the line of sight, making it now possible the unambiguous interpretation of the phase curve of the companion. We further constrain the orbital parameters, particularly the eccentricity, for which we derive e = 0.55 (-0.07, +0.03). The relatively high eccentricity indicates that the system has experienced dynamical interactions induced by an external perturber. We place constraints on the mass and semi-major axis of a hypothetical, unseen outer planet capable of producing the observed high eccentricities.

astro-ph.EP↗

arXiv2026

Kimi K2.5: Visual Agentic Intelligence

We introduce Kimi K2.5, an open-source multimodal agentic model designed to advance general agentic intelligence. K2.5 emphasizes the joint optimization of text and vision so that two modalities enhance each other. This includes a series of techniques such as joint text-vision pre-training, zero-vision SFT, and joint text-vision reinforcement learning. Building on this multimodal foundation, K2.5 introduces Agent Swarm, a self-directed parallel agent orchestration framework that dynamically decomposes complex tasks into heterogeneous sub-problems and executes them concurrently. Extensive evaluations show that Kimi K2.5 achieves state-of-the-art results across various domains including coding, vision, reasoning, and agentic tasks. Agent Swarm also reduces latency by up to $4.5\times$ over single-agent baselines. We release the post-trained Kimi K2.5 model checkpoint to facilitate future research and real-world applications of agentic intelligence.

cs.CL↗

arXiv2026

WorldVQA: Measuring Atomic World Knowledge in Multimodal Large Language Models

We introduce WorldVQA, a benchmark designed to evaluate the atomic visual world knowledge of Multimodal Large Language Models (MLLMs). Unlike current evaluations, which often conflate visual knowledge retrieval with reasoning, WorldVQA decouples these capabilities to strictly measure "what the model memorizes." The benchmark assesses the atomic capability of grounding and naming visual entities across a stratified taxonomy, spanning from common head-class objects to long-tail rarities. We expect WorldVQA to serve as a rigorous test for visual factuality, thereby establishing a standard for assessing the encyclopedic breadth and hallucination rates of current and next-generation frontier models.

cs.CV↗

arXiv2026

Towards Pixel-Level VLM Perception via Simple Points Prediction

We present SimpleSeg, a strikingly simple yet highly effective approach to endow Multimodal Large Language Models (MLLMs) with native pixel-level perception. Our method reframes segmentation as a simple sequence generation problem: the model directly predicts sequences of points (textual coordinates) delineating object boundaries, entirely within its language space. To achieve high fidelity, we introduce a two-stage SF$\to$RL training pipeline, where Reinforcement Learning with an IoU-based reward refines the point sequences to accurately match ground-truth contours. We find that the standard MLLM architecture possesses a strong, inherent capacity for low-level perception that can be unlocked without any specialized architecture. On segmentation benchmarks, SimpleSeg achieves performance that is comparable to, and often surpasses, methods relying on complex, task-specific designs. This work lays out that precise spatial understanding can emerge from simple point prediction, challenging the prevailing need for auxiliary components and paving the way for more unified and capable VLMs. Homepage: https://simpleseg.github.io/

cs.CV↗

arXiv2025

OpenCUA: Open Foundations for Computer-Use Agents

Vision-language models have demonstrated impressive capabilities as computer-use agents (CUAs) capable of automating diverse computer tasks. As their commercial potential grows, critical details of the most capable CUA systems remain closed. As these agents will increasingly mediate digital interactions and execute consequential decisions on our behalf, the research community needs access to open CUA frameworks to study their capabilities, limitations, and risks. To bridge this gap, we propose OpenCUA, a comprehensive open-source framework for scaling CUA data and foundation models. Our framework consists of: (1) an annotation infrastructure that seamlessly captures human computer-use demonstrations; (2) AgentNet, the first large-scale computer-use task dataset spanning 3 operating systems and 200+ applications and websites; (3) a scalable pipeline that transforms demonstrations into state-action pairs with reflective long Chain-of-Thought reasoning that sustain robust performance gains as data scales. Our end-to-end agent models demonstrate strong performance across CUA benchmarks. In particular, OpenCUA-72B achieves an average success rate of 45.0% on OSWorld-Verified, establishing a new state-of-the-art (SOTA) among open-source models. Further analysis confirms that our approach generalizes well across domains and benefits significantly from increased test-time computation. We release our annotation tool, datasets, code, and models to build open foundations for further CUA research.

cs.AI↗

arXiv2025

Kimi K2: Open Agentic Intelligence

We introduce Kimi K2, a Mixture-of-Experts (MoE) large language model with 32 billion activated parameters and 1 trillion total parameters. We propose the MuonClip optimizer, which improves upon Muon with a novel QK-clip technique to address training instability while enjoying the advanced token efficiency of Muon. Based on MuonClip, K2 was pre-trained on 15.5 trillion tokens with zero loss spike. During post-training, K2 undergoes a multi-stage post-training process, highlighted by a large-scale agentic data synthesis pipeline and a joint reinforcement learning (RL) stage, where the model improves its capabilities through interactions with real and synthetic environments. Kimi K2 achieves state-of-the-art performance among open-source non-thinking models, with strengths in agentic capabilities. Notably, K2 obtains 66.1 on Tau2-Bench, 76.5 on ACEBench (En), 65.8 on SWE-Bench Verified, and 47.3 on SWE-Bench Multilingual -- surpassing most open and closed-sourced baselines in non-thinking settings. It also exhibits strong capabilities in coding, mathematics, and reasoning tasks, with a score of 53.7 on LiveCodeBench v6, 49.5 on AIME 2025, 75.1 on GPQA-Diamond, and 27.1 on OJBench, all without extended thinking. These results position Kimi K2 as one of the most capable open-source large language models to date, particularly in software engineering and agentic tasks. We release our base and post-trained model checkpoints to facilitate future research and applications of agentic intelligence.

cs.LG↗

arXiv2025

VideoReasonBench: Can MLLMs Perform Vision-Centric Complex Video Reasoning?

Recent studies have shown that long chain-of-thought (CoT) reasoning can significantly enhance the performance of large language models (LLMs) on complex tasks. However, this benefit is yet to be demonstrated in the domain of video understanding, since most existing benchmarks lack the reasoning depth required to demonstrate the advantages of extended CoT chains. While recent efforts have proposed benchmarks aimed at video reasoning, the tasks are often knowledge-driven and do not rely heavily on visual content. To bridge this gap, we introduce VideoReasonBench, a benchmark designed to evaluate vision-centric, complex video reasoning. To ensure visual richness and high reasoning complexity, each video in VideoReasonBench depicts a sequence of fine-grained operations on a latent state that is only visible in part of the video. The questions evaluate three escalating levels of video reasoning skills: recalling observed visual information, inferring the content of latent states, and predicting information beyond the video. Under such task setting, models have to precisely recall multiple operations in the video, and perform step-by-step reasoning to get correct final answers for these questions. Using VideoReasonBench, we comprehensively evaluate 18 state-of-the-art multimodal LLMs (MLLMs), finding that most perform poorly on complex video reasoning -- e.g., GPT-4o achieves only 6.9% accuracy -- while the thinking-enhanced Gemini-2.5-Pro significantly outperforms others with 56.0% accuracy. Our investigations on "test-time scaling" further reveal that extended thinking budget, while offering none or minimal benefits on existing video benchmarks, is essential for improving the performance on VideoReasonBench.

cs.CV↗

arXiv2025

Kimi-Audio Technical Report

We present Kimi-Audio, an open-source audio foundation model that excels in audio understanding, generation, and conversation. We detail the practices in building Kimi-Audio, including model architecture, data curation, training recipe, inference deployment, and evaluation. Specifically, we leverage a 12.5Hz audio tokenizer, design a novel LLM-based architecture with continuous features as input and discrete tokens as output, and develop a chunk-wise streaming detokenizer based on flow matching. We curate a pre-training dataset that consists of more than 13 million hours of audio data covering a wide range of modalities including speech, sound, and music, and build a pipeline to construct high-quality and diverse post-training data. Initialized from a pre-trained LLM, Kimi-Audio is continual pre-trained on both audio and text data with several carefully designed tasks, and then fine-tuned to support a diverse of audio-related tasks. Extensive evaluation shows that Kimi-Audio achieves state-of-the-art performance on a range of audio benchmarks including speech recognition, audio understanding, audio question answering, and speech conversation. We release the codes, model checkpoints, as well as the evaluation toolkits in https://github.com/MoonshotAI/Kimi-Audio.

eess.AS↗

arXiv2025

Kimi-VL Technical Report

We present Kimi-VL, an efficient open-source Mixture-of-Experts (MoE) vision-language model (VLM) that offers advanced multimodal reasoning, long-context understanding, and strong agent capabilities - all while activating only 2.8B parameters in its language decoder (Kimi-VL-A3B). Kimi-VL demonstrates strong performance across challenging domains: as a general-purpose VLM, Kimi-VL excels in multi-turn agent tasks (e.g., OSWorld), matching flagship models. Furthermore, it exhibits remarkable capabilities across diverse challenging vision language tasks, including college-level image and video comprehension, OCR, mathematical reasoning, and multi-image understanding. In comparative evaluations, it effectively competes with cutting-edge efficient VLMs such as GPT-4o-mini, Qwen2.5-VL-7B, and Gemma-3-12B-IT, while surpassing GPT-4o in several key domains. Kimi-VL also advances in processing long contexts and perceiving clearly. With a 128K extended context window, Kimi-VL can process diverse long inputs, achieving impressive scores of 64.5 on LongVideoBench and 35.1 on MMLongBench-Doc. Its native-resolution vision encoder, MoonViT, further allows it to see and understand ultra-high-resolution visual inputs, achieving 83.2 on InfoVQA and 34.5 on ScreenSpot-Pro, while maintaining lower computational cost for common tasks. Building upon Kimi-VL, we introduce an advanced long-thinking variant: Kimi-VL-Thinking-2506. Developed through long chain-of-thought (CoT) supervised fine-tuning (SFT) and reinforcement learning (RL), the latest model exhibits strong long-horizon reasoning capabilities (64.0 on MMMU, 46.3 on MMMU-Pro, 56.9 on MathVision, 80.1 on MathVista, 65.2 on VideoMMMU) while obtaining robust general abilities. Code and models are publicly accessible at https://github.com/MoonshotAI/Kimi-VL.

cs.CV↗

arXiv2025

Characterization of AF Lep b at high spectral resolution with VLT/HiRISE

Since the recent discovery of the directly imaged super-Jovian planet AF Lep b, several studies have been conducted to characterize its atmosphere and constrain its orbital parameters. AF Lep b has a measured dynamical mass of $3.68 \pm 0.48$ MJup, a radius of $1.3 \pm 0.15$ RJup, a nearly circular orbit in spin-orbit alignment with the host star, a relatively high metallicity, and a near-solar to super-solar C/O ratio. However, key parameters such as the rotational velocity and radial velocity could not be estimated as they require high-resolution spectroscopic data that is impossible to obtain with classical spectrographs. AF Lep b was recently observed with the new HiRISE visitor instrument at the VLT, with the goal of obtaining high-resolution (R~140,000) spectroscopic observations to better constrain the orbital and atmospheric parameters of the young giant exoplanet. We compare the extracted spectrum of AF Lep b to self-consistent atmospheric models using ForMoSA. We then use our measurements of the radial velocity of the planet to provide new constraints on the orbit of the planet. From the forward modeling, we find a C/O ratio that aligns with previous low-resolution analyses, and we confirm the super-solar metallicity. We also confirm unambiguously the presence of methane in the atmosphere of the companion. Based on all available relative astrometry and radial velocity measurements of the host star, we show that two distinct orbital populations are possible for the companion. We derive the radial velocity of AF Lep b to be $10.51 \pm 1.03$ km/s, and show that this value agrees well with one of the two orbital solutions, allowing us to rule out an entire family of orbits. Additionally, assuming that the rotation and orbit are coplanar, the derived planet's rotation rate is consistent with the observed trend of increasing spin velocity with higher planet mass.

astro-ph.EP↗

arXiv2025

Kimi k1.5: Scaling Reinforcement Learning with LLMs

Language model pretraining with next token prediction has proved effective for scaling compute but is limited to the amount of available training data. Scaling reinforcement learning (RL) unlocks a new axis for the continued improvement of artificial intelligence, with the promise that large language models (LLMs) can scale their training data by learning to explore with rewards. However, prior published work has not produced competitive results. In light of this, we report on the training practice of Kimi k1.5, our latest multi-modal LLM trained with RL, including its RL training techniques, multi-modal data recipes, and infrastructure optimization. Long context scaling and improved policy optimization methods are key ingredients of our approach, which establishes a simplistic, effective RL framework without relying on more complex techniques such as Monte Carlo tree search, value functions, and process reward models. Notably, our system achieves state-of-the-art reasoning performance across multiple benchmarks and modalities -- e.g., 77.5 on AIME, 96.2 on MATH 500, 94-th percentile on Codeforces, 74.9 on MathVista -- matching OpenAI's o1. Moreover, we present effective long2short methods that use long-CoT techniques to improve short-CoT models, yielding state-of-the-art short-CoT reasoning results -- e.g., 60.8 on AIME, 94.6 on MATH500, 47.3 on LiveCodeBench -- outperforming existing short-CoT models such as GPT-4o and Claude Sonnet 3.5 by a large margin (up to +550%).

cs.AI↗

arXiv2023

First light of VLT/HiRISE: High-resolution spectroscopy of young giant exoplanets

A major endeavor of this decade is the direct characterization of young giant exoplanets at high spectral resolution to determine the composition of their atmosphere and infer their formation processes and evolution. Such a goal represents a major challenge owing to their small angular separation and luminosity contrast with respect to their parent stars. Instead of designing and implementing completely new facilities, it has been proposed to leverage the capabilities of existing instruments that offer either high contrast imaging or high dispersion spectroscopy, by coupling them using optical fibers. In this work we present the implementation and first on-sky results of the HiRISE instrument at the very large telescope (VLT), which combines the exoplanet imager SPHERE with the recently upgraded high resolution spectrograph CRIRES using single-mode fibers. The goal of HiRISE is to enable the characterization of known companions in the $H$ band, at a spectral resolution of the order of $R = \lambda/\Delta\lambda = 100\,000$, in a few hours of observing time. We present the main design choices and the technical implementation of the system, which is constituted of three major parts: the fiber injection module inside of SPHERE, the fiber bundle around the telescope, and the fiber extraction module at the entrance of CRIRES. We also detail the specific calibrations required for HiRISE and the operations of the instrument for science observations. Finally, we detail the performance of the system in terms of astrometry, temporal stability, optical aberrations, and transmission, for which we report a peak value of $\sim$3.9% based on sky measurements in median observing conditions. Finally, we report on the first astrophysical detection of HiRISE to illustrate its potential.

astro-ph.IM↗

arXiv2022

Connecting SPHERE and CRIRES+ for the characterisation of young exoplanets at high spectral resolution: status update of VLT/HiRISE

New generation exoplanet imagers on large ground-based telescopes are highly optimised for the detection of young giant exoplanets in the near-infrared, but they are intrinsically limited for their characterisation by the low spectral resolution of their integral field spectrographs ($R<100$). High-dispersion spectroscopy at $R \gg 10^4$ would be a powerful tool for the characterisation of these planets, but there is currently no high-resolution spectrograph with extreme adaptive optics and coronagraphy that would enable such characterisation. With project HiRISE we propose to use fiber coupling to combine the capabilities of two flagship instruments at the Very Large Telescope in Chile: the exoplanet imager SPHERE and the high-resolution spectrograph CRIRES+. The coupling will be implemented at the telescope in early 2023. We provide a general overview of the implementation of HiRISE, of its assembly, integration and testing (AIT) phase in Europe, and a brief assessment of its expected performance based on the final hardware.

astro-ph.IM↗

arXiv2020

Direct characterization of young giant exoplanets at high spectral resolution by coupling SPHERE and CRIRES+

Studies of atmospheres of directly imaged exoplanets with high-resolution spectrographs have shown that their characterization is predominantly limited by noise on the stellar halo at the location of the studied exoplanet. An instrumental combination of high-contrast imaging and high spectral resolution that suppresses this noise and resolves the spectral lines can therefore yield higher quality spectra. We study the performance of the proposed HiRISE fiber coupling between the SPHERE and CRIRES+ at the VLT for spectral characterization of directly imaged planets. Using end-to-end simulations of HiRISE we determine the S/N of the detection of molecular species for known exoplanets in $H$ and $K$ bands, and compare them to CRIRES+. We investigate the ultimate detection limits of HiRISE as a function of stellar magnitude, and we quantify the impact of different coronagraphs and of the system transmission. We find that HiRISE largely outperforms CRIRES+ for companions around bright hosts like $\beta$ Pic or 51 Eri. For an $H=3.5$ host, we observe a gain of a factor of up to 16 in observing time with HiRISE to reach the same S/N on a companion at 200 mas. More generally, HiRISE provides better performance than CRIRES+ in two-hour integration times between 50-350 mas for hosts with $H<8.5$ and between 50-700 mas for $H<7$. For fainter hosts like PDS 70 and HIP 65426, no significant improvements are observed. We find that using no coronagraph yields the best S/N when characterizing known exoplanets due to higher transmission and fiber-based starlight suppression. We demonstrate that the overall transmission of the system is in fact the main driver of performance. Finally, we show that HiRISE outperforms the best detection limits of SPHERE for bright stars, opening major possibilities for the characterization of future planetary companions detected by other techniques.

astro-ph.IM↗

arXiv2019

Euclid preparation: VI. Verifying the Performance of Cosmic Shear Experiments

Our aim is to quantify the impact of systematic effects on the inference of cosmological parameters from cosmic shear. We present an end-to-end approach that introduces sources of bias in a modelled weak lensing survey on a galaxy-by-galaxy level. Residual biases are propagated through a pipeline from galaxy properties (one end) through to cosmic shear power spectra and cosmological parameter estimates (the other end), to quantify how imperfect knowledge of the pipeline changes the maximum likelihood values of dark energy parameters. We quantify the impact of an imperfect correction for charge transfer inefficiency (CTI) and modelling uncertainties of the point spread function (PSF) for Euclid, and find that the biases introduced can be corrected to acceptable levels.

astro-ph.CO↗