arXiv subjects

Umar Jamil

Publications and source records attributed to Umar Jamil.

5 recordsLinked to original sources

arXiv2026

Phoenix-VL 1.5 Medium Technical Report

We introduce Phoenix-VL 1.5 Medium, a 123B-parameter natively multimodal and multilingual foundation model, adapted to regional languages and the Singapore context. Developed as a sovereign AI asset, it demonstrates that deep domain adaptation can be achieved with minimal degradation to broad-spectrum intelligence and alignment. Continued pretraining was performed on Mistral Medium 3.1 using a localized 1-trillion tokens multimodal corpus, followed by a 250-billion tokens long-context extension phase. Subsequent post-training incorporated a novel human-annotated Singapore multimodal dataset and curated textual corpus on Singapore culture, knowledge, and legislation, totaling 22-billion tokens. An additional 5 billion tokens of model alignment was performed through Online Direct Preference Optimization. Phoenix-VL 1.5 Medium achieves state-of-the-art performance for its size on Singapore multimodal, legal, and government policy benchmarks while remaining globally competitive on general multimodal intelligence, multilingual, and STEM benchmarks. We also introduce a novel evaluation suite encompassing localized knowledge benchmarks and an institutionally aligned model behavior and safety framework. We report the data curation principles, training methodology, and highlight benchmark and inference performance.

cs.CL↗

arXiv2026

EVE: A Domain-Specific LLM Framework for Earth Intelligence

We introduce Earth Virtual Expert (EVE), the first open-source, end-to-end initiative for developing and deploying domain-specialized LLMs for Earth Intelligence. At its core is EVE-Instruct, a domain-adapted 24B model built on Mistral Small 3.2 and optimized for reasoning and question answering. On newly constructed Earth Observation and Earth Sciences benchmarks, it outperforms comparable models while preserving general capabilities. We release curated training corpora and the first systematic domain-specific evaluation benchmarks, covering MCQA, open-ended QA, and factuality. EVE further integrates RAG and a hallucination-detection pipeline into a production system deployed via API and GUI, supporting 350 pilot users so far. All models, datasets, and code are ready to be released under open licenses as contributions to our field at huggingface.co/eve-esa and github.com/eve-esa.

cs.CL↗

arXiv2025

Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learning

We explore a method for improving the performance of large language models through self-reflection and reinforcement learning. By incentivizing the model to generate better self-reflections when it answers incorrectly, we demonstrate that a model's ability to solve complex, verifiable tasks can be enhanced even when generating synthetic data is infeasible and only binary feedback is available. Our framework operates in two stages: first, upon failing a given task, the model generates a self-reflective commentary analyzing its previous attempt; second, the model is given another attempt at the task with the self-reflection in context. If the subsequent attempt succeeds, the tokens generated during the self-reflection phase are rewarded. Our experimental results show substantial performance gains across a variety of model architectures, as high as 34.7% improvement at math equation writing and 18.1% improvement at function calling. Notably, smaller fine-tuned models (1.5 billion to 7 billion parameters) outperform models in the same family that are 10 times larger. Our novel paradigm is thus an exciting pathway to more useful and reliable language models that can self-improve on challenging tasks with limited external feedback.

cs.CL↗

arXiv2024

Writing in the Margins: Better Inference Pattern for Long Context Retrieval

In this paper, we introduce Writing in the Margins (WiM), a new inference pattern for Large Language Models designed to optimize the handling of long input sequences in retrieval-oriented tasks. This approach leverages the chunked prefill of the key-value cache to perform segment-wise inference, which enables efficient processing of extensive contexts along with the generation and classification of intermediate information ("margins") that guide the model towards specific tasks. This method increases computational overhead marginally while significantly enhancing the performance of off-the-shelf models without the need for fine-tuning. Specifically, we observe that WiM provides an average enhancement of 7.5% in accuracy for reasoning skills (HotpotQA, MultiHop-RAG) and more than a 30.0% increase in the F1-score for aggregation tasks (CWE). Additionally, we show how the proposed pattern fits into an interactive retrieval design that provides end-users with ongoing updates about the progress of context processing, and pinpoints the integration of relevant information into the final response. We release our implementation of WiM using Hugging Face Transformers library at https://github.com/writer/writing-in-the-margins.

cs.CL↗

arXiv2023

Power Loss Minimization of Distribution Network using Different Grid Strategies

Power losses in electrical power systems especially, distribution systems, occur due to several environmental and technical factors. Transmission & Distribution line losses are normally 17% and 50% respectively. These losses are due to the inappropriate size of the conductor, long distribution lines, low power factor, overloading of lines etc. The power losses cause economic loss and reduce the system's reliability. The reliability of electrical power systems can be improved by decreasing network power loss and by improving the voltage profile. In radial distribution systems, power loss can also be minimized through Distributed Generation (DG) system placement. In this thesis, three different grid strategies including real power sharing, reactive power injection and transformer tap changing are discussed and used to minimize line losses. These three proposed grid strategies have been implemented using a power flow study based on Newton-Raphson (NR) and Genetic Algorithm (GA). To minimize line losses, both methods have been used for each grid strategy. The used test system in this research work is the IEEE-30 bus radial distribution system. Results obtained after simulation of each grid strategy using NR and GA shows that real load sharing is reliable with respect to minimization of line loss as compared to reactive power injection and transformer tap changing grid strategy. Comparative analysis has been performed between GA and NR for each grid strategy, results show that Genetic Algorithm is more reliable and efficient for loss minimization as compared to Newton-Raphson. In the base case for optimum power flow solution using genetic algorithm and Newton-Raphson, real line losses are 9.481475MW and 17.557MW respectively. So, GA is preferable for each proposed grid strategy to minimize line losses than NR.

eess.SY↗