arXiv subjects

Jiangwei Chen

Publications and source records attributed to Jiangwei Chen.

6 recordsLinked to original sources

arXiv2026

How Hard Can It Be? Hardness-Aware Multi-Objective Unlearning

Machine unlearning aims to remove the influence of specific forget training data due to privacy, copyright or bias concerns while maintaining the model performance on the remaining retain data. Existing unlearning algorithms, such as optimizing a weighted combination of losses, have tried to achieve these objectives of improving forget quality and maintaining retain utility. However, they do not guarantee that these objectives can be improved by a specified extent for all forget and retain data. In this work, we address this limitation with a novel and theoretically-grounded approach from a constrained optimization perspective. Firstly, we identify that the hardness of reconciling both objectives can be quantified by the similarity between the forget data and the retain data. Next, we derive an unlearning algorithm (HAMU) with the overall goal of guaranteeing a specified improvement in forget quality while minimizing the retain utility cost/degradation by updating the model weights based on our hardness measure. Our hardness measure also informs users when retain utility degradation is unavoidable, i.e., both objectives cannot be improved simultaneously, and stopping should be considered. Our algorithm is applicable to non-convex models and is easily parallelizable, making it readily deployable in real-world scenarios. We empirically demonstrate HAMU's superior performance over baselines on both image and text datasets using large models. Our code is available at https://github.com/aoi3142/HAMU.

cs.LG↗

arXiv2025

Incentivizing Time-Aware Fairness in Data Sharing

In collaborative data sharing and machine learning, multiple parties aggregate their data resources to train a machine learning model with better model performance. However, as the parties incur data collection costs, they are only willing to do so when guaranteed incentives, such as fairness and individual rationality. Existing frameworks assume that all parties join the collaboration simultaneously, which does not hold in many real-world scenarios. Due to the long processing time for data cleaning, difficulty in overcoming legal barriers, or unawareness, the parties may join the collaboration at different times. In this work, we propose the following perspective: As a party who joins earlier incurs higher risk and encourages the contribution from other wait-and-see parties, that party should receive a reward of higher value for sharing data earlier. To this end, we propose a fair and time-aware data sharing framework, including novel time-aware incentives. We develop new methods for deciding reward values to satisfy these incentives. We further illustrate how to generate model rewards that realize the reward values and empirically demonstrate the properties of our methods on synthetic and real-world datasets.

cs.LG↗

arXiv2024

Waterfall: Framework for Robust and Scalable Text Watermarking and Provenance for LLMs

Protecting intellectual property (IP) of text such as articles and code is increasingly important, especially as sophisticated attacks become possible, such as paraphrasing by large language models (LLMs) or even unauthorized training of LLMs on copyrighted text to infringe such IP. However, existing text watermarking methods are not robust enough against such attacks nor scalable to millions of users for practical implementation. In this paper, we propose Waterfall, the first training-free framework for robust and scalable text watermarking applicable across multiple text types (e.g., articles, code) and languages supportable by LLMs, for general text and LLM data provenance. Waterfall comprises several key innovations, such as being the first to use LLM as paraphrasers for watermarking along with a novel combination of techniques that are surprisingly effective in achieving robust verifiability and scalability. We empirically demonstrate that Waterfall achieves significantly better scalability, robust verifiability, and computational efficiency compared to SOTA article-text watermarking methods, and showed how it could be directly applied to the watermarking of code. We also demonstrated that Waterfall can be used for LLM data provenance, where the watermarks of LLM training data can be detected in LLM output, allowing for detection of unauthorized use of data for LLM training and potentially enabling model-centric watermarking of open-sourced LLMs which has been a limitation of existing LLM watermarking works. Our code is available at https://github.com/aoi3142/Waterfall.

cs.CR↗

arXiv2024

Data-Centric AI in the Age of Large Language Models

This position paper proposes a data-centric viewpoint of AI research, focusing on large language models (LLMs). We start by making the key observation that data is instrumental in the developmental (e.g., pretraining and fine-tuning) and inferential stages (e.g., in-context learning) of LLMs, and yet it receives disproportionally low attention from the research community. We identify four specific scenarios centered around data, covering data-centric benchmarks and data curation, data attribution, knowledge transfer, and inference contextualization. In each scenario, we underscore the importance of data, highlight promising research directions, and articulate the potential impacts on the research community and, where applicable, the society as a whole. For instance, we advocate for a suite of data-centric benchmarks tailored to the scale and complexity of data for LLMs. These benchmarks can be used to develop new data curation methods and document research efforts and results, which can help promote openness and transparency in AI and LLM research.

cs.LG↗

arXiv2007

Chiral Symmetry of Double-Walled Carbon Nanotubes detected in First-principles Optical Absorption Spectra

The linear polarizability absorption spectra of the double-walled carbon nanotubes (DWNTs) have been calculated by using the tight-binding (TB) model and sum-over-state (SOS) method, supplemented by the first principles CASTEP calculations. It is found that the chiral symmetries of both outer and inner tubes in the DWNTs can always be identified distinctly by the characteristic peaks in the absorption spectra of the DWNTs, no matter what kind of the outer tube is, offering a powerful experimental tool to measure precisely the chiral angle of the inner tube of a DWNT.

cond-mat.mtrl-sci↗

arXiv2005

Structural and electronic properties of the metal-metal intramolecular junctions of single-walled carbon nanotubes

Several intramolecular junctions (IMJs) connecting two metallic (11, 8) and (9, 6) carbon nanotubes along their common axis have been realized by using a layer-divided technique to the nanotubes and introducing the topological defects. Atomic structure of each IMJ configuration is optimized with a combination of density-functional theory (DFT) and the universal force field (UFF) method, based upon which a four-orbital tight-binding calculation is made on its electronic properties. Different topological defect structures and their distributions on the IMJ interfaces have been found, showing decisive effects on the localized density of states, while the sigma-pi coupling effect is negligible near Fermi energy (EF). Finally, a new IMJ model has been proposed, which probably reflects a real atomic structure of the M-M IMJ observed in the experiment [Science 291, 97 (2001)].

cond-mat.mtrl-sci↗