arXiv subjects

Steven

Publications and source records attributed to Steven.

6 recordsLinked to original sources

arXiv2024

Understanding and Alleviating Memory Consumption in RLHF for LLMs

Fine-tuning with Reinforcement Learning with Human Feedback (RLHF) is essential for aligning large language models (LLMs). However, RLHF often encounters significant memory challenges. This study is the first to examine memory usage in the RLHF context, exploring various memory management strategies and unveiling the reasons behind excessive memory consumption. Additionally, we introduce a simple yet effective approach that substantially reduces the memory required for RLHF fine-tuning.

cs.LG↗

arXiv2024

Scaler: Efficient and Effective Cross Flow Analysis

Performance analysis is challenging as different components (e.g.,different libraries, and applications) of a complex system can interact with each other. However, few existing tools focus on understanding such interactions. To bridge this gap, we propose a novel analysis method "Cross Flow Analysis (XFA)" that monitors the interactions/flows across these components. We also built the Scaler profiler that provides a holistic view of the time spent on each component (e.g., library or application) and every API inside each component. This paper proposes multiple new techniques, such as Universal Shadow Table, and Relation-Aware Data Folding. These techniques enable Scaler to achieve low runtime overhead, low memory overhead, and high profiling accuracy. Based on our extensive experimental results, Scaler detects multiple unknown performance issues inside widely-used applications, and therefore will be a useful complement to existing work. The reproduction package including the source code, benchmarks, and evaluation scripts, can be found at https://doi.org/10.5281/zenodo.13336658.

cs.PF↗

arXiv2024

Length-scale study in deep learning prediction for non-small cell lung cancer brain metastasis

Deep learning assisted digital pathology has the potential to impact clinical practice in significant ways. In recent studies, deep neural network (DNN) enabled analysis outperforms human pathologists. Increasing sizes and complexity of the DNN architecture generally improves performance at the cost of DNN's explainability. For pathology, this lack of DNN explainability is particularly problematic as it hinders the broader clinical interpretation of the pathology features that may provide physiological disease insights. To better assess the features that DNN uses in developing predictive algorithms to interpret digital microscopic images, we sought to understand the role of resolution and tissue scale and here describe a novel method for studying the predictive feature length-scale that underpins a DNN's predictive power. We applied the method to study a DNN's predictive capability in the case example of brain metastasis prediction from early-stage non-small-cell lung cancer biopsy slides. The study highlights the DNN attention in the brain metastasis prediction targeting both cellular scale (resolution) and tissue scale features on H&E-stained histological whole slide images. At the cellular scale, we see that DNN's predictive power is progressively increased at higher resolution (i.e., lower resolvable feature length) and is largely lost when the resolvable feature length is longer than 5 microns. In addition, DNN uses more macro-scale features (maximal feature length) associated with tissue organization/architecture and is optimized when assessing visual fields larger than 41 microns. This study for the first time demonstrates the length-scale requirements necessary for optimal DNN learning on digital whole slide images.

eess.IV↗

arXiv2022

CachePerf: A Unified Cache Miss Classifier via Hybrid Hardware Sampling

The cache plays a key role in determining the performance of applications, no matter for sequential or concurrent programs on homogeneous and heterogeneous architecture. Fixing cache misses requires to understand the origin and the type of cache misses. However, this remains to be an unresolved issue even after decades of research. This paper proposes a unified profiling tool--CachePerf--that could correctly identify different types of cache misses, differentiate allocator-induced issues from those of applications, and exclude minor issues without much performance impact. The core idea behind CachePerf is a hybrid sampling scheme: it employs the PMU-based coarse-grained sampling to select very few susceptible instructions (with frequent cache misses) and then employs the breakpoint-based fine-grained sampling to collect the memory access pattern of these instructions. Based on our evaluation, CachePerf only imposes 14% performance overhead and 19% memory overhead (for applications with large footprints), while identifying the types of cache misses correctly. CachePerf detected 9 previous-unknown bugs. Fixing the reported bugs achieves from 3% to 3788% performance speedup. CachePerf will be an indispensable complementary to existing profilers due to its effectiveness and low overhead.

cs.PF↗

arXiv2020

The Prime-Power Map

We introduce a modification of Pillai's prime map: the prime-power map. This map fixes $1$, divides its argument by $p$ if it is a prime-power $p^k$, otherwise subtracts from its argument the largest prime-power not exceeding it. We study the iteration of this map over the positive integers, developing, firstly, results parallel to those known for the prime map. Subsequently, we compare its dynamical properties to those of a more manageable variant of the map under which any orbit admits an explicit description. Finally, we present some experimental observations, based on which we conjecture that almost every orbit of the prime-power map contains no prime-power.

math.DS↗

arXiv2016

Complete Affine Connection in the Causal Boundary: Static, Spherically Symmetric Spacetimes

The boundary at $\Cal I^+$, future null infinity, for a standard static, spherically symmetric spactime is examined for possible linear connections. Two independent methods are employed, one for treating $\Cal I^+$ as the future causal boundary, and one for treating it as a conformal boundary (the latter is subsumed in the former, which is of greater generality). Both methods provide the same result: a constellation of various possible connections, depending on an arbitrary choice of a certain function, a sort of gauge freedom in obtaining a natural connection on $\Cal I^+$; choosing that function to be constant (for instance) results in a complete connection. Treating $\Cal I^+$ as part of the future causal boundary, the method is to impute affine connections on null hypersurfaces going out to $\Cal I^+$, in terms of a transverse vector field on each null hypersurface (there is much gauge freedom on choice of the transverse vector fields). Treating $\Cal I^+$ as part of a conformal boundary, the method is to make a choice of conformal factor that makes the boundary totally geodesic in the enveloping manifold (there is much gauge freedom in choice of that conformal factor). Similar examination is made of other boundaries, such as timelike infinity and timelike and spacelike singularities. These are much simpler, as they admit a unique connection from a similar limiting process (i.e., no gauge freedom); and that connection is complete.

gr-qc↗