Software

This page collects public code repositories and software artifacts from my recent work.

Counts update automatically from Hugging Face and GitHub. Downloads are all-time totals across each model family's official Hugging Face releases, including GGUF and MLX variants.

LLM Agents and Long-Context Learning

NeoHorse-1

Open-weight 4B and 9B models for agent workflows.

  • Focus: Agentic post-training for tool use, coding, and instruction following, with routing signals connecting harness execution to model learning.

  • My role: Led post-training strategy, experiments, and final checkpoint selection.

  • Links: Technical Report, GitHub, 4B Model, 9B Model.

NeoHorse-Jev-4B

Prefill-only structured decisions for agent workflows.

  • Focus: Given application state and questions, returns typed answers and probabilities for routing requests, selecting tools, checking conditions, and rating outcomes.

  • Release: Open weights and an inference runtime, with GGUF variants for local deployment.

  • Links: Model and Documentation, GGUF, GitHub.

SCOPE

Self-evolving Context Optimization via Prompt Evolution.

  • Problem: LLM agents receive large, dynamic execution contexts but often fail to manage useful signals from traces, errors, and tool outputs.

  • Method: Treats context management as online prompt optimization, evolving agent prompts from execution traces.

  • Links: Paper, Code.

  • Keywords: LLM agents; prompt evolution; context optimization.

MemDLM

Memory-Enhanced DLM Training.

  • Problem: Diffusion language models need stronger training signals for long-context and denoising dynamics.

  • Method: Introduces memory-enhanced training with a parametric memory channel.

  • Links: Paper, Code.

  • Keywords: diffusion language models; parametric memory; long-context training.

Efficient LLMs and Model Compression

CMoE

Analytical FFN-to-MoE Restructuring via Activation Pattern Analysis.

  • Problem: Dense LLMs are expensive at inference time, while training MoE models from scratch is costly.

  • Method: Converts dense FFNs into sparse MoE layers through analytical post-training restructuring based on activation patterns.

  • Links: Paper, Code.

  • Keywords: FFN-to-MoE; analytical restructuring; LLM acceleration.

PreMoE

Proactive Inference for Efficient Mixture-of-Experts.

  • Problem: MoE models are usually deployed with full expert capacity even when a deployment scenario may only need a subset.

  • Method: Compiles sparse MoE variants before serving through expert pruning and deployment-specific sparsity.

  • Links: Paper, Code.

  • Keywords: MoE expert pruning; proactive inference; efficient deployment.

FuseGPT

From Pruning to Grafting: Dynamic Knowledge Redistribution via Learnable Layer Fusion.

  • Problem: Structured pruning removes whole transformer blocks and can discard useful knowledge.

  • Method: Reframes pruning as learnable knowledge grafting, redistributing knowledge from pruned blocks into surviving layers.

  • Links: Paper, Code.

  • Keywords: structured pruning; layer fusion; knowledge grafting.

LLM Evaluation

Behavioral Fingerprinting

Behavioral Fingerprinting of Large Language Models.

  • Problem: Accuracy-only benchmarks miss cognitive and alignment-style differences between LLMs.

  • Method: Profiles models through behavioral dimensions such as reasoning, robustness, sycophancy, and interaction style.

  • Links: Paper, Code.

  • Keywords: LLM evaluation; behavioral fingerprinting; alignment robustness.

Other Tools

EvolveClaw

Make your OpenClaw agent self-improving.

  • Problem: Agent systems can benefit from self-improvement loops rather than static behavior.

  • Method: Provides a TypeScript tool for evolving OpenClaw-style agents.

  • Links: Code.

  • Keywords: agent systems; self-improvement; TypeScript tooling.

ArxivFinder

arXiv Paper Finder and Notifier.

  • Problem: Keeping track of relevant arXiv papers can be time-consuming.

  • Method: Provides a lightweight paper-finding and notification utility.

  • Links: Code.

  • Keywords: research tooling; arXiv monitoring; paper discovery.

web
analytics