Skip to content

feat: implement Small Model Mode (Phases 1 & 2) #391#412

Open
kaustubha07 wants to merge 10 commits intoNano-Collective:mainfrom
kaustubha07:feature/small-model-mode
Open

feat: implement Small Model Mode (Phases 1 & 2) #391#412
kaustubha07 wants to merge 10 commits intoNano-Collective:mainfrom
kaustubha07:feature/small-model-mode

Conversation

@kaustubha07
Copy link
Contributor

This PR implements the first two phases of the "Small Model Mode" initiative (#391), focusing on optimizing Nanocoder for local, low-parameter models.

Key Improvements:

  • Slim System Prompt: A dedicated ~300-word prompt for high performance on small models.
  • Tool Subsetting: Predefined profiles (minimal, code-edit, etc.) to reduce model confusion.
  • Schema Simplification: Automatic recursive stripping of descriptions/examples from tool schemas.
  • Smart Retry: Intelligent fallback to Small Model Mode and XML parsing on tool errors.
  • Auto-Detection: Regex-based activation for models like Llama 3B, Gemma 2, Phi, and Qwen.

Verification:

  • Targeted unit tests for detection and simplification logic are passing.
  • 100% compliance with project linting, formatting (Biome), and type checks.
  • Verified on Windows; pre-existing environment-related AVA failures were documented but no new regressions were introduced.

@kaustubha07 kaustubha07 force-pushed the feature/small-model-mode branch from 7922610 to 98d0a11 Compare March 15, 2026 04:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant