Documentation on Harbor Self-Evolving

Install and start

Mon, 01 Jan 0001 00:00:00 +0000

Requirements

A working DeepSeek Harness installation and the business Agent workspace you want to evaluate.
Node.js/npm for the DSH Plugin setup command.
Python environment support used by the installed Adapter.
Harbor >=0.21,<0.22.
Docker only if you explicitly choose container execution; 0.10.3 defaults to Host.

Install

Run from the business Agent workspace, not from this source repository:

npx --yes dsh-harbor-evolution@latest setup --project-root "$PWD"

For a version-pinned installation, replace latest with 0.10.3. Setup writes the selected DSH profile dependency, configures the Harbor project integration, installs the compatible Python Adapter and exposes the bundled evolve-agent-with-harbor Skill. Follow the exact restart command printed by setup.

Workbench, context, and reviewed actions

Mon, 01 Jan 0001 00:00:00 +0000

The Harbor page is injected into the existing DSH Web GUI. It reuses DSH locale, Session, conversation, composer, Settings and Tool View surfaces; it is not a second chat product or login system.

Object-first Workbench

A Job opens into eight connected sections: Summary, Trials, Pipeline, Optimization, Compare/Gate, Evaluator/Rubric, Artifacts and Audit. The Pipeline tracks Candidate, Dataset, Integration, Renderer, Judge, Meta, Reporter, Optimizer and Gate separately so a wiring failure is not mislabeled as a low score.

Concepts and trustworthy scores

Mon, 01 Jan 0001 00:00:00 +0000

Translate the four concepts into business language

Concept	Practical meaning	Question answered in Harbor
Dataset	Business cases with task instructions, inputs and expected evidence. It defines what to evaluate; it is not a raw dump of conversations.	Which capabilities must work, and which failures must be detected?
Generator	The execution process that receives a Task and produces an answer or Artifact under a fixed Candidate, model and runtime. It may be an LLM Agent, script, workflow or other program.	Who answers, how is it run, and what does it produce?
Evaluator	The criteria and evidence logic used to judge output quality. It may be a deterministic script or `llm-as-judge`.	What counts as good, and is the evidence sufficient to decide?
Optimizer	The role that reads Dataset-level results and Trial evidence, then proposes one constrained, reviewable change. It cannot declare success by itself.	What should change, and how do we avoid changing too much at once?

Harbor compiles these user-facing concepts into a stricter Evaluation Stack with Integration, Renderer, Judge, Contract, Reporter, Policy, Context and Gate roles. Users describe the business problem first instead of filling in an internal architecture questionnaire.

Architecture and trust boundaries

Mon, 01 Jan 0001 00:00:00 +0000

Three product roles

Plugin: the user-facing DSH integration and permission boundary.
Skill: the workflow policy that chooses the smallest safe evaluation path.
Adapter: the Harbor runtime bridge that materializes Jobs, Trials, Evidence and Context.

The Gate remains a separate deterministic policy function; it is not part of the Optimizer and has no deployment capability.

Eight-role Evaluation Stack

Generator, Integration, Renderer, Evaluator/Judge, Contract, Reporter, Optimizer and Policy/Gate separate execution, observation, interpretation, reporting, change proposal and promotion. This avoids a single opaque prompt both changing the system and grading itself.

Security, privacy, and execution boundaries

Mon, 01 Jan 0001 00:00:00 +0000

Harbor Self-Evolving narrows high-impact operations, but it is not a general sandbox or multi-user authorization system.

Session and project scope

Agent tools derive project root from the calling Session’s absolute cwd. Web tokens bind Session and project. Candidate/private context and journal paths apply symlink and no-follow defenses where implemented. General lexical path containment is not a universal physical-filesystem guarantee; stronger realpath/openat containment remains roadmap work.

Troubleshooting

Mon, 01 Jan 0001 00:00:00 +0000

Harbor page is missing

Confirm setup changed the profile DSH actually runs, restart using the printed command, and verify the dependency is an exact registry version rather than link:. Check that both Harbor plugins and the bundled Skill are present.

Plugin loads but evaluation commands fail

Check the managed Python environment and harbor plugins list. Normal installation must include both dsh-evolution and dsh-historical-evaluation; adding the npm source directory alone is incomplete.