Open/Closed Model Visibility Audit
Why model openness matters
Open-weight and closed proprietary models can differ in freshness, retrieval behavior, citation habits, safety posture, and reproducibility. For an audit buyer, the useful question is not where a model company is based. The useful question is whether the model surface is open enough to inspect, reproduce, or benchmark differently from a closed API-only surface.
Current Clarivy endpoint matrix
| Model openness surface | Endpoints in Snapshot | What the grouping means |
|---|---|---|
| Open-weight / source-available model endpoints | Kimi, DeepSeek, Qwen | The model family exposes public weights or source-available artifacts in the broader ecosystem; exact model id is recorded per datapoint. |
| Closed proprietary API model endpoints | Doubao, ChatGPT, Claude, Gemini | The audit calls a vendor-hosted API surface where model internals are not publicly inspectable; data-control status is recorded per datapoint. |
What the grouping does not mean
- It does not mean Clarivy self-hosts open-weight models; Snapshot calls reviewed vendor APIs.
- It does not mean open-weight models are less capable or closed models are less useful.
- It does not describe geography or language capability. All tested models are treated as multilingual endpoints.
- It does not add ERNIE, MetaSo, or Perplexity Sonar to the current production Snapshot matrix.
Use cases
- Procurement: show whether vendor claims are stable across inspectable and closed API model surfaces.
- Marketing: learn whether category and competitor prompts produce different brand visibility patterns by model openness.
- Compliance: attach model id, API method, retention posture, and raw response evidence to every datapoint.
FAQ
Which open-weight or source-available endpoints does Snapshot include?
Snapshot currently groups Kimi, DeepSeek, and Qwen as open-weight or source-available model endpoints. The exact model id used in a customer run is recorded per datapoint.
Which closed proprietary API endpoints does Snapshot include?
Snapshot currently groups Doubao, ChatGPT, Claude, and Gemini as closed proprietary API model endpoints.
Where is the endpoint list versioned?
The current production list is versioned on the Methodology page. Adding or removing an endpoint is a methodology change, not a marketing-only edit.