Knowledge & Support

Frequently Asked Questions

Everything you need to know about evaluating models, understanding scores, and exporting remediation data.

Will Tanvelo modify my model or codebase?keyboard_arrow_down

No. Tanvelo is strictly a diagnosis and recommendation engine. We never alter your weights, modify your codebase, or change your prompt templates automatically. You receive concrete diagnostic reports and exportable datasets, leaving you in 100% control.

What do I need to connect my AI model?keyboard_arrow_down

All you need is your model's inference endpoint URL (OpenAI-compatible, Ollama, vLLM, OpenRouter, or custom HTTP endpoint) and an authorized API key if required. Zero custom SDK installation or code rewrite is needed to start benchmarking immediately.

How is the Tanvelo Health Score calculated?keyboard_arrow_down

The Tanvelo Health Score (0–100) is a weighted composite based on 5 calibrated operational vectors: Reasoning Depth (30%), Knowledge & Grounding (25%), Deterministic Coding (20%), Safety Separation (15%), and Semantic Consistency (10%). Each vector isolates specific failure modes rather than relying on noisy general-purpose prompts.

How does failure clustering work?keyboard_arrow_down

When automated benchmark runs complete, anomalous or sub-par responses are transformed into dense vector embeddings. A clustering algorithm groups semantically similar failures into impact-ranked buckets, allowing you to instantly understand recurring patterns instead of reading hundreds of raw logs.

What format are the exported remediation datasets?keyboard_arrow_down

Remediation datasets are exported in standard JSONL (JSON Lines) and CSV formats. Each entry contains the failure prompt, the categorized failure mode, and a verified gold-standard target completion ready for supervised fine-tuning or prompt guardrail testing.

Is my evaluation data used to train other AI models?keyboard_arrow_down

Never. Your inputs, completions, and evaluation reports are strictly private to your workspace and never utilized to train public, open-source, or foundational AI models.

Can I compare multiple model versions against each other?keyboard_arrow_down

Yes. Tanvelo supports regression comparison. You can benchmark release candidate v2.1 against baseline v2.0 to quantify score deltas, verify that known weaknesses have been remediated, and ensure no new regressions were introduced.

Can I run evaluations inside our private network or VPC?keyboard_arrow_down

Enterprise tier workspaces can deploy private runner instances or configure VPC peering to test internal models that are not exposed to the public internet.

Have a question not listed here?

Our engineering team is available to assist with custom model integrations and evaluation suites.

Contact Teamarrow_forward