Xcomet MCP Server vs DialectOS

xcomet_evaluate

Evaluate the quality of a translation using xCOMET model. This tool analyzes a source text and its translation, providing: - A quality score between 0 and 1 (higher is better) - Detected error spans with severity levels (minor/major/critical) - A human-readable quality summary Args: - source (string): Original source text to translate from - translation (string): Translated text to evaluate - reference (string, optional): Reference translation for comparison - source_lang (string, optional): Source language code (ISO 639-1) - target_lang (string, optional): Target language code (ISO 639-1) - response_format ('json' | 'markdown'): Output format (default: 'json') - use_gpu (boolean, optional): Use GPU for inference if available (default: false) Returns: For JSON format: { "score": number, // Quality score 0-1 "errors": [ // Detected errors { "text": string, "start": number, "end": number, "severity": "minor" | "major" | "critical" } ], "summary": string // Human-readable summary } Examples: - Evaluate EN→JA translation quality - Check if MT output needs post-editing - Compare translation against reference

xcomet_detect_errors

Detect and categorize errors in a translation. This tool focuses on error detection, providing detailed information about translation errors with their severity levels and positions. Args: - source (string): Original source text - translation (string): Translated text to analyze - reference (string, optional): Reference translation - min_severity ('minor' | 'major' | 'critical'): Minimum severity to report (default: 'minor') - response_format ('json' | 'markdown'): Output format (default: 'json') - use_gpu (boolean, optional): Use GPU for inference if available (default: false) Returns: { "total_errors": number, "errors_by_severity": { "minor": number, "major": number, "critical": number }, "errors": [ { "text": string, "start": number, "end": number, "severity": "minor" | "major" | "critical" } ] } Examples: - Find critical errors before publication - Identify areas needing post-editing - Quality gate for MT output