Supported model types

Last updated Aug 27, 2026 AI Gateway's Guardrails detects the type of AI model being used and applies safety checks accordingly:

  • Text generation models: Both prompts and responses are evaluated.
  • Embedding models: Only the prompt is evaluated, as the response consists of numerical embeddings, which are not meaningful for moderation.
  • Unknown models: If AI Gateway cannot determine the model type, it evaluates only the prompt and bypasses Guardrails for the response.

Note

Guardrails does not support streaming (stream: true) requests. For more information, refer to Streaming behavior.

Was this helpful?

YesNo

On this page

Supported model types - 图1Docs

{"@context":"https://schema.org","@type":"TechArticle","@id":"https://developers.cloudflare.com/ai-gateway/features/guardrails/supported-model-types/#page","headline":"Supported model types","description":"Review which AI model types AI Gateway Guardrails evaluates for text generation, embeddings, and unknown models.","url":"https://developers.cloudflare.com/ai-gateway/features/guardrails/supported-model-types/","inLanguage":"en","image":"https://developers.cloudflare.com/ai-gateway/features/guardrails/supported-model-types/og.png?v=229bda1a6dff72be","dateModified":"2026-08-27","publisher":{"@type":"Organization","name":"Cloudflare","description":"One platform for your apps, agents, and workforce. Build, secure, and scale without managing infrastructure","url":"https://www.cloudflare.com/","sameAs":["https://github.com/cloudflare","https://www.linkedin.com/company/cloudflare","https://x.com/cloudflare"],"logo":{"@type":"ImageObject","url":"https://developers.cloudflare.com/logo.svg"},"address":{"@type":"PostalAddress","streetAddress":"101 Townsend St","addressLocality":"San Francisco","addressRegion":"CA","postalCode":"94107","addressCountry":"US"},"contactPoint":[{"@type":"ContactPoint","contactType":"Customer Support","url":"https://support.cloudflare.com/","availableLanguage":["English"]},{"@type":"ContactPoint","contactType":"Sales","url":"https://www.cloudflare.com/contact/","availableLanguage":["English"]}]},"isPartOf":{"@type":"WebSite","@id":"https://developers.cloudflare.com/#website","name":"Cloudflare Docs","url":"https://developers.cloudflare.com/"}}

description: Understand latency, availability, language support, and Workers AI usage when enabling AI Gateway Guardrails. title: Usage considerations image: https://developers.cloudflare.com/ai-gateway/features/guardrails/usage-considerations/og.png?v=8764b9b28eb91734

Skip to content

Documentation Index
Fetch the complete documentation index at: https://developers.cloudflare.com/ai-gateway/llms.txt
Use this file to discover all available pages before exploring further.