AI Gateway Sessions and Web Search APIs #141

Today's Letter

  1. Vercel AI Gateway, session affinity logs added
  2. DeepSeek, Search & Fetch APIs released

Vercel AI Gateway, session affinity logs added

Vercel AI Gateway, session affinity logs added
  • Vercel added a Sessions view to AI Gateway logs, grouping requests by session and showing session-affinity routing
  • Each session lists the client, cost, models, providers, cache hit rate, session ID, and duration
  • The session path shows every turn’s model, timing, and serving provider, including earlier providers
  • Session affinity routes each turn to the provider that served the previous turn, improving prompt cache reuse
  • Sessions can be filtered by turns, client, model, provider, authentication, or cost; single-turn sessions are hidden by default
  • Session grouping uses providerOptions.gateway.sessionId, the x-session-id header, or a conversation-opening fingerprint when no identifier is provided
  • The feature is enabled by default for text and chat requests

Source: vercel.com
More: tech-insider.org · startupfortune.com


DeepSeek, Search & Fetch APIs released

DeepSeek, Search & Fetch APIs released
  • DeepSeek launched Search API and Fetch API for live web content access
  • Search API finds web pages and returns structured results from DeepSeek’s in-house search engine
  • Fetch API retrieves a single web page and returns its content as Markdown
  • Both APIs use raw JSON requests, bearer authentication, and the https://api.deepseek.com base URL
  • Search requests support 1–50 results, optional page content, localization, and query operators
  • Pricing is listed at $0.75 per 1,000 successful requests

Source: api-docs.deepseek.com
More: bloomberg.com · startupfortune.com


Jocoletter curates AI, software, and product trends for developers and builders.

#DeepSeek #Vercel

Subscribe to Jocoletter

Read more