AI Gateway Sessions and Web Search APIs #141
Today's Letter
Vercel AI Gateway, session affinity logs added

- Vercel added a Sessions view to AI Gateway logs, grouping requests by session and showing session-affinity routing
- Each session lists the client, cost, models, providers, cache hit rate, session ID, and duration
- The session path shows every turn’s model, timing, and serving provider, including earlier providers
- Session affinity routes each turn to the provider that served the previous turn, improving prompt cache reuse
- Sessions can be filtered by turns, client, model, provider, authentication, or cost; single-turn sessions are hidden by default
- Session grouping uses providerOptions.gateway.sessionId, the x-session-id header, or a conversation-opening fingerprint when no identifier is provided
- The feature is enabled by default for text and chat requests
Source: vercel.com
More: tech-insider.org · startupfortune.com
DeepSeek, Search & Fetch APIs released

- DeepSeek launched Search API and Fetch API for live web content access
- Search API finds web pages and returns structured results from DeepSeek’s in-house search engine
- Fetch API retrieves a single web page and returns its content as Markdown
- Both APIs use raw JSON requests, bearer authentication, and the https://api.deepseek.com base URL
- Search requests support 1–50 results, optional page content, localization, and query operators
- Pricing is listed at $0.75 per 1,000 successful requests
Source: api-docs.deepseek.com
More: bloomberg.com · startupfortune.com
Jocoletter curates AI, software, and product trends for developers and builders.
#DeepSeek #Vercel