LLM Integration

0%

    API Basics and Prompts

    • Build a Chat Messages Array

      Junior

    • Safe Prompt Template Filling

      Junior

    • Token-Budgeted Chat History Trimming and Compaction

      Mid

    Streaming and Structured Output

    • Parse Chunked SSE Model Stream

      Mid

    • Validated Structured Output With Retry Feedback

      Mid

    • Incremental Streaming JSON Object Parser

      Senior

    Reliability and Cost

    • Estimate Request Tokens and Dollar Cost

      Junior

    • Resilient LLM Client With Backoff and Fallback

      Mid

    • Per-Tenant Daily Token Budget Router

      Mid

    • Semantic Cache with Similarity Threshold and TTL

      Senior

    Tools and Agents

    • Tool-Calling Agent Loop with Step and Time Limits

      Senior

    • Schema-Validated Tool Registry and Loop

      Senior

    • Guarded Tool Executor with Idempotent Retries

      Senior

    RAG Security and Evals

    • RAG Retrieval With Metadata Filters and Citations

      Mid

    • PII Redaction With Placeholder Restore

      Mid

    • Regression Eval Harness with LLM-as-Judge

      Senior