2 comments

  • bookernath 1 hour ago
    Tokens per minute is a strange metric, I usually see tok/s. A per-second figure would be more accessible in comparing this to alternatives.
    • badmonster0 13 minutes ago
      how does this compare with sglang