Crowkis
Crowkis delivers a semantic cache for LLM workloads to avoid redundant computations.
FreeProductivity
Visit website Free to browse · updated 2026-06-20
What is Crowkis?
Crowkis addresses repeated LLM queries by caching responses based on semantic similarity instead of exact wording. This allows rephrased questions to retrieve prior results after passing verification stages that block unsafe or stale content. The tool is implemented in Rust as a single container image supporting multiple access methods. It enables quick adoption by working alongside standard clients without requiring application changes. Common deployments include support bots, internal knowledge tools, retrieval systems, and agent platforms where similar requests occur frequently.
Key features
Semantic caching for LLM queries based on meaning
Built in Rust with zero GC pauses
Supports RESP3, gRPC, REST and MCP protocols
Single signed Docker image containing all features
Anti-poisoning safety checks before serving cached answers
Compatible with existing Redis clients
Python and Node SDKs with get_or_compute support
What you can use Crowkis for
Customer Support Bots
Handle repeated questions about refunds, resets, and shipping with semantic caching so common intents return instantly without new LLM calls.
Internal Copilots
Share cached answers across company tools for policy and how-to queries, letting one response serve hundreds of employees via Slack, portals, or IDE plugins.
RAG Applications
Cache the final synthesized answers from document retrieval pipelines so popular questions skip repeated synthesis steps while staying version-pinned to source docs.
How to use Crowkis
- 1Pull the official Docker image with docker pull crowkis/crowkis:latest
- 2Run the container on the desired port
- 3Point an existing Redis client or SDK at the Crowkis port
- 4Call get_or_compute with your query and fallback LLM function
- 5Set TTL and tenant parameters as needed for your workload
Crowkis pricing
Pricing model: Free. Plan details are indicative — check the site for current prices.
Community Edition
Free
- One signed Docker image
- Every feature compiled in
- Full power with no license
- No sign-up
- No phone-home
- RESP3 · gRPC · REST · MCP
Editor's verdict
Pros
- +Reduces LLM costs by serving cached semantic matches
- +Sub-millisecond response times for cache hits
- +Zero code changes needed via Redis compatibility
Cons
- –Self-hosted only via Docker
- –Requires separate Redis-compatible client setup
Our take: Crowkis is a solid productivity choice. It's valued for reduces llm costs by serving cached semantic matches and sub-millisecond response times for cache hits. The main trade-off is self-hosted only via docker. A good pick if you want capable AI without a high upfront cost.
Frequently asked questions
Crowkis is a semantic cache for LLM responses that understands query meaning and serves prior answers only when safe, reducing repeated compute costs.
Summary
Crowkis is a solid productivity choice. It's valued for reduces llm costs by serving cached semantic matches and sub-millisecond response times for cache hits. The main trade-off is self-hosted only via docker. A good pick if you want capable AI without a high upfront cost.
Did you find this helpful?
User reviews
Verified reviews from the community shape this tool's rating.
Loading reviews…
Crowkis alternatives
Similar productivity tools worth comparing.
