AI & LLM Handy Tools

⌘K
No favorites

Prompt Engineering

6 tools
Prompt Template Builder
Create reusable structured prompts (system + user + examples).
Open
Learn
Prompt A/B Tester
Compare model responses across prompt variations.
🚧 In Development
Context Trimmer
Automatically shorten context to stay under token limits.
🚧 In Development
Prompt Leakage Detector
Detect system prompt exposure or overfitting.
🚧 In Development
Persona Simulator
Emulate model behavior under various personas.
🚧 In Development
Prompt Shortcuts
prompt-shortcut
Open
Learn

Model Training & Evaluation

5 tools
Dataset Cleaner
Remove duplicates, bad tokens, or offensive samples.
Open
Learn
Fine-Tune Config Generator
Generate LoRA, PEFT, or RLHF JSON config templates.
Open
Learn
Training Cost Estimator
Estimate GPU hours and token cost for training.
🚧 In Development
Model Comparison Viewer
Compare outputs from multiple LLMs side-by-side.
🚧 In Development
Evaluation Benchmark Suite
Evaluate accuracy, coherence, toxicity, and bias.
🚧 In Development

Dataset Tools

7 tools
Text Dataset Labeler
Manual or semi-auto text classification tool.
Open
Learn
JSONL Validator & Formatter
Validate and format datasets for OpenAI/HuggingFace fine-tuning.
Open
Learn
Text → JSONL Converter
Prepare datasets for OpenAI / HuggingFace training.
🚧 In Development
Embedding Visualizer
Plot sentence embeddings in 2D/3D using PCA/UMAP.
Open
Learn
Bias Detector
Identify gender, racial, or cultural bias in text.
Open
Learn
Token Counter
Estimate token usage and costs before training.
Open
Learn
RAG Chunking Visualizer
Visualize text splitting for RAG pipelines.
Open
Learn
Tap "Expand" to view tools

MLOps & Inference

5 tools
API Tester
Send test prompts to OpenAI, Ollama, Anthropic, Mistral, etc.
Open
Learn
Latency Checker
Compare response times across models or regions.
🚧 In Development
Streaming Output Visualizer
Watch token-by-token generation in real time.
🚧 In Development
Inference Log Analyzer
Track drift, anomalies, and token usage metrics.
🚧 In Development
Model Deployment Tracker
Monitor and version deployed models.
🚧 In Development
Tap "Expand" to view tools

Safety & Alignment

4 tools
Jailbreak Tester
Evaluate prompt-injection and system override attempts.
Open
Learn
Toxicity Classifier
Detect harmful or biased language in model outputs.
🚧 In Development
Hallucination Checker
Compare generated output with factual references.
🚧 In Development
Alignment Score Tracker
Rate model safety, honesty, and relevance.
🚧 In Development
Tap "Expand" to view tools

AI Agents & Workflows

4 tools
Agent Flow Visualizer
Visualize task-chains and tool-use flows.
🚧 In Development
Task Memory Tester
Evaluate how well an agent retains prior context.
🚧 In Development
RAG Builder
Connect documents → embeddings → LLM for retrieval QA.
🚧 In Development
Tool Use Simulator
Simulate agent reasoning and tool calls.
🚧 In Development
Tap "Expand" to view tools

Learning & Training

6 tools
AI & LLM Glossary
Interactive glossary of essential AI/ML/LLM terminology with examples.
Open
Learn
LLM Model Comparison
Compare popular language models by cost, context, and capabilities.
Open
Learn
Daily AI Concepts
Flashcards with short explanations of key AI terms.
🚧 In Development
Prompt Engineering Playground
Interactive tutorials for writing better prompts.
🚧 In Development
Model Explorer
Discover and compare open models from HF/Ollama.
🚧 In Development
AI Paper Digest
Summaries of top LLM research papers weekly.
🚧 In Development
Tap "Expand" to view tools

AI Safety & Security

7 tools
Prompt Injection Detector
Detect and analyze prompt injection attempts in user inputs.
🚧 In Development
PII Detector
Identify personal information (emails, SSNs, credit cards) in prompts.
🚧 In Development
Content Moderation Tool
Check text for harmful, toxic, or inappropriate content.
Open
Learn
Adversarial Prompt Tester
Test model robustness against adversarial inputs.
🚧 In Development
AI-Generated Content Detector
Detect if text was likely generated by AI models.
🚧 In Development
Data Leakage Checker
Scan for potential training data leakage in model outputs.
🚧 In Development
Bias Audit Tool
Audit model outputs for gender, racial, or cultural bias.
🚧 In Development
Tap "Expand" to view tools

LLM Security & Red Teaming

10 tools
Jailbreak Attack Tester
Test LLMs with jailbreak prompts (DAN, evil mode, role-play attacks).
Open
Learn
Prompt Injection Attack Lab
Craft and test prompt injection attacks (indirect, context hijacking).
🚧 In Development
Adversarial Suffix Generator
Generate adversarial suffixes to bypass safety filters.
🚧 In Development
Model Extraction Simulator
Simulate model extraction attacks via API queries.
🚧 In Development
Membership Inference Attack
Test if specific data was in the training set.
🚧 In Development
Backdoor Trigger Detector
Detect potential backdoor triggers in model behavior.
🚧 In Development
System Prompt Leakage Tester
Attempt to extract system prompts from LLM responses.
🚧 In Development
Token Smuggling Attack
Test token-level attacks and encoding exploits.
🚧 In Development
Context Window Overflow
Test model behavior with context window overflow attacks.
🚧 In Development
Multi-Turn Attack Simulator
Chain multiple prompts to bypass safety mechanisms.
🚧 In Development
Tap "Expand" to view tools