AI Red Team Operations Console

A structured audit framework for ML pipelines. 14 stages, 100+ checks, and every leakage pattern that silent model failures are made of.

Autonomous Update Review Architecture for Federated Learning. A full-stack platform for inspecting, scoring, and auditing model updates using SHAP explainability, anomaly detection, and ledger-based tracking. Built with FastAPI, React 19, and Flower.

Third-party-verifiable model-authenticity audit for the javis.bot Claude/GPT relay — open-source probe, runs on GitHub Actions, code/runs/results all public.

Reproducible pipeline for silent-failure auditing in ECG accept-sets (MIT-BIH) with Newton–Puiseux onset scoring

A method-neutral protocol for recording and verifying evidence that latent model states causally influenced downstream decisions, outputs, or actions, without requiring storage of raw internal activations.

Production-grade platform for auditing AI/ML models for fairness, explainability, and robustness. JWT auth, SHA-256 model verification, paginated REST API, dark web dashboard. 30/30 tests passing.

A production-grade LLM Evaluation & Benchmarking Framework for systematic model auditing. Features parallel benchmarking, fairness/bias detection, MMLU integration, and a real-time analytics dashboard powered by React and FastAPI.

Open-source toolkit for Fourier-based audits of trained quantum neural networks.

Subgroup-stratified, calibration-aware fairness auditing for ML models: DeLong AUC confidence intervals, per-subgroup calibration error, multiple-comparison-corrected significance, and a novel five-axis cross-platform protocol (CPFE). Grounded in peer-reviewed methods.

SHAP-based bias detection and model interpretability auditing framework. Feature importance analysis and ML audit automation.

Audit a public AI text classifier for bias and explain its decisions. Counterfactual fairness probing (Equity Evaluation Corpus style) + occlusion-based token attribution, on a black-box model using only inputs and outputs. Python · Transformers · PyTorch.

Second Look — a clinically-grounded triage safety-net & audit system (Triagegeist hackathon): calibrated ESI + vitals-independent red-flag NLP + honest informative-missingness & fairness audit + live Gradio demo.

AI Evaluator Pro 🛡️ is an AI security auditing tool that checks Hugging Face models for supply chain risks, unsafe formats, and author trust using OSINT + LLMs. It supports direct or discovery-based audits to detect security and integrity issues before deployment.

Workspace-lens audit cards and training-workflow scaffolds for open-weight language models.

Code, manuscript, and reproducible artifacts for The Spectral Geometry of Misalignment.

Coordinate multiple LLMs in parallel for voting, debate, synthesis, critique, red teaming, and verification via MCP and Claude Code