#RedBench
LightNews LightNews
andreaskipf.bsky.social
We just released Redbench, a new benchmark that contains 30 analytical SQL workloads that can be used to benchmark workload-driven optimizations. Go check it out!

GitHub: github.com/utndatasyste...
GitHub - utndatasystems/redbench: Redbench is a set of 30 analytical SQL workloads that can be used to benchmark workload-driven optimizations.
Redbench is a set of 30 analytical SQL workloads that can be used to benchmark workload-driven optimizations. - utndatasystems/redbench
github.com
March 25, 2025 at 9:42 PM
andreaskipf.bsky.social
Off to SIGMOD 2025 in Berlin! 🚄

Here’s our schedule:

Today, 4:20 PM:
💡 Redbench: A Benchmark Reflecting Real Workloads (aiDM)

Wed, 2:00 PM:
🏆 DPconv: Super-Polynomially Faster Join Ordering

Thu, 2:30 PM:
❄️ Pruning in Snowflake: Working Smarter, Not Harder

Come say hi! 👋
June 22, 2025 at 10:52 AM
mihailstoian.bsky.social
🔺Redbench is now live: github.com/utndatasyste....

Let's see how workload-aware your system really is.
April 9, 2025 at 10:11 PM
pvldb.bsky.social
Vol:19 No:9 → Redbench: Workload Synthesis From Cloud Traces
👥 Authors: Johannes Wehrstein, Roman Heinrich, Mihail Stoian, Skander Krid, Martin Stemmer, Andreas Kipf, Carsten Binnig, Muhammad El-Hindi
📄 PDF: https://www.vldb.org/pvldb/vol19/p2113-wehrstein.pdf
Thumbnail: Redbench: Workload Synthesis From Cloud Traces
August 19, 2026 at 2:00 AM
lucaneve.bsky.social
#LuchaYSiesta #AssociazioneDiRe #DonneInReteControLaViolenza #DifferenzaDonnaONG #NoCPR #Scosse #RedBench #quote #GiselPelicot #LaVergognaDeveCambiareLato #ShameMustChangeSides #PanchinaRossa #PanchinaRifugio #useless #symbol #GiornataInternazionalePerLEliminazioneDellaViolenzaControLeDonne
November 27, 2024 at 12:13 AM
lucaneve.bsky.social
#ProPalestina #StopGenocide #StopGenocidio #Genocidio #CrimeAgainstHumanity #PalestinaLibera #Solidarity #CeasefireNow #CessateIlFuoco #FermateLaGuerra #StopCrimesInPalestine #EducateYourSon #PanchinaRossa #RedBench #PanchinaRifugio #Minerva #StopTheWarAgainstWomen
November 26, 2024 at 11:53 PM
getpacketai.bsky.social
RedBench unifies 37 red teaming datasets into one standardized benchmark for testing LLM robustness. A critical tool for safety teams deploying foundation models in high-stakes applications.

https://arxiv.org/abs/2601.03699

#AI #MachineLearning
April 24, 2026 at 12:30 PM
csdb-bot.bsky.social
Johannes Wehrstein, Roman Heinrich, Mihail Stoian, Skander Krid, Martin Stemmer, Andreas Kipf, Carsten Binnig, Muhammad El-Hindi: Redbench: Workload Synthesis From Cloud Traces https://arxiv.org/abs/2511.13059 https://arxiv.org/pdf/2511.13059 https://arxiv.org/html/2511.13059
November 18, 2025 at 6:30 AM
csdb-bot.bsky.social
Skander Krid, Mihail Stoian, Andreas Kipf: Redbench: A Benchmark Reflecting Real Workloads https://arxiv.org/abs/2506.12488 https://arxiv.org/pdf/2506.12488 https://arxiv.org/html/2506.12488
June 17, 2025 at 9:05 AM
discuss.huggingface.co.web.brid.gy
A Bidirectional LLM Firewall: Next Level X1 - help wanted!
First Runs of my Benchmark Suites - Your Forensic Agent Security Suite is fully integrated in my Firewall: PS D:\MCP Mods\HAK_GAL_HEXAGONAL\standalone_packages\llm-security-firewall> python evaluation/run_extended_evaluation_suites.py --suites harmbench,jailbreakbench,redbench,baseline --limit 50 --output-dir results/extended_all_suites3_20260112 Starting Extended Evaluation Suites: [‘harmbench’, ‘jailbreakbench’, ‘redbench’, ‘baseline’] Output directory: results\extended_all_suites3_20260112 2026-01-12 06:20:00,806 - **main** - INFO - Starting extended evaluation with suites: [‘harmbench’, ‘jailbreakbench’, ‘redbench’, ‘baseline’] 2026-01-12 06:20:00,806 - **main** - INFO - Running implemented suites: [‘harmbench’, ‘jailbreakbench’, ‘redbench’, ‘baseline’] 2026-01-12 06:20:00,806 - **main** - INFO - Running HarmBench evaluation… 2026-01-12 06:20:00,808 - **main** - INFO - HarmBench evaluation requires GPU - returning placeholder results 2026-01-12 06:20:00,808 - **main** - INFO - Running JailbreakBench evaluation… 2026-01-12 06:20:03,241 - httpx - INFO - HTTP Request: GET https://rftsystems-start-here-agent-forensics-suite.hf.space/config “HTTP/1.1 200 OK” 2026-01-12 06:20:04,476 - httpx - INFO - HTTP Request: GET https://rftsystems-start-here-agent-forensics-suite.hf.space/gradio_api/info?serialize=False “HTTP/1.1 200 OK” 2026-01-12 06:20:04,479 - integration.rftsystems_adapter - INFO - RFTSystems client initialized successfully 2026-01-12 06:20:05,849 - httpx - INFO - HTTP Request: GET https://rftsystems-start-here-agent-forensics-suite.hf.space/gradio_api/heartbeat/cbb989b7-9122-42e7-a0c8-e44a7b05387e “HTTP/1.1 200 OK” 2026-01-12 06:20:08,459 - evaluation.infrastructure.firewall_test_adapter - INFO - FirewallTestAdapter initialized: http://localhost:8001/api/v1/route-and-detect 2026-01-12 06:20:08,460 - evaluation.infrastructure.artifact_storage_adapter - INFO - ArtifactStorageAdapter initialized: results\extended_all_suites3_20260112\artifacts 2026-01-12 06:20:08,460 - evaluation.infrastructure.artifact_storage_adapter - INFO - RFTSystems receipt generation enabled 2026-01-12 06:20:08,461 - evaluation.benchmark_runners.jailbreakbench_runner - INFO - Starting JailbreakBench benchmark… 2026-01-12 06:20:08,461 - evaluation.benchmark_runners.jailbreakbench_runner - INFO - Generating JailbreakBench dataset… 2026-01-12 06:20:08,461 - evaluation.adapters.jailbreakbench_adapter - INFO - Loading JailbreakBench dataset… 2026-01-12 06:20:08,463 - evaluation.adapters.jailbreakbench_adapter - INFO - Loaded 33 jailbreak behaviors 2026-01-12 06:20:08,464 - evaluation.adapters.jailbreakbench_adapter - INFO - Converting 33 behaviors to JSONL format… 2026-01-12 06:20:08,464 - evaluation.adapters.jailbreakbench_adapter - INFO - Adding 16 benign samples… 2026-01-12 06:20:08,464 - evaluation.adapters.jailbreakbench_adapter - INFO - Created balanced dataset: 33 attacks, 16 benign 2026-01-12 06:20:08,464 - evaluation.benchmark_runners.jailbreakbench_runner - INFO - Testing 50 samples against firewall… Loaded as API: https://rftsystems-start-here-agent-forensics-suite.hf.space TY-VM! — some minor Issues to solve
discuss.huggingface.co
January 12, 2026 at 2:38 AM
informingbritain.com
"HEART PATIENT CLINT'S STORY MARKED BY A RED BENCH"
#AshleighOsborne for Worcester Observer

A #RedBench has been unveiled in #Malvern in tribute to #ClintHeaton, who had a #HeartTransplant after suffering #HeartAttacks that led to organ failure.

#WorcesterObserver
#TomorrowsPapersToday
June 18, 2026 at 8:33 PM
informingbritain.com
"SITTING PRETTY AFTER A BATTLE WITH HEART ISSUE"
#SarahMason for Solihull Observer

#ThaniethKhan has been honoured with an iconic #RedBench in #Shirley to celebrate her survival from a rare genetic heart condition.

#SolihullObserver
#TomorrowsPapersToday
#IBPAPERS
February 27, 2026 at 1:01 AM
cscl-bot.bsky.social
Quy-Anh Dang, Chris Ngo, Truong-Son Hy: RedBench: A Universal Dataset for Comprehensive Red Teaming of Large Language Models https://arxiv.org/abs/2601.03699 https://arxiv.org/pdf/2601.03699 https://arxiv.org/html/2601.03699
January 8, 2026 at 6:31 AM