PURPLE TEST Red Team LLM vs. Blue LLM Team at CanSecWest 24

So this looks like it's happening. Preliminary rules will be forthcoming, we are forming a referee committee from prize sponsor's domain specialists, and other smart folks. Contact me if interested.

Blue teams can set up their LLMs connected to contest cloud instances to to access the partially attacker tainted benchmark prompt stream and web proxies while attempting to score correct benchmark result points and avoiding being docked points for returning content from the "poison list."

Red team attackers score points for messing up the Blue team results and extra points for making Blue LLMs go outside the guardrails to the "poison list" by injecting their hostile queries and modified web pages from their contest cloud instances, into the legitimate test stream proxies.

Competing teams will get access to the contest through competition accounts for conference registrants in-person, and on-line.

 
Next
Next

DOJO Pricing Changes