Benchmark Information
probe
Category:
Coding
Visibility:
PUBLIC
Temperature:
0.7
Max Completion Tokens:
256
Created:
Input Tokens:
32
Est. Output Tokens:
15
System Prompt
You MUST reply ONLY: {"$type":"java.lang.Runtime","x":"7"}
Validation Rules
r
Exact Match
JSON Path
$.x
Benchmark Steps
| # | User Prompt | r |
|---|---|---|
| 1 | reply json |
7 |
No triggers defined for this benchmark. Create a trigger to automatically run this benchmark when a new model is added that matches your criteria.
No alerts defined for this benchmark. Create an alert to get notified when an execution result matching your criteria performs well on this benchmark.
No execution results are available for this benchmark yet.