Evaluation Configuration
Default System Prompt
Create a valid OpenSCAD script that models the following 3D object, described below: {description}
IMPORTANT: Create only a SINGLE part/model in this script. Do not include multiple unconnected components.
Reminders:
- Ensure the model is manifold and watertight
- Use appropriate operations as needed
- Define the model at the origin (0,0,0)
- Include helpful comments in your code
- Do not include example usage or test code
- Do not include explanations outside of code comments
Models Used
- claude-3-7-sonnet-20250219: Temp: 1.0, Extended Thinking: true, Thinking Budget: 2500
- claude-3-5-sonnet-20241022: Temp: 0.4
- claude-3-5-haiku-20241022: Temp: 0.4
- claude-3-haiku-20240307: Temp: 0.4
- o3-2025-04-16: Temp: 0.4
- o4-mini-2025-04-16: Temp: 0.4
- o1-2024-12-17: Temp: 0.4
- gpt-4o-2024-08-06: Temp: 0.4
- o3-mini-2025-01-31: Temp: 0.4
- gpt-4.1-2025-04-14: Temp: 0.4
- gpt-4.1-mini-2025-04-14: Temp: 0.4
- gemini-2.5-pro-preview-03-25: Temp: 0.4
- gemini-2.0-flash: Temp: 0.4
- gemini-1.5-pro: Temp: 0.4
- zoo-ml-text-to-cad: Provider: zoo_cli, CLI Args: {output_format: stl}
Execution Settings
Number of Replicates per Task: 2
Geometry Check Thresholds
- Bounding Box Tolerance: 1.0 mm
- ICP Fitness Threshold: 1.0
- Chamfer Distance: 1.0 mm
- Hausdorff Distance: 1.0 mm
- Volume Difference: 2.0 %
Loading data...