spotter — Run #243 (2025-03-17)
    
      
        Overall Score:
        35.4%
      
      
      (40% Scalability Score + 60% Test Score)
    
  
  (40% Scalability Score + 60% Test Score)
DA-bench Setup for Run #243 — Scalability Score: 85.7% (6 / 7)
See how this tool was set up for the test.
- 
          
Setup Less Than 20 Minutes 
- 
          
Connects to Data Warehouse 
- 
          
Handles 1TB Table 
- 
          
Handles 10+ Tables 
- 
          
No Table Structure Changes 
- 
          
No SQL Expertise for Setup 
DA-bench Results for Run #243 — Test Score: 1.8% (5 / 280)
      Data Querying (0 / 175)
      
          
        11 Correct Answers,
        10 Hallucinations
      
    
    
      Domain Knowledge (5 / 5)
      
          
        1 Correct Answer,
        0 Hallucinations
      
    
    | Question | Date Tested | Overall Score | Video Recording | 
|---|---|---|---|
| 
                  dk01
                   | 2025-03-17 | 5 | 
      Feature Engineering (0 / 40)
      
          
        0 Correct Answers,
        0 Hallucinations
      
    
    | Question | Date Tested | Overall Score | Video Recording | 
|---|---|---|---|
| 
                  fe1
                   | 2025-03-17 | 0 | |
| 
                  fe2
                   | 2025-03-17 | 0 | |
| 
                  fe3
                   | 2025-03-17 | 0 | |
| 
                  fe4
                   | 2025-03-17 | 0 | |
| 
                  fe5
                   | 2025-03-17 | 0 | |
| 
                  fe6
                   | 2025-03-17 | 0 | |
| 
                  fe7
                   | 2025-03-17 | 0 | |
| 
                  fe8
                   | 2025-03-17 | 0 | 
      Insight Identification (0 / 40)
      
          
        0 Correct Answers,
        0 Hallucinations
      
    
    | Question | Date Tested | Overall Score | Video Recording | 
|---|---|---|---|
| 
                  ii2
                   | 2025-03-17 | 0 | |
| 
                  ii5
                   | 2025-03-17 | 0 | |
| 
                  ii6
                   | 2025-03-17 | 0 | |
| 
                  ii7
                   | 2025-03-17 | 0 | |
| 
                  ii8
                   | 2025-03-17 | 0 | |
| 
                  ii10
                   | 2025-03-17 | 0 | |
| 
                  ii12
                   | 2025-03-17 | 0 | |
| 
                  ii15
                   | 2025-03-17 | 0 | 
      Learning (-5 / 5)
      
          
        0 Correct Answers,
        1 Hallucination
      
    
    | Question | Date Tested | Overall Score | Video Recording | 
|---|---|---|---|
| 
                  l1
                   | 2025-03-17 | -5 | 
      Visualization (5 / 15)
      
          
        1 Correct Answer,
        0 Hallucinations
      
    
    | Question | Date Tested | Overall Score | Video Recording | 
|---|---|---|---|
| 
                  v1
                   | 2025-03-17 | 0 | |
| 
                  v2
                   | 2025-03-17 | 0 | |
| 
                  v3
                   | 2025-03-17 | 5 | 
 
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
    