Skip to content

MANIFEST.md

Latest commit

 

History

History
284 lines (226 loc) · 10.6 KB

MANIFEST.md

File metadata and controls

284 lines (226 loc) · 10.6 KB

VybeCoder Real-World Test Suite - Bug Manifest

This document catalogs every intentional bug in the test suite, organized by tier and language.

Tier 1: Syntax Errors (BLOCKING - Must Fix)

JavaScript (3 files, 6 bugs)

File Bug Description
shopping-cart.js Unclosed object brace Missing } for discount object
shopping-cart.js Unclosed function brace Missing } for addItem function
api-client.js Unclosed string Missing ' on API_BASE string
api-client.js Unclosed template literal Missing ` on error message
data-processor.js Unclosed array Missing ] for sources array
data-processor.js Unclosed parenthesis Missing ) for map chain

TypeScript (3 files, 6 bugs)

File Bug Description
user-service.ts Unclosed interface brace Missing } for metadata nested object
user-service.ts Unclosed generic bracket Missing > in ApiResponse<T
event-handler.ts Unclosed string in type Missing ' on 'change' in union type
event-handler.ts Unclosed arrow function Missing } in forEach callback
ProductCard.tsx Unclosed JSX attribute Missing " on className
ProductCard.tsx Unclosed JSX tag Missing </div> for product-info

Python (3 files, 6 bugs)

File Bug Description
database.py Unclosed parenthesis Missing ) in sqlite3.connect call
database.py Unclosed string Missing " on INSERT query
config_parser.py Unclosed list Missing ] for allowed_origins
config_parser.py Unclosed dict Missing } for returned dict
email_template.py Unclosed f-string brace Missing } after {name
email_template.py Unclosed triple-quote Missing """ on render_notification

Java (3 files, 6 bugs)

File Bug Description
OrderService.java Missing semicolon Missing ; after taxRate declaration
OrderService.java Unclosed brace Missing } for createOrder method
Logger.java Unclosed string Missing " in DateTimeFormatter pattern
Logger.java Unclosed parenthesis Missing ) in if condition
Cache.java Unclosed generic Missing > in Cache<K, V
Cache.java Unclosed array Missing } for TTL_OPTIONS array

Go (3 files, 6 bugs)

File Bug Description
server.go Unclosed struct Missing } for Server struct
server.go Unclosed string Missing " on name field
processor.go Unclosed slice Missing } for defaultItems slice
processor.go Unclosed parenthesis Missing ) in Printf call
config.go Unclosed map Missing } for defaultFeatures map
config.go Missing brace Missing { after if condition

C# (3 files, 6 bugs)

File Bug Description
ProductRepository.cs Missing semicolon Missing ; after _products field
ProductRepository.cs Unclosed brace Missing } for Add method
EventService.cs Unclosed string Missing " on _defaultLocation
EventService.cs Unclosed parenthesis Missing ) on OrderBy call
UserController.cs Unclosed array Missing } for ValidRoles array
UserController.cs Unclosed object Missing } for UserDto initializer

Swift (3 files, 6 bugs)

File Bug Description
NetworkManager.swift Unclosed struct Missing } for NetworkConfig
NetworkManager.swift Unclosed string Missing " on defaultMessage
TaskManager.swift Unclosed array Missing ] for defaultTags
TaskManager.swift Unclosed closure Missing } in filter closure
CacheService.swift Unclosed dictionary Missing ] for defaultConfig
CacheService.swift Missing brace Missing { after guard else

C++ (3 files, 6 bugs)

File Bug Description
DataStore.hpp Missing semicolon Missing ; after class definition
DataStore.hpp Unclosed struct Missing } for Record struct
Logger.cpp Unclosed string Missing " on DEFAULT_FORMAT
Logger.cpp Unclosed template Missing > in template<typename T
ConfigManager.hpp Unclosed initializer Missing } for DEFAULT_KEYS
ConfigManager.hpp Unclosed parenthesis Missing ) in getOrDefault params

Tier 1 Total: 24 files, 48 bugs

Tier 2: Compile/Type Errors (BLOCKING - Should Fix)

JavaScript (3 files, 6 bugs)

File Bug Description
user-validator.js Undefined function trimAndLower() doesn't exist
user-validator.js Accessing undefined userData.profile.firstName without null check
calculator.js Missing return multiply() doesn't return
calculator.js Wrong arg count power(a) missing second argument
order-processor.js Non-existent import formatCurrency not in utils
order-processor.js Undefined variable discountRate not defined

TypeScript (3 files, 6 bugs)

File Bug Description
payment-service.ts Return type mismatch Returns string instead of PaymentResult
payment-service.ts Missing property isDefault missing in return object
data-transformer.ts Wrong argument type Passing string to Date parameter
data-transformer.ts Undefined property user.isActive doesn't exist on type
api-client.ts Missing await fetchOne not awaited
api-client.ts Generic constraint violation Settings doesn't have 'id'

Python (3 files, 6 bugs)

File Bug Description
inventory_manager.py Return type mismatch Returns string, declared int
inventory_manager.py Undefined variable logger not defined
report_generator.py Missing import json module not imported
report_generator.py Undefined attribute report.author doesn't exist
user_auth.py None not handled user.password_hash when user is None
user_auth.py Wrong argument type Passing list to str parameter

Java (3 files, 6 bugs)

File Bug Description
BookService.java Missing return findById has no return at end
BookService.java Type mismatch Returning String where int expected
EmailNotifier.java Undefined method formatMessage() doesn't exist
EmailNotifier.java Argument mismatch Passing List to String parameter
TaskQueue.java Interface incomplete SimpleTask missing getPriority()
TaskQueue.java Generic constraint String doesn't extend Executable

Go (3 files, 6 bugs)

File Bug Description
user_store.go Undefined function validateEmail() not defined
user_store.go Return type mismatch Returning string for int
handler.go Interface incomplete HealthHandler missing GetMethod()
handler.go Wrong return count Returning 2 values for 1-value signature
cache.go Undefined field createdAt not in CacheItem struct
cache.go Unused variable count declared but not used

C# (3 files, 6 bugs)

File Bug Description
OrderProcessor.cs Missing using Task type needs System.Threading.Tasks
OrderProcessor.cs Return type mismatch Returning string for int
NotificationService.cs Interface incomplete EmailSender missing ValidateRecipient
NotificationService.cs Undefined method FormatMessage() doesn't exist
Repository.cs Generic constraint Product doesn't implement IEntity
Repository.cs Property type mismatch String property assigned int

Swift (3 files, 6 bugs)

File Bug Description
DataManager.swift Protocol incomplete User missing fromDict()
DataManager.swift Return type mismatch Returning String for Int
PaymentProcessor.swift Undefined function validateCard() doesn't exist
PaymentProcessor.swift Argument type mismatch String passed for Double
ConfigLoader.swift Property type mismatch Int assigned to Int property
ConfigLoader.swift Optional return type Returning optional for non-optional

C++ (3 files, 6 bugs)

File Bug Description
MessageQueue.hpp Undefined function getCurrentTimestamp() not defined
MessageQueue.hpp Return type mismatch Returning string for int
Container.hpp Undefined member capacity_ doesn't exist
Container.hpp Undefined member description_ doesn't exist
Shape.hpp Pure virtual not overridden Circle missing describe()
Shape.hpp Wrong override signature Rectangle::describe returns void

Tier 2 Total: 24 files, 48 bugs

Tier 3: Quality Suggestions (NON-BLOCKING)

JavaScript (2 files, ~12 suggestions)

  • Using == instead of ===
  • Unused variables/imports
  • console.log in production
  • var instead of const/let
  • Callback hell pattern

TypeScript (2 files, ~12 suggestions)

  • Unused imports
  • any type usage
  • Non-null assertion operator (!)
  • Implicit any in callbacks

Python (2 files, ~12 suggestions)

  • Unused imports
  • Bare except clauses
  • Magic numbers
  • Mutable default arguments
  • Using is for value comparison

Java (2 files, ~12 suggestions)

  • Unused imports
  • String comparison with ==
  • Raw type usage
  • String concatenation in loops
  • Empty catch blocks

Go (2 files, ~12 suggestions)

  • Typos (Printl, Qurey, Disconect)
  • Unchecked errors
  • Unused variables

C# (2 files, ~12 suggestions)

  • Unused using directives
  • String comparison without StringComparison
  • Possible null references
  • String concatenation in loops

Swift (2 files, ~12 suggestions)

  • Force unwrap (!)
  • Force try (try!)
  • Force cast (as!)
  • Unused methods

C++ (2 files, ~12 suggestions)

  • Raw pointers (no smart pointers)
  • C-style casts
  • Missing const correctness
  • Unused members

Tier 3 Total: 16 files, ~96 suggestions

Summary

Tier Files Bugs/Suggestions Expected Fix Rate
Tier 1 (Syntax) 24 48 95-100%
Tier 2 (Compile) 24 48 80-90%
Tier 3 (Quality) 16 ~96 N/A (detection only)
Total 64 ~192 -

Scoring Guide

Tier 1 Score

Score = (Bugs Fixed / 48) × 100
Target: ≥95%

Tier 2 Score

Score = (Bugs Fixed / 48) × 100
Target: ≥80%

Tier 3 Score

Score = (Suggestions Detected / ~96) × 100
Target: ≥70% detection (fixes optional)

Overall Score

Overall = (Tier1 × 0.5) + (Tier2 × 0.35) + (Tier3_Detection × 0.15)
Target: ≥85%