Skip to content

Prompt: LLMs emit URLs that do not exist #54

@amotl

Description

@amotl

Problem

LLMs hallucinate, in this case about URLs. The question was:

"CrateDB does not seem to provide an AUTOINCREMENT feature?"

Details

Both text fragments include URLs that don't exist, or are wrong. The correct URL would be https://cratedb.com/docs/guide/performance/inserts/sequences.html.

CrateDB does not offer automatic incrementing IDs due to distributed scaling concerns. Use UUIDs, timestamps, or an application-managed sequence as needed. See the CrateDB documentation: Autogenerated sequences and PRIMARY KEY values for examples and best practices.

CrateDB: Autogenerated sequences and PRIMARY KEY values

CrateDB Community: Sequences in distributed databases

Reproduce

The command was:

uvx llm --model gpt-4.1 \
  --fragment https://cdn.crate.io/about/v1/llms-full.txt \
  --system-fragment https://cdn.crate.io/about/v1/instructions-general.md \
  "CrateDB does not seem to provide an AUTOINCREMENT feature?"

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions