Skip to content

Snowpark connect notebook errors #2830

@kvenkatraman

Description

@kvenkatraman

Describe the bug

  1. Copy fails due to mismatch (default column in table does not work with standard copy command
  2. Table referred does not exist.

URL of where you see the bug
https://github.com/Snowflake-Labs/sfquickstarts/tree/master/site/sfguides/src/analyze-logistics-data-using-snowpark-connect-for-apache-spark

To Reproduce

  1. Open notebook: [analyze-logistics-data-using-snowpark-connect-for-apache-spark]
  2. Issue - 1: Refer to cell: copy_data_into_table_1
  3. Issue -2:
    a. refer to the cell: delivery_confirmations - "build25_de_keynote.data.delivery_confirmations" does not exists
    b. refer to cell freight_bills_data - "build25_de_keynote.data.freight_bills"

Additional context
Issue-1 can be fixed by adjusting file format to include: ERROR_ON_COLUMN_COUNT_MISMATCH = FALSE

full statement as below
CREATE OR REPLACE FILE FORMAT csv_format
TYPE = 'CSV'
FIELD_DELIMITER = ','
SKIP_HEADER = 1 -- Assumes the first row is a header
NULL_IF = ('', 'NULL')
EMPTY_FIELD_AS_NULL = TRUE
ERROR_ON_COLUMN_COUNT_MISMATCH = FALSE
COMPRESSION = 'AUTO';

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions