Describe the bug
- Copy fails due to mismatch (default column in table does not work with standard copy command
- Table referred does not exist.
URL of where you see the bug
https://github.com/Snowflake-Labs/sfquickstarts/tree/master/site/sfguides/src/analyze-logistics-data-using-snowpark-connect-for-apache-spark
To Reproduce
- Open notebook: [analyze-logistics-data-using-snowpark-connect-for-apache-spark]
- Issue - 1: Refer to cell: copy_data_into_table_1
- Issue -2:
a. refer to the cell: delivery_confirmations - "build25_de_keynote.data.delivery_confirmations" does not exists
b. refer to cell freight_bills_data - "build25_de_keynote.data.freight_bills"
Additional context
Issue-1 can be fixed by adjusting file format to include: ERROR_ON_COLUMN_COUNT_MISMATCH = FALSE
full statement as below
CREATE OR REPLACE FILE FORMAT csv_format
TYPE = 'CSV'
FIELD_DELIMITER = ','
SKIP_HEADER = 1 -- Assumes the first row is a header
NULL_IF = ('', 'NULL')
EMPTY_FIELD_AS_NULL = TRUE
ERROR_ON_COLUMN_COUNT_MISMATCH = FALSE
COMPRESSION = 'AUTO';
Describe the bug
URL of where you see the bug
https://github.com/Snowflake-Labs/sfquickstarts/tree/master/site/sfguides/src/analyze-logistics-data-using-snowpark-connect-for-apache-spark
To Reproduce
a. refer to the cell: delivery_confirmations - "build25_de_keynote.data.delivery_confirmations" does not exists
b. refer to cell freight_bills_data - "build25_de_keynote.data.freight_bills"
Additional context
Issue-1 can be fixed by adjusting file format to include: ERROR_ON_COLUMN_COUNT_MISMATCH = FALSE
full statement as below
CREATE OR REPLACE FILE FORMAT csv_format
TYPE = 'CSV'
FIELD_DELIMITER = ','
SKIP_HEADER = 1 -- Assumes the first row is a header
NULL_IF = ('', 'NULL')
EMPTY_FIELD_AS_NULL = TRUE
ERROR_ON_COLUMN_COUNT_MISMATCH = FALSE
COMPRESSION = 'AUTO';