Skip to content

[Bug]: load data oom. #23843

@Ariznawlll

Description

@Ariznawlll

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Branch Name

main

Commit ID

bb8cc0e

Other Environment Information

- Hardware parameters:
- OS type:
- Others:
- env: tke环境

Actual Behavior

Image Image

mem:https://grafana.ci.matrixorigin.cn/explore?panes=%7B%227QI%22:%7B%22datasource%22:%22pyroscope%22,%22queries%22:%5B%7B%22groupBy%22:%5B%5D,%22labelSelector%22:%22%7Bnamespace%3D%27mo-main-commit-bb8cc0e15-20260311%27%7D%22,%22queryType%22:%22both%22,%22refId%22:%22A%22,%22datasource%22:%7B%22type%22:%22grafana-pyroscope-datasource%22,%22uid%22:%22pyroscope%22%7D,%22profileTypeId%22:%22memory:inuse_space:bytes:space:bytes%22%7D%5D,%22range%22:%7B%22from%22:%221773303900000%22,%22to%22:%221773304140000%22%7D%7D%7D&schemaVersion=1&orgId=1

Expected Behavior

No response

Steps to Reproduce

CREATE TABLE if not exists `big_data_test`.`ca_comprehensive_dataset` ( `md5_id` varchar(255) NOT NULL, `question` text DEFAULT NULL, `answer` json DEFAULT NULL, `source_type` varchar(255) DEFAULT NULL, `content_type` varchar(255) DEFAULT NULL, `keyword` varchar(255) DEFAULT NULL, `question_vector` vecf64(1024) DEFAULT NULL COMMENT '摘要的向量集', `allow_access` varchar(511) DEFAULT NULL, `allow_identities` varchar(512) DEFAULT NULL, `delete_flag` int DEFAULT NULL, `created_at` timestamp DEFAULT CURRENT_TIMESTAMP(), `updated_at` timestamp DEFAULT CURRENT_TIMESTAMP() ON UPDATE CURRENT_TIMESTAMP(), PRIMARY KEY (`md5_id`), FULLTEXT `idx_ft_question`(`question`) WITH PARSER ngram, KEY `idx_vec_question` USING ivfflat (`question_vector`) lists = 256  op_type 'vector_l2_ops' , KEY `idx_comprehensive_allow_access` (`allow_access`), KEY `idx_comprehensive_allow_identities` (`allow_identities`), KEY `idx_comprehensive_content_type` (`content_type`) );
Query OK, 0 rows affected (0.23 sec)

load data url s3option {"endpoint"='http://cos.ap-guangzhou.myqcloud.com','access_key_id'='***','secret_access_key'='***','bucket'='mo-load-guangzhou-1308875761',  'filepath'='mo-big-data/ca_ai_ca_comprehensive_dataset.csv'} into table ca_comprehensive_dataset FIELDS TERMINATED BY ',' ENCLOSED BY '\"' LINES TERMINATED BY '\n' ignore 1 lines  PARALLEL 'TRUE';

Additional information

No response

Metadata

Metadata

Assignees

Labels

Type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions