国产探花免费观看_亚洲丰满少妇自慰呻吟_97日韩有码在线_资源在线日韩欧美_一区二区精品毛片,辰东完美世界有声小说,欢乐颂第一季,yy玄幻小说排行榜完本

首頁 > 學院 > 操作系統 > 正文

impala大數據量查詢/tmp/impala-scratch創建異常

2024-06-28 16:04:00
字體:
來源:轉載
供稿:網友

使用impala對大數據量查詢distinct的時候出現如下錯誤

5ab149d_24414dab2c19caca:e54b206c5ab149f_91001337-9d70-4c93-84ce-e7916c1ae804 failed with errno=2 description=Error(2): No such file or directoryBackend 4:Create file /tmp/impala-scratch/24414dab2c19caca:e54b206c5ab149d_24414dab2c19caca:e54b206c5ab149f_91001337-9d70-4c93-84ce-e7916c1ae804 failed with errno=2 description=Error(2): No such file or directory

查閱文檔發現impala在大數據量處理時會用到磁盤保存中間數據

By default, intermediate files used during large sort, join, aggregation, or analytic function Operations are stored in the directory /tmp/impala-scratch. These files are removed when the operation finishes. (Multiple concurrent queries can perform operations that use the "spill to disk" technique, without any name conflicts for these temporary files.) You can specify a different location by starting the impalad daemon with the --scratch_dirs="path_to_directory" configuration option or the equivalent configuration option in the Cloudera Manager user interface. You can specify a single directory, or a comma-separated list of directories. The scratch directories must be on the local filesystem, not in HDFS. You might specify different directory paths for different hosts, depending on the capacity and speed of the available storage devices. Impala will not start if it cannot create or read and write files in the "scratch" directory. If there is less than 1 GB free on the filesystem where that directory resides, Impala still runs, but writes a warning message to its log.

直接到各個impalad節點上創建/tmp/impala-scratch中間目錄,并賦予讀寫權限:

mkdir /tmp/impala-scratchchmod 777 /tmp/impala-scratch


發表評論 共有條評論
用戶名: 密碼:
驗證碼: 匿名發表
主站蜘蛛池模板: 镇远县| 霍邱县| 盐山县| 察哈| 锦州市| 习水县| 赣州市| 西和县| 临桂县| 五台县| 武乡县| 漳平市| 德庆县| 尼木县| 万州区| 英山县| 上饶市| 蒙阴县| 平顶山市| 永康市| 疏附县| 景德镇市| 乐山市| 汉源县| 巴青县| 静宁县| 炎陵县| 崇义县| 右玉县| 建水县| 新疆| 彩票| 航空| 绵竹市| 乃东县| 汉川市| 夹江县| 夹江县| 新建县| 厦门市| 健康|