Tag: 谷歌 的BigQuery

BigQuery联合数据源的API配置

我有以下配置适用于将一堆文件加载到BigQuery中： config= { ‘configuration’=> { ‘load’=> { ‘sourceUris’=> ‘gs://my_bucket/my_files_*’, ‘schema’=> { ‘fields’=> fields_array }, ‘schemaUpdateOptions’ => [{ ‘ALLOW_FIELD_ADDITION’=> true}], ‘destinationTable’=> { ‘projectId’=> ‘my_project’, ‘datasetId’=> ‘my_dataset’, ‘tableId’=> ‘my_table’ }, ‘sourceFormat’ => ‘NEWLINE_DELIMITED_JSON’, ‘createDisposition’ => ‘CREATE_IF_NEEDED’, ‘writeDisposition’ => ‘WRITE_TRUNCATE’, ‘maxBadRecords’=> 0, } }, } 然后使用以下client进行预初始化来执行此操作： result = client.execute( api_method: big_query.jobs.insert, parameters: { projectId: ‘my_project’, datasetId: ‘my_dataset’ }, […]