Opiniones sobre Batch Load Data Into BigQuery

Craig H. · Se revisó hace más de 6 años

There was an issue using qwiklabs for Big query as it was not enabled.

Kanchana P. · Se revisó hace más de 6 años

Too simple :/

Alexis K. · Se revisó hace más de 6 años

Sunil B. · Se revisó hace más de 6 años

okay. it would be great to review the initial dataset from Wikipedia

Laurent B. · Se revisó hace más de 6 años

Daniel S. · Se revisó hace más de 6 años

Daniel H. · Se revisó hace más de 6 años

Hugo A. · Se revisó hace más de 6 años

Thanks

Yandi S. · Se revisó hace más de 6 años

Iain K. · Se revisó hace más de 6 años

Samuel T. · Se revisó hace más de 6 años

Simplistic

Christopher T. · Se revisó hace más de 6 años

Mihail I. · Se revisó hace más de 6 años

Alex H. · Se revisó hace más de 6 años

John B. · Se revisó hace más de 6 años

Welcome to Cloud Shell! Type "help" to get started. google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz --2017-12-02 17:30:16-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11 Connecting to dumps.wikimedia.org (dumps.wikimedia.org)|208.80.154.11|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 73747078 (70M) [application/octet-stream] Saving to: ‘pagecounts-20160101-070000.gz’ pagecounts-20160101-070000.gz 100%[==============================================================================================================================================================>] 70.33M 1.99MB/s in 37s 2017-12-02 17:30:53 (1.92 MB/s) - ‘pagecounts-20160101-070000.gz’ saved [73747078/73747078] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_11 \ pagecounts_20160101-070000.gz \ language,title,requests:integer,content_size:integer Welcome to BigQuery! This script will walk you through the process of initializing your .bigqueryrc configuration file. First, we need to set up your credentials if they do not already exist. Credential creation complete. Now we will select a default project. List of projects: # projectId friendlyName --- ------------------------------- ------------------------------- 1 qwiklabs-resources Qwiklabs Resources 2 qwiklabs-gcp-27cb66854bc10d96 qwiklabs-gcp-27cb66854bc10d96 Found multiple projects. Please enter a selection for which should be the default, or leave blank to not set a default. Enter a selection (1 - 2): 2 BigQuery configuration complete! Type "bq" to get started. Too many positional args, still have [' pagecounts_20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ > --quote "" \ > YourProjectID:lab.pagecounts_20160108_11 \ > pagecounts-20160108-110000.gz \ > BigQuery error in load operation: Source file not found: pagecounts-20160108-110000.gz google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " "\ --quote ""\ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer BigQuery error in load operation: Field delimiter must be a single character, found:" --quote". google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have [' pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', 'language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz --2017-12-02 17:48:03-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11

John C. · Se revisó hace más de 6 años

Welcome to Cloud Shell! Type "help" to get started. google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz --2017-12-02 17:30:16-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11 Connecting to dumps.wikimedia.org (dumps.wikimedia.org)|208.80.154.11|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 73747078 (70M) [application/octet-stream] Saving to: ‘pagecounts-20160101-070000.gz’ pagecounts-20160101-070000.gz 100%[==============================================================================================================================================================>] 70.33M 1.99MB/s in 37s 2017-12-02 17:30:53 (1.92 MB/s) - ‘pagecounts-20160101-070000.gz’ saved [73747078/73747078] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_11 \ pagecounts_20160101-070000.gz \ language,title,requests:integer,content_size:integer Welcome to BigQuery! This script will walk you through the process of initializing your .bigqueryrc configuration file. First, we need to set up your credentials if they do not already exist. Credential creation complete. Now we will select a default project. List of projects: # projectId friendlyName --- ------------------------------- ------------------------------- 1 qwiklabs-resources Qwiklabs Resources 2 qwiklabs-gcp-27cb66854bc10d96 qwiklabs-gcp-27cb66854bc10d96 Found multiple projects. Please enter a selection for which should be the default, or leave blank to not set a default. Enter a selection (1 - 2): 2 BigQuery configuration complete! Type "bq" to get started. Too many positional args, still have [' pagecounts_20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ > --quote "" \ > YourProjectID:lab.pagecounts_20160108_11 \ > pagecounts-20160108-110000.gz \ > BigQuery error in load operation: Source file not found: pagecounts-20160108-110000.gz google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " "\ --quote ""\ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer BigQuery error in load operation: Field delimiter must be a single character, found:" --quote". google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have [' pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', 'language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz --2017-12-02 17:48:03-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11

John C. · Se revisó hace más de 6 años

Brian B. · Se revisó hace más de 6 años

Cyrille H. · Se revisó hace más de 6 años

Ricquan W. · Se revisó hace más de 6 años

Takes 10 minutes to upload the file.

Ben A. · Se revisó hace más de 6 años

Ricquan W. · Se revisó hace más de 6 años

Christian M. · Se revisó hace más de 6 años

This lab doesn't teach much more then where the buttons are. An explanation of the command of loading the data into BQ would have been a good start.

Jonathan Y. · Se revisó hace más de 6 años

Greg F. · Se revisó hace más de 6 años