Batch Load Data Into BigQuery Rezensionen
451 Rezensionen
Craig H. · Vor mehr als 7 Jahre überprüft
There was an issue using qwiklabs for Big query as it was not enabled.
Kanchana P. · Vor mehr als 7 Jahre überprüft
Too simple :/
Alexis K. · Vor mehr als 7 Jahre überprüft
Sunil B. · Vor mehr als 7 Jahre überprüft
okay. it would be great to review the initial dataset from Wikipedia
Laurent B. · Vor fast 8 Jahre überprüft
Daniel S. · Vor fast 8 Jahre überprüft
Daniel H. · Vor fast 8 Jahre überprüft
Hugo A. · Vor fast 8 Jahre überprüft
Thanks
Yandi S. · Vor fast 8 Jahre überprüft
Iain K. · Vor fast 8 Jahre überprüft
Samuel T. · Vor fast 8 Jahre überprüft
Simplistic
Christopher T. · Vor fast 8 Jahre überprüft
Mihail I. · Vor fast 8 Jahre überprüft
Alex H. · Vor fast 8 Jahre überprüft
John B. · Vor fast 8 Jahre überprüft
Welcome to Cloud Shell! Type "help" to get started. google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz --2017-12-02 17:30:16-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11 Connecting to dumps.wikimedia.org (dumps.wikimedia.org)|208.80.154.11|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 73747078 (70M) [application/octet-stream] Saving to: ‘pagecounts-20160101-070000.gz’ pagecounts-20160101-070000.gz 100%[==============================================================================================================================================================>] 70.33M 1.99MB/s in 37s 2017-12-02 17:30:53 (1.92 MB/s) - ‘pagecounts-20160101-070000.gz’ saved [73747078/73747078] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_11 \ pagecounts_20160101-070000.gz \ language,title,requests:integer,content_size:integer Welcome to BigQuery! This script will walk you through the process of initializing your .bigqueryrc configuration file. First, we need to set up your credentials if they do not already exist. Credential creation complete. Now we will select a default project. List of projects: # projectId friendlyName --- ------------------------------- ------------------------------- 1 qwiklabs-resources Qwiklabs Resources 2 qwiklabs-gcp-27cb66854bc10d96 qwiklabs-gcp-27cb66854bc10d96 Found multiple projects. Please enter a selection for which should be the default, or leave blank to not set a default. Enter a selection (1 - 2): 2 BigQuery configuration complete! Type "bq" to get started. Too many positional args, still have [' pagecounts_20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ > --quote "" \ > YourProjectID:lab.pagecounts_20160108_11 \ > pagecounts-20160108-110000.gz \ > BigQuery error in load operation: Source file not found: pagecounts-20160108-110000.gz google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " "\ --quote ""\ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer BigQuery error in load operation: Field delimiter must be a single character, found:" --quote". google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have [' pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', 'language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz --2017-12-02 17:48:03-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11
John C. · Vor fast 8 Jahre überprüft
Welcome to Cloud Shell! Type "help" to get started. google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz --2017-12-02 17:30:16-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11 Connecting to dumps.wikimedia.org (dumps.wikimedia.org)|208.80.154.11|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 73747078 (70M) [application/octet-stream] Saving to: ‘pagecounts-20160101-070000.gz’ pagecounts-20160101-070000.gz 100%[==============================================================================================================================================================>] 70.33M 1.99MB/s in 37s 2017-12-02 17:30:53 (1.92 MB/s) - ‘pagecounts-20160101-070000.gz’ saved [73747078/73747078] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_11 \ pagecounts_20160101-070000.gz \ language,title,requests:integer,content_size:integer Welcome to BigQuery! This script will walk you through the process of initializing your .bigqueryrc configuration file. First, we need to set up your credentials if they do not already exist. Credential creation complete. Now we will select a default project. List of projects: # projectId friendlyName --- ------------------------------- ------------------------------- 1 qwiklabs-resources Qwiklabs Resources 2 qwiklabs-gcp-27cb66854bc10d96 qwiklabs-gcp-27cb66854bc10d96 Found multiple projects. Please enter a selection for which should be the default, or leave blank to not set a default. Enter a selection (1 - 2): 2 BigQuery configuration complete! Type "bq" to get started. Too many positional args, still have [' pagecounts_20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ > --quote "" \ > YourProjectID:lab.pagecounts_20160108_11 \ > pagecounts-20160108-110000.gz \ > BigQuery error in load operation: Source file not found: pagecounts-20160108-110000.gz google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " "\ --quote ""\ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer BigQuery error in load operation: Field delimiter must be a single character, found:" --quote". google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have [' pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', 'language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz --2017-12-02 17:48:03-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11
John C. · Vor fast 8 Jahre überprüft
Brian B. · Vor fast 8 Jahre überprüft
Cyrille H. · Vor fast 8 Jahre überprüft
Ricquan W. · Vor fast 8 Jahre überprüft
Takes 10 minutes to upload the file.
Ben A. · Vor fast 8 Jahre überprüft
Ricquan W. · Vor fast 8 Jahre überprüft
Christian M. · Vor fast 8 Jahre überprüft
This lab doesn't teach much more then where the buttons are. An explanation of the command of loading the data into BQ would have been a good start.
Jonathan Y. · Vor fast 8 Jahre überprüft
Greg F. · Vor fast 8 Jahre überprüft
Wir können nicht garantieren, dass die veröffentlichten Rezensionen von Verbrauchern stammen, die die Produkte gekauft oder genutzt haben. Die Rezensionen werden von Google nicht überprüft.