I'd like to copy a column with the same contents as a specific column in mysql by embulk.
The filter plug-in ilembulk-filter-column が does not work well and cannot be copied.
I used this method as a reference.
https://qiita.com/sonots/items/1acb9c53f0566bf78a9e
The cause and solution could not be extracted from the log.
What do you think is wrong?
Please point out the grammar error.
in:
type —mysql
host: {{env.HOST}}
user: {{env.USER}}
password: {{env.PASS}}
database: {{env.DB}}
filter:
- type —column
columns:
- {name:DATA_COPY, src:DATE}
out:
type —bigquery
mode —Replace
auth_method —json_key
json_keyfile: '{env.CREDENTIAL}}'
path_prefix —tmp
allow_quoted_newlines:1#
file_ext:.csv.gz
source_format —CSV
project: {{env.PROJECT}}
dataset: {{env.DATASET}}
auto_create_table —true
table: {{env.TABLE}}
formatter: {type:csv, charset:UTF-8, delimiter:',',header_line:false}
encoders:
- {type:gzip}
IN INFORMATION
ID, DATE
1,2021-11-12
OUT INFORMATION
ID, DATE
1,2021-11-12
indent miss
filters:
- type —column
add_columns:
- {name:DATA_COPY, src:DATE}
© 2024 OneMinuteCode. All rights reserved.