Cannot copy column with "embulk-filter-column"

Asked 2 years ago, Updated 2 years ago, 450 views

I'd like to copy a column with the same contents as a specific column in mysql by embulk.
The filter plug-in ilembulk-filter-column が does not work well and cannot be copied.

I used this method as a reference.
https://qiita.com/sonots/items/1acb9c53f0566bf78a9e

The cause and solution could not be extracted from the log.

What do you think is wrong?
Please point out the grammar error.

 in:
  type —mysql
  host: {{env.HOST}}
  user: {{env.USER}}
  password: {{env.PASS}}
  database: {{env.DB}}

filter:
  - type —column
    columns:
      - {name:DATA_COPY, src:DATE}

out:
  type —bigquery
  mode —Replace
  auth_method —json_key
  json_keyfile: '{env.CREDENTIAL}}'
  path_prefix —tmp
  allow_quoted_newlines:1#
  file_ext:.csv.gz
  source_format —CSV
  project: {{env.PROJECT}}
  dataset: {{env.DATASET}}
  auto_create_table —true
  table: {{env.TABLE}}
  formatter: {type:csv, charset:UTF-8, delimiter:',',header_line:false}
  encoders:
  - {type:gzip}

IN INFORMATION

ID, DATE
1,2021-11-12

OUT INFORMATION

ID, DATE
1,2021-11-12

embulk

2022-09-30 21:59

1 Answers

indent miss

 filters:
- type —column
  add_columns:
  - {name:DATA_COPY, src:DATE}


2022-09-30 21:59

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.