If you run an embulk on the cron, the process stops halfway.

Asked 2 years ago, Updated 2 years ago, 291 views

I'd like to run an embulk on cron.
I can check the log until the kick of the program set in cron, but

If you compare the command execution time and cron time with the standard output of the processing to the log, the processing only stops at cron time.
The error is as follows:

org.embulk.exec.PartialExecutionException:org.embulk.config.ConfigException: Failed to map a JSON value into some object.

As far as the log shows, the embulk run on cron has stopped with the following actions:

2021-11-16 14:00:02.447+0900:Embulk v0.9.23
2021-11-16 14:00:14.483 + 0900 [WARN] (main): DEPRECATION: JRuby org.jruby.embed.ScriptingContainer is directly injected.
2021-11-16 14:00:56.884 + 0900 [INFO] (main): Gem's home and path are set by default: "/root/.embulk/lib/gems"
2021-11-16 14:01:26.054 + 0900 [INFO] (main): Started Embulk v0.9.23
2021-11-16 14:01:26.197 + 0900 [INFO] (0001:transaction): Loaded plugin embulk-input-mysql 
2021-11-16 14:01:27.685 + 0900 [INFO] (0001:transaction): Loaded plugin embulk-output-mysql
2021-11-16 14:01:30.755 + 0900 [WARN] (0001:transaction): "UTC" is recognized as "Z" to be compatible with the legacy style.

Typically, a command from the CLI does not stop at WARN.
What measures should I take to continue the processing with cron?

shellscript cron embulk

2022-09-29 22:08

1 Answers

Resolved.

The reason is that we only extracted the standard output, and we didn't know the cause.
Checked the standard error output and fixed the bug.


2022-09-29 22:08

If you have any answers or tips


© 2024 OneMinuteCode. All rights reserved.