You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We are planning to use Chronos at our organization but see some gaps in what we want and what is available in Chronos today. While the title of this issue is to address a feature we need immediately, I will list down all that we are looking for.
Our use-case requires us to run jobs on all dates that satisfies the schedule of ScheduledJob. In other words, we don't want to skip date just because it is in the past. This is because the dates are used to pull slices of data from systems onto Hadoop. In the current form of Chronos, we can't enable/configure this to be so. This would also require the startDate/newDate/intendedRunDate of a job to be available as metadata to jobs (env var?). We could start off by making the startDate available as an environment variable to jobs. This seems possible in MesosTaskBuilder as the startDate is embedded in the taskId.
In general, it would be great if we could structure the code in a way so that the job scheduling mechanism can be extended easily. What are your thoughts?
The text was updated successfully, but these errors were encountered:
We are planning to use Chronos at our organization but see some gaps in what we want and what is available in Chronos today. While the title of this issue is to address a feature we need immediately, I will list down all that we are looking for.
Our use-case requires us to run jobs on all dates that satisfies the schedule of
ScheduledJob
. In other words, we don't want to skip date just because it is in the past. This is because the dates are used to pull slices of data from systems onto Hadoop. In the current form of Chronos, we can't enable/configure this to be so. This would also require the startDate/newDate/intendedRunDate of a job to be available as metadata to jobs (env var?). We could start off by making the startDate available as an environment variable to jobs. This seems possible inMesosTaskBuilder
as the startDate is embedded in thetaskId
.In general, it would be great if we could structure the code in a way so that the job scheduling mechanism can be extended easily. What are your thoughts?
The text was updated successfully, but these errors were encountered: