Do you schedule jobs in your pipeline? Which tools do you use?

Scheduling jobs in a pipeline means orchestrating the execution order, timing, and dependencies of tasks that transform data or build software. I typically use Airflow for data pipelines because it provides a DAG-based model, rich scheduling options (cron, intervals, event-based triggers), and built-in monitoring. For CI/CD pipelines, I rely on Jenkins or GitHub Actions, which allow declarative pipelines, parallel stages, and integration with container registries. I also use cron jobs for simple, lightweight tasks that don’t need a full orchestrator. The key is to define clear dependencies, use retries and alerts, and keep the pipeline idempotent so that re-running a job doesn’t corrupt data or state.