I have used Dagster for multiple complex projects now. One common mistake I see a lot of vibe coders making is they keep AI in the loop, (often they don't even realise that AI is still in the loop). Dagster is one tool that can help automate recurring pipelines, such as:
- Recurring jobs that need to run, like pulling market data.
- Running recurring jobs like back testing
Anything you can programatically remove from Ai but converting to a pipeline. Think about cron jobs, but then think about creating a series of workflows that can string together.