#

taskflow

Here are 4 public repositories matching this topic...

ZSAIm / VideoCrawlerEngine

起源于旧项目爱奇艺解析器(iqiyi-parser)在开发、维护和扩展的过程中遇到的一些问题，而实现的一个基于任务流式的可视化爬虫引擎。引擎的执行单元是节点。脚本节点(script)作为根节点来完成对节点和流程的描述，经由任务节点(task)解析流程描述并生成节点的执行队列，最后交由工作者执行池处理。整个过程可视可控，所有节点处理器都以插件的形式导入，以最大程度实现易扩展性。

python taskflow

Updated Dec 14, 2022
Python

GuinsooLab / sheenflow

A next-generation open source orchestration platform for the development, production, and observation of data assets.

infrastructure workflow airflow schedule pipeline workflow-engine orchestration-framework scheduled-tasks orchestration workflows dag observability taskflow data-ops orchestration-engine guinsoolab

Updated Mar 2, 2023
Python

117503445 / tasksflow

Handling Complex Workflows with Tasks

python library pypi taskflow

Updated May 6, 2024
Python

vojay-dev / airflow-dynamic-task-mapping

This project showcases how to use Dynamic Task Mapping in Apache Airflow

python airflow orchestration data-engineering apache-airflow taskflow duckdb taskflow-api dynamic-task-mapping modern-airflow

Updated Nov 22, 2024
Python

Improve this page

Add a description, image, and links to the taskflow topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the taskflow topic, visit your repo's landing page and select "manage topics."