Search open source projects
10 projects found for "pipelines"
Jenkins
MITWidely used open-source automation server with a large plugin ecosystem for building CI/CD pipelines and automating software delivery.
- DevOps
Beam
Apache-2.0Unified programming model for defining batch and stream data processing pipelines that can run portably across multiple execution engines.
- Analytics
Kubeflow
Apache-2.0Machine learning platform for Kubernetes that bundles pipelines, model training, hyperparameter tuning, and serving into one toolkit.
- AI & Machine Learning
Apache Kafka
Apache-2.0Distributed event streaming platform that stores data as a durable, replayable log, built for high-throughput real-time pipelines rather than traditional point-to-point queuing.
- Backend
Docling
MITDocument parsing library that converts PDFs, Word docs, and other formats into clean, structured data ready for LLM and RAG pipelines.
- AI & Machine Learning
Kestra
Apache-2.0Declarative, YAML-based orchestration platform for scheduling and orchestrating data pipelines, ETL jobs, and business workflows.
- Automation
Open Policy Agent (OPA)
Apache-2.0General-purpose, CNCF-graduated policy engine for enforcing authorization, compliance, and configuration rules as code across microservices, APIs, Kubernetes, and CI pipelines.
- DevOps
Prefect
Apache-2.0Python-native workflow orchestration platform for building, scheduling, and monitoring data pipelines with ordinary Python code.
- Automation
Tekton
Apache-2.0Kubernetes-native building blocks for creating CI/CD pipelines, giving teams a standard, portable way to define pipelines as Kubernetes resources.
- DevOps
Woodpecker CI
Apache-2.0Simple, container-native CI/CD engine extensible via plugins, designed to run pipelines with a lightweight server and agent footprint.
- DevOps