96 skills found · Page 1 of 4
zhaoyachao / Zdh Web大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台，包含数据采集,调度,权限,审批流,私域营销等模块
duoan / Mega Data Factory🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models
coursera / DataductDataPipeline for humans.
ErdemOzgen / Data Engineering RoadmapRoadmap for Data Engineering
jamesdensmore / DatapipelinesbookNo description available
LiberCoders / CLI GymOfficial Implementation of "CLI-Gym: Scalable CLI Task Generation via Agentic Environment Inversion"
josephmachado / Beginner De Project StreamSimple stream processing pipeline
ContextData / VectorETLBuild super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications
Smars-Bin-Hu / Azure Cloud Datapipeline EDAA cloud-native data pipeline and visualization project analyzing Formula 1 racing data using Azure, Databricks, Delta Lake, Tableau, and Python for insightful EDA and interactive dashboards.
Stability-AI / DatapipelinesIterable datapipelines for pytorch training.
kartik4949 / TensorPipeHigh Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.
LuQQiu / DataPipelineReal time stock data pipeline --play with Kafka, Cassandra, Spark, Redis, Node.js, Zookeeper
josephmachado / De ProjectStep by step instructions to create a production-ready data pipeline
vim89 / Datapipelines Essentials PythonSimplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Alireza-Akhavan / Tf2 TutorialTensorflow 2 Tutorials (use tensorflow and keras in a better way!)
cloudposse / Terraform Aws Efs BackupTerraform module designed to easily backup EFS filesystems to S3 using DataPipeline
KennethanCeyer / Awesome Data PipelineAwesome list for datapipeline
guimou / DatapipelinesVarious demos of data pipelines
covalenthq / Bsp GethEthereum client written in Go, modified for full-hierarchy data exports and block specimen production
indix / SparkplugSpark package to "plug" holes in data using SQL based rules ⚡️ 🔌
