80 skills found · Page 1 of 3
FedML-AI / FedMLFEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
airbnb / ChrononChronon is a data platform for serving for AI/ML applications.
googleapis / Nodejs StorageNode.js client for Google Cloud Storage: unified object storage for developers and enterprises, from live data serving to data analytics/ML to data archiving.
mosecorg / MosecA high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
jjiantong / Awesome KV Cache Optimization[Survey] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
abhisheks008 / ML CrateML-Crate stands as the ultimate hub for a multitude of exciting ML projects, serving as the go-to resource haven for passionate and dedicated ML enthusiasts!🌟💫 Devfolio URL, https://devfolio.co/projects/mlcrate-98f9
helmut-hoffer-von-ankershoffen / JetsonHelmut Hoffer von Ankershoffen experimenting with arm64 based NVIDIA Jetson (Nano and AGX Xavier) edge devices running Kubernetes (K8s) for machine learning (ML) including Jupyter Notebooks, TensorFlow Training and TensorFlow Serving using CUDA for smart IoT.
cap-ntu / ML Model CIMLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
caraml-dev / MerlinKubernetes-friendly ML model management, deployment, and serving.
hiveml / Simple Ml ServingSimple step-by-step guide to deploying deep learning models to production.
autodeployai / AI ServingServing AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
seanZhang414 / OpenadserverOpen Source Ad Serving Platform with ML-Powered CTR Prediction | Self-hosted alternative to Google Ad Manager | Python, FastAPI, PyTorch
clearml / Clearml ServingClearML - Model-Serving Orchestration and Repository Solution
Photoroom / DatagoA natively parallel dataloader for Python, written in Rust. Serving data at GB/s speeds, while covering aspect ratio bucketing, crop and resize for image ML workloads.
hoangsonww / End To End Data Pipeline📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transformation, storage, monitoring, and AI/ML serving with CI/CD automation using Terraform & GitHub Actions.
jonathanreadshaw / ServingMLFastCeleryWorking example for serving a ML model using FastAPI and Celery
gurvindersingh / MlappML model serving app based on APIs
Paulescu / Incremental Ml Training And ServingIncremental ML learning in the real-world
MaartenGr / ML APIGuide on creating an API for serving your ML model
Azure / Azure Llm Fine TuningThis hands-on walks you through fine-tuning an open source LLM on Azure and serving the fine-tuned model on Azure. It is intended for Data Scientists and ML engineers who have experience with fine-tuning but are unfamiliar with Azure ML.
