12,210 skills found · Page 83 of 407
Orchestra-Research / grpo-rl-trainingExpert guidance for GRPO/RL fine-tuning with TRL for reasoning and task-specific model training
Orchestra-Research / lambda-labs-gpu-cloudReserved and on-demand GPU cloud instances for ML training and inference
Orchestra-Research / crewai-multi-agentMulti-agent orchestration framework for autonomous AI collaboration
Orchestra-Research / qdrant-vector-searchHigh-performance vector similarity search engine for RAG and semantic search
Orchestra-Research / audiocraft-audio-generationPyTorch library for audio generation including text-to-music (MusicGen) and text-to-sound (AudioGen)
Orchestra-Research / blip-2-vision-languageVision-language pre-training framework bridging frozen image encoders and LLMs
Orchestra-Research / evaluating-cosmos-policyEvaluates NVIDIA Cosmos Policy on LIBERO and RoboCasa simulation environments
Orchestra-Research / segment-anything-modelFoundation model for image segmentation with zero-shot transfer
Orchestra-Research / stable-diffusion-image-generationState-of-the-art text-to-image generation with Stable Diffusion models via HuggingFace Diffusers
Orchestra-Research / knowledge-distillationCompress large language models using knowledge distillation from teacher to student models
Orchestra-Research / long-contextExtend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques
Orchestra-Research / model-mergingMerge multiple fine-tuned models using mergekit to combine capabilities without retraining
Orchestra-Research / model-pruningReduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT
Orchestra-Research / moe-trainingTrain Mixture of Experts (MoE) models using DeepSpeed or HuggingFace
Orchestra-Research / speculative-decodingAccelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques
Orchestra-Research / ml-paper-writingWrite publication-ready ML/AI papers for NeurIPS, ICML, ICLR, ACL, AAAI, COLM
Orchestra-Research / ara-compilerCompiles any research input — PDF papers, GitHub repositories, experiment logs, code directories, or raw notes — into a complete Agent-Native Research Artifact (ARA) with cognitive layer (claims, concepts, heuristics), physical layer (configs, code stubs), exploration graph, and grounded evidence
Orchestra-Research / ara-rigor-reviewerPerforms ARA Seal Level 2 semantic epistemic review on Agent-Native Research Artifacts, scoring six dimensions (evidence relevance, falsifiability, scope calibration, argument coherence, exploration integrity, methodological rigor) and producing a constructive, severity-ranked report with a Strong A…
Orchestra-Research / distributed-llm-pretraining-torchtitanProvides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP)
Orchestra-Research / sentencepieceLanguage-independent tokenizer treating text as raw Unicode. Supports BPE and Unigram algorithms. Fast (50k sentences/sec), lightweight (6MB memory), deterministic vocabulary. Used by T5, ALBERT, XLNet, mBART. Train on raw text without pre-tokenization
Orchestra-Research / axolotlExpert guidance for fine-tuning LLMs with Axolotl - YAML configs, 100+ models, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, multimodal support
Orchestra-Research / miles-rl-trainingProvides guidance for enterprise-grade RL training using miles, a production-ready fork of slime
Orchestra-Research / simpo-trainingSimple Preference Optimization for LLM alignment. Reference-free alternative to DPO with better performance (+6.4 points on AlpacaEval 2.0). No reference model needed, more efficient than DPO. Use for preference alignment when want simpler, faster training than DPO/PPO.
Orchestra-Research / slime-rl-trainingProvides guidance for LLM post-training with RL using slime, a Megatron+SGLang framework
Orchestra-Research / torchforge-rl-trainingProvides guidance for PyTorch-native agentic RL using torchforge, Meta's library separating infra from algorithms
Orchestra-Research / verl-rl-trainingProvides guidance for training LLMs with reinforcement learning using verl (Volcano Engine RL)
Orchestra-Research / training-llms-megatronTrains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies
Orchestra-Research / skypilot-multi-cloud-orchestrationMulti-cloud orchestration for ML workloads with automatic cost optimization
Orchestra-Research / awq-quantizationActivation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss
Orchestra-Research / quantizing-models-bitsandbytesQuantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss