23 skills found
joe-siyuan-qiao / WeightStandardizationStandardizing weights to accelerate micro-batch training
Lightning-Universe / Stable Diffusion DeployLearn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.
spcl / UcudnnAccelerating DNN Convolutional Layers with Micro-batches
JaCraig / SQLHelperSQLHelper is a wrapper around DbConnection/DbCommand and a micro ORM. It automatically handles batching, data conversion, transactions, etc. for you. It's been around even longer than Dapper as part various libraries I've had over the years.
pump-fun-trading-bot / Pump Fun Bundler BotPump Fun Bundler Bot — the ultimate Solana bot for PUMP.FUN & Raydium. Automate token launches, trading, market-making, liquidity, sniping new tokens, SOL/WSOL wrapping, volume bots, and batch wallets. Full Master/Sub wallet control, low fees, secure private keys, dynamic token distribution, micro-trading.
wanggrun / Kalman NormalizationCode of "Batch Kalman Normalization: Towards Training Deep Neural Networks with Micro-Batches"
qubole / StreaminglensQubole Streaminglens tool for tuning Spark Structured Streaming Pipelines
bilalaziz786 / Analysis Of Political Sentiments On Twitter Using Deep LearningAim was to develop a machine learning model which can analyze sentiments on twitter and to predict the winner of Lok Sabha Elections 2019. Web scraping was used for comments and then applied feature extraction, TF-IDF, Word2Vec, ANN and LSTM to improve the accuracy of model. Softmax function was used for multiclass classification. Learning curve was used to select the epochs and batch size in ANN and LSTM. Word cloud was made to select the most important features in the dataset. Random forest classification was selected as the best classifier with the help of PR curve by using micro average for average precision and recall.
MarkPhamm / Local Streaming PipelineEnd-to-end real-time analytics pipeline with Kafka, Spark micro-batch/Spark Streaming/Flink, ClickHouse, and live dashboards.
naughtygopher / NibblerA light-weight package for in-app micro batch processing
Dev-Force / Node Kafka AlertsEasily deployable (Docker), extensible (clean architecture), template-based, plug and play micro-service. Real-time (Kafka) and batch processing (using a database) of messages which allows devs to send notifications using third party tools (like twilio/sendgrid). Uses concepts from Event-Sourcing and CQRS.
slopp / Dagster Kafka DemoMicro-batch processing of streams using Dagster and Kafka
barelyhuman / Conchmicro library for async sequential batches (Node/Browser/Deno) , for low memory systems
mamin11 / Batch Email SenderMicro-service spring batch application that can send large number of emails for e-commerce application. Consumes data from SQL database sends confirmation emails and updates the database record.
zehui-liu / Spark PuddingA micro framework for Apache Spark data integration and processing, which builds Apache Spark tasks through configuration files. Support Apache Spark streaming and batch integration.
audipasuatmadi / Go MicrobatchA Go library that allows you to slash your data into micro-batches, and perform operation on them once they are flushed.
rapidrabbit76 / FastAPI Deep Learning Model Micro Batching ServingFastAPI pytorch model serving with micro batching
Foraminarium / MicroCT Image Analysis With ImageJ FijiMicro X-ray Computed Tomography (microCT) image analysis provides information about micro-scale structures and properties critical to the biological and geoscientific fields. Recent advances in microCT have in part been driven by the availability of new 3D image processing techniques. These techniques, while developed for the biological/life sciences, have the potential to support other scientific fields given an appropriate application. For example, microCT analysis can provide information about the density and structure of the microfossil shells of foraminifera, which are commonly used in paleoceanography to reconstruct aspects of the ocean and climate. Information about the density and structure of foraminiferal shells is useful for characterizing changes in ocean acidification and in foraminiferal species classification and assemblage-based sea surface temperature studies. The macros presented here provide a user-friendly semi-automated workflow for applying imageJ/Fiji tools to extract microCT-derived information on many individuals scanned together in a batch. The example datasets provided are of a batch of individual foraminiferal shells. The batch is small (six individuals) for simplicity of the example, but the workflow is applicable for rapidly processing large batches (dozens to hundreds) of individuals.
seujung / WeightStandardization GluonStandardizing weights to accelerate micro-batch training with gluon
JaysonGCS / Micro BatcherInterval-based micro batching library for TypeScript/JavaScript
