UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)

Easy hyperparameter optimization and automatic result saving across machine learning algorithms and libraries

Open-source Python library for statistical analysis of randomised control trials (A/B tests)

GenAIOps with Prompt Flow is a "GenAIOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.

Deep-Learning Model Exploration and Development for NLP

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

moai is a PyTorch-based AI Model Development Kit (MDK) created to improve data-driven model workflows, design and reproducibility.

Open Source version of SigOpt API, performing hyperparameter optimization and visualization

A playground to make it easy to try crazy things

Implementation of metaheuristic optimization methods in Python for scientific, industrial, and educational scenarios. Experiments can be executed in parallel or in a distributed fashion. Experimental results can be evaluated in various ways, including diagrams, tables, and export to Excel.

↕️ Intuitive axiomatic retrieval experimentation.

Experiments conducted for NaNoGenMo 2014

Python’s delightfully modular experiment tracker for MLOps

Implement GenAIOps using Azure AI Foundry with ease and jumpstart

This is a machine learning framework that enables developers to iterate fast over different ML architecture designs.

This python project is a helper package that uses power analysis to calculate required sample size for any experiment

Tool for the automatic orchestration of experiments targeting software systems

A declarative, parameter-parsing library that provides multiple parsing interfaces (YAML, command line, and JSON)

Experimental Linear Algebra Performance Studies