Uptrain

<h4 align="center"> <a href="https://uptrain.ai"> <img alt="Logo of UpTrain - an open-source platform to evaluate and improve LLM applications" src="https://github.com/uptrain-ai/uptrain/assets/108270398/b6a4905f-63fd-47ab-a894-1026a6669c86"/> </a> </h4> <p align="center"> <a href="https://demo.uptrain.ai/evals_demo/"> <img alt="Try out Evaluation" src="https://img.shields.io/badge/Try%20Evaluations-uptrain?logo=data%3Aimage%2Fpng%3Bbase64%2CiVBORw0KGgoAAAANSUhEUgAAAGQAAABkCAYAAABw4pVUAAAACXBIWXMAAAsTAAALEwEAmpwYAAAEl0lEQVR4nO2dS8gWVQCGPzMvZVmWXRZ2VwuxolpIq8BMzDAqyChLQnBjpC76iVbZQvorSgqjsILoBgWFQQbhohICVwVJEbgwMu1C%2FaaRpWZPHP4jfQ1zZuab%2Bc6ZMzPvA7M792eu5za9nhBCCCGEEEIIIYQQHQOYBFwDrAYe7six2tZ5Ui8WgMuBV4BDdJdDwMvA3DpFTAGeAI7V3RoRYdpiFJgcWsaZwKd11z5iPgbOCCVjKrCj7ho3gE%2FMXSSEkGfrrmmDeNq3jKuB4wXuo7uAPQUK%2FAPwOfAX7eQ4cKVPIW%2FnFOALYHZf%2BMXAmEPaqr5wM4FttJO3fMmYnnMmH%2BuX0RdvVUrYpxzp%2F0j7%2BNPUzYeQhTkZ73LEM2d%2FkhtKXoFNZaEPISM5me5xxLskJewtjrDbaCcjPoRsKpDx4pR4j6eE25oSbi5wmHayyYeQzQUyHrPPjJn2yjAy%2FnaEfR2YZz6ggFsLvpU1lc11CRHpSEhkSEhkSEhkSEhkSEiXhZhxkUU6WJQxRhRUyDtDz6yhmLaQkIiQkMiQkMiQkMiQkMiQkMiQkAAA5wArgPuAs3PC6rXXJ8BNwC993xYHgOszwkuIL4AldoJCkq8z4khIYBknmNFYIcAE4KpAfV3XAhNzynOxnUFzXkkZB1zLD6IXAlwKfElYdgPzHSfGi8A%2FNtyR5GyQAjIMj2TUN3ohn1EP3wAnJcpyvyPshgFkPG%2FENlKIY4JcSK4o2FiGN6vKaIKQ02pezHNBojxbKqSVKyN6ITbOq9TDBylluQ446ktGU4ScCjwH%2FEoYDtr1jqmrl4C7MybuVZLRCCExAtxZ8Fa6ZRAZNm0J8SRlYBk2XQnxIKWUDJumhFQBWAp8b0X8YTcDmFAhPQmpiv2CnzWM3RgkJDIkJDIkJADAMtu1Yp4Py3LC6hniE7tvSZIHMsJLiC%2BAJzOW7aWOuUhIeBknOMsRT1fIINge6DXAM8A9wMklZOx2fas0QghwEfBgoB3e1gNzMraU%2BipR9u3AtAFkmN7iGzPqGrcQu9eJ%2BQIOyRFgeUpZNmTsbTWtoIzbctooXiFmCBX4lnoYA05JlOe9jPB7q8pogpDzqZf5ifJsLJlOIRlNEDLZDhjVwdHkmxBwLvBdiXRuH6CN4hVi4zxEPYw6ymP2U9nnQ0YjhNh4dwDv2jca38dWYGXOVJ0iUgaW0RghMQLM6RsHGYoMm66ElMVxpZSWYdOUkCqY%2Bb3AS3a66%2FtmbnDF9CQkJiQkMiQkMiSk40LMnxDS%2BHDomTUU0xaDfKhWzWxdRsdc6blMbYHx6USuD861PjK8GTdLex2H8ckQLpb4%2Bk3F744MTafdrF5HYXyi3d6Mv%2B%2F4%2BW0F8EbGWWAu1%2BVpw6It%2F%2B%2FWXcD%2BjHZ5zXcfUN6il9%2BAnYE6E7fXeOwsMLxgRi8v8yYkY66SSGejVxlWyESzZMxRAPEfH%2BWtmR%2BmlOkt%2FpPBMDAn7OlBZCSulMcKLCfuEoeBR5Nr5EOLuRB4AfiZ7vKTXSD6v6XYtWKvmAXAvfbnL6MtP0ZsXRcEe1YIIYQQQgghhBBCCNGLh38BZfHpULZhNcAAAAAASUVORK5CYII%3D&labelColor=CC766E&color=6A6A6A"> </a> <a href="https://docs.uptrain.ai/getting-started/quickstart"> <img alt="Read Docs" src="https://img.shields.io/badge/Read%20Docs-uptrain?logo=data%3Aimage%2Fpng%3Bbase64%2CiVBORw0KGgoAAAANSUhEUgAAAGQAAABkCAYAAABw4pVUAAAACXBIWXMAAAsTAAALEwEAmpwYAAAC%2FklEQVR4nO3dO2sUURiH8SPipVAhKngJWggKolZ%2BAEGQIFiaL2CICNoLBmJAsBAbKxEREcTAYq%2BFYKGx8orxFkmhEltNY6P4yIEjs5FlJ4k7s%2B975v%2BD6ZJhD0%2FenZnsMhOCiIiIiIhIQwFbgFHgCjAJtPq83QF2hqYBNgNXgZ%2FYMwvsCE0B7E2LtuwjMBga8hb1CR9mso8C3MWXGWB7yBFwAPiNP2%2FjZIfcABfw6z2wLeQEuIdv74CtIRfA85IFv%2BnDdceTJUZ5FU%2FZQw6A6ZLFTvThNQ2zdC%2BBTcG7jIJEL9xHySzI3ygbg1cZBiEdF31GyTRI9AwYCN5kHIR0trYheJJ5kGgKWB%2B8aECQ6HHfogBHgJvpX%2BlPF%2FHzTQgSnat7EYPAAxaaXsTvNSXIRJ0L2APMdXgRClJ3kHgWAXygMwXpQ5Bu%2Fz73GmQAOLjEbbbv6wBWA99zC7IcJtaRzqi6UZCag5ymOwWpOcg43SlIzUEm6E5BCgrSxIO6JiRRkIXfBz5b8TYSSihIAuyjej6OhRbeslAQBelEE5JoQtroLaugCUk0IW00IQVNSALsip%2FdV7y1QgkFMUZBjFEQYxTEGAVJdNrbRqe9BU1IoglpowkpaEISTUgbTUhBE5JoQtpoQgqakIXfvh%2BueBsKJRTEGAUxRkGMURBjFMQYBTFGQYzJKcjrkn20arjO6MX2uWQd416CPKQZTnkJco1mOOwlyDHy9w1Y5SXIykUcR7w7X3mMXgVJ%2Bzlk9IkIvboD9jpXQdK%2BRoBf5OULsLvaChUFSfsbcvSUhDL3a78Nea%2BDpH2uBU6mW5DPOZqaH%2Bn5IjdqOaOqK4j8BwUxRkGMURBjFMQYBTFGQYxREGPi3ZpLrkPmDTw2tbWM7UzwCDhBni4Fj4D95Ol48Co9RS0n864eL%2FGv%2BNdEXsaCd8B18jAFrAnexUWkB9F79iibh0NGwApgFPiKv2PGWLyPfchRmpajwEXgloFrilaH7TZwOX3BrZ7Pu0VERERERIJ9fwBA%2FZMtFhwT0AAAAABJRU5ErkJggg%3D%3D&labelColor=976DA5&color=6A6A6A"> </a> </a> <a href="https://join.slack.com/t/uptraincommunity/shared_invite/zt-1yih3aojn-CEoR_gAh6PDSknhFmuaJeg"> <img alt="Slack Community" src="https://img.shields.io/badge/Slack%20Community-uptrain?logo=data%3Aimage%2Fpng%3Bbase64%2CiVBORw0KGgoAAAANSUhEUgAAAGQAAABkCAYAAABw4pVUAAAACXBIWXMAAAsTAAALEwEAmpwYAAADFklEQVR4nO2cPW4TURSFLaWBhg6xACs9YhEsISiLiIzoUkGNRIV3kDSxhJVVBArKrCBUSCnCTyTc8KGRphomjsfv3vGBdz7JpY%2Bu5iQz9v3kN5kYY4wxxhhjjDHG%2FAXwGDgGPgJfgRXwBfgAHAJ7u8yrCuAI%2BM56LoFnu8irCuA9m3MLPB8zryrav%2BSh3AD7Y%2BRVRXuP%2F8Z2nGfnVUf7wC1hmplXHcBF4QWcZeZVB3BdeAHnmXnVAfwqvIBnnbzfkXnVAVwVXsBFJ4%2FIvOoAli5EiHZ94f8QFZpdUru%2B8C1LBeAp8NPPECGaXVK7vhiKH%2BqJpew36wtciBbAFHjZbmwX97xedd5bSt0fe6PBhWiBC9GC2gvpcdbRrIY48OxCpB39hs46mst1DjyzEGlHP9BZR3N7lwPPKkTa0W%2FprKO56XPgGYVIO%2FpCZx3NeXYh8o4%2BwFlHM00uRNvRBzjraGbJhWg7%2BgBnHc08uRBtRx%2FgwKM56czXfC8o4TTY0Z%2BoO%2FBo3gbP180LnU%2FRgUdzEDxfNy90PkUHHskP4FHgfH15ofMpOvBIXgfP15cXOp%2BiA4%2FiM%2FAwcL7evIz51Bx4BJ%2BAJ4Hz3ZmXNZ%2BSAy%2B9J78BHgTNd29e5nwqDnzo6xR4B7zY9gHZmW9Q3hjzGWNMrWzh1Ed11og5f0WnPpqzRtD5Kzr1UZw1os5f0amnO2uEnb%2BiU0911og7%2F4xCjpWdNeLOP6OQC2VnjbjzzyjkWtlZI%2B78FZ16tLM%2BC54vGnmnHu2sF8HzRSPv1A%2BSC1mihbRTj3bWfYVIO%2F%2BMQpScdV8h0s4%2FqxQFZ73um7%2B0888qZZfOepPdmLTzT2EHznro9lja%2BadR6KzTf6SJuPOXYoxCzABciBgu5D8vhH%2FJgSuyg0K6%2BOx3sUIafPa7WCENPvtdrJAGn%2F1OOYvgW2D1Z7%2BrFTKb1IxgIfNJzST8rnwl7cDVSXD0V5F51ZHg6JeRedWR4OgPI%2FOqI8HR70XmVUmko8%2FIq5IoR5%2BVVyURjj4zr1oocPRj5BljjDHGGGOMMcYYY8xElT9jEHRBpJyhuQAAAABJRU5ErkJggg%3D%3D&labelColor=6565d8&color=6A6A6A"> </a> <a href="https://github.com/uptrain-ai/uptrain/issues/new?assignees=&labels=enhancement&template=feature_request.md&title="> <img alt="Request New Feature" src="https://img.shields.io/badge/Request%20New%20Feature-uptrain?logo=data%3Aimage%2Fpng%3Bbase64%2CiVBORw0KGgoAAAANSUhEUgAAAGQAAABkCAYAAABw4pVUAAAACXBIWXMAAAsTAAALEwEAmpwYAAAG%2BElEQVR4nO2da6gWRRjHN1NLKy1Tu2B5CjEsMiO0wEiqoxhmZQUJ5YfyQ5FhdLEiIiItLQtRIswiMIvKNDOTCosyCzsVGWiXLykVdrESQz1aXn7xcObAsmdmdvc9715md37wftAzszuz%2F3eemX3mmecNAo%2FH4%2FF4PKUF6AmMBxYDG4E1wLii21VXEZYAf9KV%2F4BLim5n3UWIsqboNlcO0osQ5sui218J6J4IYRYX3RdnAY4ELgYWAr%2FRHFqL7pdTkI0IncjI6ll0H%2BsuQpjn8ujIWGAacA9wf0GfmcCwBuaEVnlI3ZwTOtkNvAq8YCkzPishzlQ3%2FoviaAdWADcAxxQswrVAH3UP%2BXc%2B5kp16EngX%2BotwmvAdZ0ihO7VR%2F1dx5Jmi3EC8AHFsAd4ADi%2BbCJE7isjJXtzBfQCPqIYfgHOSTif5S5CpA35mCu1%2BiiCfcDIHEXYk1aE3M0VMAI4GNORA8BmYFuCTsuy8mtgf4KyszXt6VGECMD54hgE%2Bhr%2BLvVzMVfSWBubwktOYAKw0yDaLaFyA4G1luseAk6KtGU48B05jgRgMPBpqK58CS5N8ZyaZ67UMNxr6dgB3fpfHrym7HxNuX7A74Zrf6MpL%2BLnZo7kCwF8a3jIfYswV5NiOrnZUE%2B%2B%2FVG0mzPA64Zrr46UG0K%2Bc4KIscVy7XFFmKs7Yzq8zVDvDE3ZSYayaw3XXh8pd6IyY0mR0TsbGNRAv%2BPEEM7L1VypGz2RoOMTNPXmasq9pSk3XL3s6djZwHymQxYPS4HRTRTjk4Tmqrm%2BK%2BCZBB3eqeaMgWpkzLWsypYBZwP9gasSrMouirTnWLVH3ainoE353Y6yTOBxYsjfB%2BdurlIIkiXvWL7F4lT8qcHr%2FgHMA4ZGxJClu43vgVMSzoGZ%2BK6KFkS4LcaDIH6tDTTGAeUbm5xwZESX4X1zM1clEuQgMD1BW0cBz1vmpO7QRYwE5qq1qoJ08n6SuCZgADAL2EqGYuS6uiqpIJ38oJbjVvd7yMUiAWqHaYwuc0ZCc5VNIENJBenkH%2BXPGpGgH8PUJK5z6aQWQ13zekvdy5suRowg69W3rwyfy0wOP01%2FjgNmJPSHTY65lslc7cgskMEiyPLAYYAjlJirLOZshaV%2BvqurqgsSRoliWt0NLY25qpEgrZaHO8dQJ7%2BXwboJIlje0GU%2BODooenVVQ0FmWEbJtFKYK9cFoSPyZApwl0QlJlh9yTJaR1vhqyvXBaHDrHweafOimDqLLN%2F8MYWuriogyEOGdo%2B11DnLsgRemtZ3JRExWXTMVUHeNrT77ph64i8zbXINSmOu5IU1i465KshCQ7uviaknbngTc9Qefay5Uhtp87PomKuCnK7xW22Mm3SVQ3KrZe8kqbmaKs8ui445KYgAnKZGymrgwRShP%2FeSDp25WlkbQejYar1dPeRRGVx%2FQEwsWhJz1V4LQejYFZT98LC%2F6dYM7mM7dJPEXFEXQT7UtGVvUvd7SuEbNVcr6iTILkN7Rmdwrw3dMFe1EaTNkK5icAb3kmiWtOYqXMddQYALgPtkPpAgOku5KzXLT62LvAltkhCj7Q2aK3cFoeOo2qHIiakWS%2FkLVbiPnFaa2qx2GO71cIPmyk1BZEcOfdjpsqAEACdbwlZt5spZQaYYrr8lKAkqlrhL%2B6LOw4i5claQkYbrd4mULwqJ%2F1LmsdOsfhU9pKSOSrQ7L4hhf7pdzvMFJUO9wZuC5h7RPCNnBemltlDfBJ6VMyOBQ6gV4r7KCOI6lj2S8gmiDnVKYpjHgKslQC2oGMByJwRRXtkfI%2FVerJooOCSI6XyiNQLENVwS5F1D3TuCCoFDgixIemrXZVwSZIjyS4WR%2FQw%2FhxS4yhJf0KPAS2KqgN5BxcCVEVIX8IKUCy9IyfCClIzSC6I2nU4NagJlFUQlnvkissRtevBB2SizIJ9pyq0MKg5lFEQ5Ek1h%2FJV793BBkH6GbG9y2qhHUGEooyCq7Bu5NKpklFmQ%2FipIeZdK0r8gbeJJFymtIKE6lXIelk2Qp9IKUjcw7%2FvMy%2BJmEubpBbEfgfvV8IxmBs0GuMIL0lDkpTAxaDZqotbFHNXeZAEtlt%2Br2h3NkdJMUXS%2FiVFbQYDewI2Ro3VRXsmyAedqItS1gqjELBI49rJpyKqFwjpHP22WnCjhA0TZRl8CT8cJYlgA3KwpV9Qv9eRF8xMGGIap5Fk0uU56G%2FLlbq%2BZIOty%2B%2BFIlcLoY3XjVZpD%2BjoOaxKA6bzCVeA923G8LHNQPS4nVDVJJXXn8TZprvEz1WK%2FyoPS%2FOw%2FaXKJaP5vYiQ5y9%2BaXzdo6UZS47KxQ%2BUN1ibKLFPSFzlJO92QK32MSmjs6mcWcJM6eFrciPB4PB6Px%2BPxeDwej8fj8XiCYvgfmdGLzXmrOA4AAAAASUVORK5CYII%3D&labelColor=5B92E9&color=6A6A6A"> </a> <a href="https://demo.uptrain.ai/benchmark"> <img alt="Daily Monitoring" src="https://img.shields.io/badge/Daily%20Monitoring-uptrain?logo=data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAGQAAABkCAYAAABw4pVUAAAACXBIWXMAAAsTAAALEwEAmpwYAAAFUUlEQVR4nO2daahVVRTHt2WDls3RQDYXRUZBkRkRjdAraPjSAJUUKVSE0QuiQZ4FmRj2lMwwqGgitZTq5cvEIipKpGgymogwCrKs7IOkDf5i9ZYorzvsM+99zvrB/XjWXfv+z9ln7zXs65xhGIZhGIZhGIZRCsD2wOXAIuA94P2MH7HxLHBBOSOoEcBewJsUx/PATlWPMxqAQYpnXtXjjALgDMrhb+CwqscbPMAMymNy1eMNHuDxEgXpq3q8wQP0lSjIPVWPN3iAY4HNJkhAAHNMkIAAdgBml/Ck2JSVBOAo4HbgYWD+sM9KEyQQZP8ArDVBAgDYDfjUpqwAAEYCy+0dEgjAPHupBwJwq62yAgHo0WCgLXurBjgOWG/7kAAA9gfW2MYwAIDRwKoUYkiq9pdG7NQZSq3eD3wCrANWAwuBOyRXDRyU0/dsB7yQQoxvgf2AH2svCHCO50BFqBXALGAicCKwY8Lvmp5CjN+BcXp9fQXRu3VqxlXOn8DHwFNAL3AusG+b7xMRkyK+9Wxj42vP625zMQHsAyyjOH4AXtW07RXAZcCmFHZuHub3y57XxVMSBEwAviN85rbw/SKP62T1NtLFADBFp5nQWdbuRwWe6HDdRqlucZFEUqWILAZWi79d3n13tdhUfgSMd6EDnAB8RRys9a2pAnbRWq+Lt6zCgge4BthAHPwBnObqCLCzpkNjYTNwlasjwNG6N8jCr/opi2mujuh8+lvGH2cVcKjaO1A3e1N08/dZAeFyaUsY4eqEhDC0vCbrtDFLSnU8XqbjpX5Wq0be0fBGGt6V6dXVCWCsRkKzsB64NIMPI4DDxYZMP8AS4Jsu9VeDnZa3UQKcD/ycUYwPgSML3P+cDtykT5NMT/3Aea5O6B0phWb/ZBRD3gujqx5P1Ghg8LUc1vzXVz2W6AGO0GRNFr4AjneRA+ypwcZrgbOS5mby6l6VeE0WJAs4xsVfVDddA4nb8n2WhUkaRy7JIMSm4bmFWAGe6TBOWdVdGXpvxZoooqAeABd6jFciDHu4ogEeTSGGrPX3djWBoWWzDxNDK7mU8MbdkjtwNQL/GN2MMpw5RJer3ZDKjLNdDQG+9BRkdlkO3dLFkbckIOhqCqEJok5NalHBt0HTmnEk9+skiDq2q1YUTtaA3u6uARCqIE0FEyQsTJDAaIwgDFWWS/X7B5pYegO4ofSAXRcaIYiWlq5rM7CVIe30ay+I5lZ+6jK4V1wgNEEQ3yOTTnEB0ARB3vYc4J0uAJogyOcxDZAGCCLpXB/muAAwQbZigtTpCWGobUCqIhcAD0pRQko7NmVlEUSDoFLF2IqBpEFREyS7IC/SmUETpKQpCzjT03ZP9FOWtglcJ/sDzYmMDVCQfk/b86MVRBse723R8y2dtQ8kzRgWLMgiT9uDMQvSn9fdVoIgSzxtL49SEKnH9ax2PzWBTRMkLcB9ed/NJkgGgOc8BVmawKY9IWkBFnsKsiKBTRMkLSaIC+6lbk8IJsgWbNlrT8j/sSdkK/aEtLg7JJeQdyhCTiH1YWaB/g4U4G8p/SEzPZ15JIFN3zMMbyzwb/IeSmDzpWD+Nk9CIp7OeJ+SAFztYe8v4IAU/p7s6a/3kXzS0Olhb2O7k1FzR09e6MRAkpN1tNX69S