Releases: open-mmlab/mmeval
Releases · open-mmlab/mmeval
MMEval V0.2.1 Release
Features
- Add jax support to accuracy by @fengsxy in #61
- Add jax support to MeanIoU by @xuan07472 in #67
- Add bleu metric and its test file by @go-with-me000 in #66
- Add SAD by @xuan07472 in #76
- Add GradientError by @xuan07472 in #78
- Add MattingMSE by @xuan07472 in #71
- Add ConnectivityError by @xuan07472 in #79
- Add DOTAMeanAP metric by @YanxingLiu in #65
- Add ROUGE to mmeval by @go-with-me000 in #72
- Add KeypointEndPointError by @LareinaM in #92
- Add perplexity metric by @go-with-me000 in #87
- Add KeypointAUC metric by @LareinaM in #91
- Add KeypointNME by @LareinaM in #93
- Support NIQE by @Z-Fran in #80
- Add WordAccuracy for OCR Task by @Harold-lkk in #94
- Add CharRecallPrecision for OCR Task by @Harold-lkk in #96
- Add logger argument in BaseMetric by @C1rN09 in #102
Enhancements
- Update the test case style of PCKAccuracy by @ice-tong in #68
- Rename metrics by @ice-tong in #83
- Make scipy as a runtime dependency by @C1rN09 in #109
- Refactor single and multi label metrics by @yingfhu in #81
- Refactor detection dataset metainfo to lowercase and update detection metric logics by @BIGWangYuDong in #98
Bug fixes
- Fix CI failed caused by OneFlow installation and new version of NumPy by @ice-tong in #73
- Fix import error in python3.6 by @ytzhao in #77
- Upgrade the version of isort to fix lint error by @zhouzaida in #85
- Use official isort by @zhouzaida in #86
- Fix psnr,snr,ssim,mae and mse fail to compute on videos by @Z-Fran in #89
- CircleCI fail due to plum-dispatch v2.0.0 by @C1rN09 in #108
- Fix format by @zhouzaida in #111
- Add opencv to docs dependency & setup.py to resolve API docs error by @C1rN09 in #113
Others
New Contributors
- @fengsxy made their first contribution in #61
- @xuan07472 made their first contribution in #67
- @go-with-me000 made their first contribution in #66
- @ytzhao made their first contribution in #77
- @YanxingLiu made their first contribution in #65
- @C1rN09 made their first contribution in #101
- @LareinaM made their first contribution in #92
- @Harold-lkk made their first contribution in #94
Full Changelog: v0.2.0...v0.2.1
MMEval V0.2.0 Release
Since MMEval v0.2.0, we support evaluation with OneFlow!
Features
Documentations
- Add mmeval into PYTHONPATH for API doc generation(#45)
- Update qq group link (#56)
- Add OneFlow support (#62)
Contributors
A total of 4 developers contributed to this release.
@vansin @ofhwei @zhouzaida @ice-tong
New Contributors
Full Changelog: v0.1.0...v0.2.0
MMEval V0.1.0 Release
We are excited to introduce our new open-source library: MMEval, a unified and open cross-ML framework evaluation library.
Install MMEval via pip:
pip install mmeval
MMEval is a machine learning evaluation library that supports efficient and accurate distributed evaluation on a variety of machine learning frameworks. Major features:
- Comprehensive metrics for various computer vision tasks (NLP will be covered soon!)
- Efficient and accurate distributed evaluation, backed by multiple distributed communication backends
- Support multiple machine learning frameworks via dynamic input dispatching mechanism