1.4.8

What's Changed

• NA: Update fern auto generated code by @thiagohora in #1180
• [OPIK-902] share config building logic by @awkoy in #1168
• OPIK-917: Fix DatasetItemPage error: java.lang.IllegalArgumentException: duplicate element: NUMBER by @thiagohora in #1178
• [OPIK-855] Add type to prompt version by @BorisTkachenko in #1179
• [OPIK-855] Autogenerated code for prompt type by @BorisTkachenko in #1182
• OPIK-918 Experiment configuration comparison is showing the wrong data in some cases by @andriidudar in #1183

Full Changelog: 1.4.7...1.4.8

1.4.7

What's Changed

• [OPIK-862] Allow users to diff prompt commits by @andriidudar in #1161
• [OPIK-811] Cost tracking for vertex ai by @BorisTkachenko in #1159
• modified regex example to fix invalid escape strings warning by @17jmumford in #1164
• [OPIK-897] Provide more informative error message for 400 unable to process json by @BorisTkachenko in #1165
• [OPIK-902] put ApiKey and workspace name to add experiment dialog by @awkoy in #1167
• OPIK-895: Improving queries in the critical path by @thiagohora in #1162
• [OPIK-813] Styling improvements to traces empty states by @andriidudar in #1170
• OPIK-894: Add load test scripts by @andrescrz in #1172
• [NA] Make evaluate functions work stably when event loops are used inside by @alexkuzmik in #1171
• [OPIK-686] [SDK] [FR]: Add Support for Bedrock Invoke_Agent API by @japdubengsub in #1166
• [OPIK-905] [FE] Split find project endpoint into two endpoints: find and stats by @andriidudar in #1175
• OPIK-904: Split find project endpoint into two endpoints find and stats by @thiagohora in #1176

Full Changelog: 1.4.6...1.4.7

1.4.6

What's Changed

• [OPIK-678] Add support for change_description field in the prompt commit by @andriidudar in #1126
• Fix Opik misconfiguration in the helm chart by @liyaka in #1127
• [OPIK-864] Reduce page size from 200 to 100 in search_spans/search_traces by @alexkuzmik in #1130
• [OPIK-820] [UX improvements] Add automatic redirection to 'Datasets'and 'Prompt library item pages by @andriidudar in #1129
• [OPIK-625] [FE] Add average values for duration, usage, and total cost estimation in project list table by @andriidudar in #1131
• [OPIK-766] run code snippet button by @awkoy in #1088
• [OPIK-757] Add support for comments part2 by @BorisTkachenko in #1121
• OPIK-796: Fix issue with LLM setup and stream shutdown by @thiagohora in #1108
• [OPIK-744] deduplicate openai models by @idoberko2 in #1073
• Updated changelog by @jverre in #1140
• Jacques/changelog 26 01 by @jverre in #1141
• Bump com.mysql:mysql-connector-j from 9.1.0 to 9.2.0 in /apps/opik-backend by @dependabot in #1143
• [OPIK-762] create an experiment dialog improvements by @awkoy in #1136
• [OPIK-861] Allow spans to be added to datasets by @andriidudar in #1145
• [OPIK-844] Add support for span comments by @BorisTkachenko in #1137
• [OPIK-844] Autogenerated code for comments by @BorisTkachenko in #1146
• [OPIK-872] Unify Create and Edit prompt modals. by @andriidudar in #1149
• [OPIK-887] Change flattening delimiter from "|" to "." in experiment configuration by @andriidudar in #1150
• Update README.md by @gidim in #1153
• Update README.md by @jverre in #1154
• OPIK-865: Implement stream-based span search endpoint by @thiagohora in #1133
• OPIK-833: Add support to multiple prompts links for experiments by @thiagohora in #1144
• Resolve Typing Issues on Wrapping OpenAI Client by @17jmumford in #1156
• [FR] Relax httpx dependency restriction by @alexkuzmik in #1157
• OPIK-841 Integration E2E tests refactoring by @AndreiCautisanu in #1117
• [OPIK-760] quickstart page to side dialog by @awkoy in #1147
• [OPIK-766] enable run button by @awkoy in #1158

New Contributors

• @17jmumford made their first contribution in #1156

Full Changelog: 1.4.5...1.4.6

1.4.5

What's Changed

• OPIK-859: Reduce find spans query cost by @thiagohora in #1123
• [OPIK-860] Add text to Open trace button on experiment sidebars by @andriidudar in #1125
• [OPIK-700] [FE] Rule modal validation by @andriidudar in #1120
• [NA] Add truncate method to the search_spans and search_traces by @alexkuzmik in #1124
• Amorgan/small typo fixes by @anmorgan24 in #1118

Full Changelog: 1.4.4...1.4.5

1.4.4

What's Changed

• [OPIK-759] implement side dialog component and log a trace dialog by @awkoy in #1111
• [OPIK-680] [FR]: Cost Tracking for VertexAI and LangChain by @japdubengsub in #1055
• [NA] Relax litellm version and make litellm monitoring optional by @alexkuzmik in #1122

Full Changelog: 1.4.3...1.4.4

1.4.3

What's Changed

• OPIK-795: Create rule logs table by @thiagohora in #1060
• OPIK-665: Add Python code executor PoC Docker sandbox by @andrescrz in #1058
• Update Ragas notebook by @jverre in #1074
• Bump org.redisson:redisson from 3.42.0 to 3.43.0 in /apps/opik-backend by @dependabot in #1076
• Bump software.amazon.awssdk:bom from 2.29.9 to 2.30.2 in /apps/opik-backend by @dependabot in #1077
• [OPIK-744] fix providers' models list by @idoberko2 in #1041
• Add guidelines for local run by @liyaka in #983
• Add smaller code snippets for the quickstart page by @Lothiraldan in #1064
• [OPIK-656]: log experiments in the playground; by @aadereiko in #1072
• [OPIK-656]: improvements of experiment playground log pr's code; by @aadereiko in #1078
• [OPIK-656]: fix the bug when there is no dataset and avoid logging an experiment; by @aadereiko in #1080
• OPIK-663: Add Python Backend image builder by @andrescrz in #1082
• NA: Upgrade OpenTelemetry agent by @thiagohora in #1084
• OPIK-796: Implement ClickHouse user facing logs by @thiagohora in #1066
• Update pytest_integration.md by @SrBliss in #1087
• [OPIK-763] Updating Online Scoring into a distributed service using redis. by @ldaugusto in #1083
• NO-OPIK fix locator for next page buttons by @AndreiCautisanu in #1085
• OPIK-663: Add Sandbox Executor Python app by @andrescrz in #1090
• [DEV-2536] add python-backend service to helm chart by @liyaka in #1089
• Update template.py by @jverre in #1096
• [OPIK-839] [FE] Remove not leaves nodes(subtrees) from the autocomplete component in the rules popup by @andriidudar in #1099
• [OPIK-711]: playground Anthropic integration by @aadereiko in #1098
• [OPIK-706] remove close get-started section button by @awkoy in #1100
• [Opik-703] Add guardrails integration docs by @alexkuzmik in #1086
• Liya/dev 2536 fix python be service configuration by @liyaka in #1101
• Update evaluate_prompt.md by @anmorgan24 in #1104
• OPIK-663: Pull instead of building Sandbox Python Executor image by @andrescrz in #1102
• [OPIK-757] New endpoints for Comments by @BorisTkachenko in #1081
• [NA] fix gemini streaming by @idoberko2 in #1106
• OPIK-663: Add Python Backend to Docker compose by @andrescrz in #1110
• [OPIK-785] custom scroll hover for PC by @awkoy in #1113
• Improve demo project script (flush + batching) by @ferc in #1112
• OPIK-796: Add new automation rule evaluator logs endpoint by @thiagohora in #1115
• [OPIK-838] Add proper support for litellm completion kwargs by @alexkuzmik in #1114
• [OPIK-798] [FE] Add a button which opens a new tab to show all retrieved logs for a particular online scoring rule by @andriidudar in #1116
• [OPIK-750] sdk add the possibility to manually sets the cost of individual spans by @alexkuzmik in #1107
• Add minimal litellm version to setup.py by @alexkuzmik in #1119

New Contributors

• @SrBliss made their first contribution in #1087

Full Changelog: 1.4.2...1.4.3

1.4.2

What's new

• Update base version to 1.4.2 0c59576 @CometActions
• [OPIK-753] [FE] Autocomplete component for variable key select (#1067) 5268758 @andriidudar
• Implemented BLEU score, wrote unit tests and documentation for it. (#1006) e835dfd @kadamrahul18
• [OPIK-770] Fix haystack integration (#1070) 79501b1 @alexkuzmik
• Disable printing messages content (#1071) abffddd @alexkuzmik

New contributors

Special thanks to @kadamrahul18, our new external contributor, for implementing SentenceBLEU and CorpusBLEU metrics for our metrics library!

1.4.1

• Increment patch version (#1059) 720a0c3 @ferc
• [OPIK-781] Fix project not found illegal state (#1053) 395f686 @BorisTkachenko
• Jacques/fix code snippets (#1061) 6f0fed4 @jverre
• OPIK-802: add an option to use external clickhouse (#1065) 07cf99a @liyaka
• Contribution guide (#1062) 17b6cb6 @alexkuzmik
• [OPIK-706] simplify home page (#1063) fd48d17 @awkoy
• Temporary disable litellm import warnings (#1068) 40dc733 @alexkuzmik
• [OPIK-809] sdk sentry track decorator extract inputs may fail (#1069) 133b8a6 @alexkuzmik

1.4.0

• [OPIK-799] Can't add trace to dataset (#1056) 13d4327 @andriidudar
• Increment minor version (#1057) 42a6b30 @ferc

1.3.6

What's Changed

• [OPIK-611] support gemini models in playground by @idoberko2 in #987
• Updated changelog by @jverre in #1036
• [OPIK-702] [Docs] Crew AI integration docs by @japdubengsub in #1037
• [OPIK-743] Fix properties naming strategy by @thiagohora in #1035
• [OPIK-595]: Add Redis Caching part 1 by @thiagohora in #1015
• Update g_eval.md by @jverre in #1039
• Jacques/evaluate prompt by @jverre in #1023
• [OPIK-594] Triggering LLM calls to score after Traces are received by @ldaugusto in #1038
• [OPIK-698] [FE] Rules tab in project by @andriidudar in #1046
• OPIK-775 [FE] Add ability to edit dataset description from UI by @andriidudar in #1049
• Update docs by @jverre in #1048
• [OPIK-595] Automation rule evaluator cache by @thiagohora in #1042
• [OPIK-695] sdk sentry integration by @alexkuzmik in #1045
• [OPIK-718] quickstart page integrations update by @awkoy in #1034
• [OPIK-698] [FE] Rules tab in project by @andriidudar in #1051
• [OPIK-721] Return more detailed error message for Json deserialization errors by @BorisTkachenko in #1040
• [NA] Add misconfiguration check to Opik.init by @alexkuzmik in #1052
• [OPIK-751] Use Mustache for online scoring by @thiagohora in #1043

Full Changelog: 1.3.5...1.3.6