- The new ML Commons plugin empowers users to train and apply machine learning models as a part of the OpenSearch 1.3.0 release.
OpenSearch and OpenSearch Dashboards 1.3.0 includes the following features, enhancements, bug fixes, infrastructure, documentation, maintenance, and refactoring updates.
OpenSearch Release Notes.
OpenSearch Dashboards Release Notes.
- Adding Model Type Validation to Validate API ("non-blocker") (#384)
- Non blocker (#202)
- Add anomaly localization implementation (#103)
- Refactor ML task data model; add create ML task index method (#116)
- Integration step 1 and 2 for anomaly localization (#113)
- Anomaly localization integration step 3 (#114)
- Support train ML model in either sync or async way (#124)
- Anomaly localization integration step 4 and 5 (#125)
- Add train and predict API (#126)
- Add ML Model get API (#117)
- Integrate tribuo anomaly detection based on libSVM (#96)
- Add ML Delete model API (#136)
- Add fixed in time rcf (#138)
- Add ML Model Search API (#140)
- Add circuit breaker (#142)
- Add batch RCF for non-time-series data (#145)
- Add ML Task GET/Delete API (#146)
- Add Search Task API and Refactor search actions and handlers (#149)
- Add minimum top contributor candidate queue size (#151)
- Add more stats: request/failure/model count on algo/action level (#159)
- Add tasks API in Client (#200)
- Feature latest observability (#509)
- Live tail - Event analytics (#494)
- Add Events Flyout and Correlate Traces with logs (#493)
- Merge Application Analytics into main (#454)
- Add .whitesource configuration file (#119)
- Add support for OPENSEARCH_JAVA_HOME (#133)
- Adding auto backport (#146)
- Implemented support for ClusterMetrics monitors. (#221)
- Implemented a toast to display successful attempts to acknowledge alerts. Refactored alerts dashboard flyout to refresh its alerts table when alerts are acknowledged. (#160)
- Refactored acknowledge alerts button on Alerts by trigger dashboard page to be a modal experience. (#167)
- Check one feature query at a time - Validate API (#412)
- Improve error handling on missing result index errors on detector detail pages (#158)
- Enhance Autofollow task to start replication jobs based on settings (#307)
- Adds default action retries (#212)
- Adds min rollover age as a transition condition (#215)
- Adds min primary shard size rollover condition to the ISM rollover action (#220)
- Not managing indices when matched certain pattern (#255)
- Show applied policy in explain API (#251)
- Add refresh button to rollup page (#132)
- Adds support for creating and displaying the transform continuous mode (#153)
- Adds support on UI for min primary shard size rollover condition and min rollover age transition condition (#159)
- Add Recall Tests (#251)
- Change serialization for knn vector from single array object to collection of floats (#253)
- Add ExtensiblePlugin to KNNPlugin (#264)
- Add gradle task for running integ tests in remote cluster (#266)
- Change benchmark ingest took metric to total time (#268)
- Make doc and query count configurable in benchmark (#270)
- Support float type in data frame (#129)
- Support short and long type in data frame (#131)
- Use threadpool in execute task runner (#156)
- Do not return model and task id in response (#171)
- More strict check on input parameters by applying non-coerce mode (#173)
- Move anomaly localization to the last position to avoid BWC issue (#189)
- Disable duplicate visualization and enable edit panel (#554)
- Allow app creation with one composition (#557)
- Add ability to choose visualization for availability (#552)
- Added common visualization parser (#550)
- Converting datetime to utc from picker (#551)
- Feature/remove timestamp saving (#546)
- Feature convert browser time to utc time (#542)
- Replace viz icon (#543)
- Add availability metrics to app table (#539)
- Add autocomplete to panels, add parse command to app analytics (#529)
- Changes panel requests & date, traces link in events (#533)
- Include related services node under service filter (#527)
- Change availability level to have expression (#525)
- Feature/sort only datatable in flyout (#522)
- Add service map to services and trace view page (#518)
- Edit visualization in Application Analytics (#519)
- Add parse command back in autocompletion (#517)
- Add autocomplete enhancements (#507)
- Make base query immutable (#500)
- Redirect to trace tab, updateMappings once, etc (#481)
- Finish autocomplete logic for after where (#480)
- UI changes to Metrics Tab (#476)
- Add date_nanos to valid time fields (#426)
- Separate default filters and extra filters (#474)
- Saving time for individual applications (#473)
- Support lazy scroll and auto complete for PPL parse command (#421)
- Add observability visualization to notebooks (#351)
- Adds CI support for Java 8, 11 and 14 (#1580)
- Updates the test retry-count to give flaky tests more chances to pass (#1601)
- Adds support for OPENSEARCH_JAVA_HOME (#1603)
- Adds auto delete workflow for backport branches (#1604)
- Create the plugin-descriptor programmatically (#1623)
- Add test to make sure exception causes aren't sent to callers (#1639)
- Switch gradle to info logging for improved test debugging (#1646)
- Remove artifact step from CI workflow (#1645)
- Adds ssl script (#1530)
- Adds Java-17 to CI matrix (#1609)
- Reverts ssl script PR (#1637)
- Remove java17 from 1.3 build matrix (#1668)
- Add auto backport functionality to security plugin (#887)
- Adds auto delete workflow for backport branches (#901)
- Configure ML plugin actions (#912)
- Support ISO 8601 Format in Date Format. (#460)
- Add Certificate Validation option (#449)
- Span expression should always be first in by list if exist (#437)
- Support multiple indices in PPL and SQL (#408)
- Support combination of group field and span in stats command (#417)
- Support In clause in SQL and PPL (#420)
- Add cast function to PPL (#433)
- [Enhancement] optimize sort rewrite logic (#434)
- Fix running Alerting security tests in GitHub Actions. (#252)
- Bugfix: Stregthen validation checks for status API (#317)
- Fix UT coverage on codecov (#40)
- Successful deletes of an index still adds history document (#160)
- Porting missing bugfixes (#232)
- ISM Template Migration (#237)
- Fixes flaky tests (#211)
- Fixes flaky rollup/transform explain IT (#247)
- Avoids restricted index warning check in blocked index pattern test (#263)
- Porting missing logic (#240)
- Fixes flaky continuous transforms test (#276)
- Porting additional missing logic (#275)
- Fixes test failures with security enabled (#292)
- Enforces extension action parsers have custom flag (#306)
- Fixes default state not updating when changing state name (#145)
- Changes the default policy of the visual editor to be an empty one (#149)
- Set default space type to L2 to support bwc (#267)
- [BUG FIX] Add space type default and ef search parameter in warmup (#276)
- [FLAKY TEST] Fix codec test causing CI to fail (#277)
- [BUG FIX] Fix knn index shard to get bwc engine paths (#309)
- Use latest version of tribuo to fix modify thread group permission issue (#112)
- Fix jarhell error from SQL build (#137)
- Fix EpochMilli parse error in MLTask (#147)
- Fix permission when accessing ML system indices (#148)
- Fix system index permission issue in train/predict runner (#150)
- Cleanup task cache once task done (#152)
- Fix update task semaphore; don't return task id for sync request (#153)
- Restore context after accessing system index to check user permission on non-system index (#154)
- Fix verbose error message thrown by invalid enum (#167)
- Fix no permission to create model/task index bug;add security IT for train/predict API (#177)
- Fix for datepicker issue (#571)
- Show saved time range when editing saved visualization (#570)
- Issue/query click (#569)
- Fix fields not showing up in panels autocomplete (#566)
- Pass in prop curSelectedTabId for live tail (#567)
- Added fix for threshold (#568)
- Fix interval selector issue, revert interval function changes (#563)
- Remove bold letter and extra pranthesis (#559)
- Issue horizontal bar (#556)
- Final live tail fixes (#558)
- Fix page flicker for live tail (#541)
- Fix multiple flyouts issue in explorer (#538)
- Flyout bugs (#540)
- Detete request and response changes for event and panels (#530)
- Issue/darkmode support viz config (#521)
- Visualizations do not follow set timerange (#516)
- Fix empty userConfigs stringify (#513)
- Fix lower margin of autocomplete being cut off (#512)
- Fix issue of clicking query caused crash (#515)
- Feature viz saving on missing fields (#511)
- Fix events flyout bugs and Styling (#510)
- Bump prismjs from 1.25.0 to 1.27.0 in /dashboards-observability (#508)
- Revert query pre-processing for parse command (#497)
- Fix create/edit page bug (#475)
- Fix queries being filtered out (#472)
- Guava package update (#404)
- CVE fix:json-schema, gson & glob-parent (#368)
- Fix and lock link checker at lycheeverse/lychee-action (#113)
- Upgrade plugin to 1.3.0 and log4j to 2.17.1 (#118)
- Don't run opensearch-cli in a child process (#126)
- Modify grpc-netty-shaded to grpc-netty (#129)
- Fixes grpc channel leak issue and vertex buffer issue on non active master (#130)
- Fixes RCA crash on active master (#132)
- Bumps JJWT version (#1589)
- Updates backport workflow with custom branch and github app (#1597)
- Always run checks on PRs (#1615)
- Adds 'opens' command-line argument for java.io libraries to unblock build (#1616)
- Adds jacoco report and pass the location to codecov (#1617)
- Fixes the settings of roles_separator (#1618)
- Use standard opensearch.version property (#1622)
- Updates rule def for @osd/eslint/require-license-header (#905)
- Updates backport workflow with custom branch and github app (#900)
- Fix certificate validation for ODBC driver (#479)
- Update dependency opensearch-ml-client group name (#477)
- Treating ExpressionEvaluationException as client Error. (#459)
- Version Bump: H2 1.x -> 2.x (#444)
- Version Bump: springframework and jackson (#443)
- Bug Fix, disable html escape when formatting response (#412)
- Jackson-databind bump to 2.12.6 (#410)
- Parse none type field as null instead of throw exception (#406)
- Remove node version declaration in package.json (#166)
- ADD auto backport functionality to AD (#368)
- Use admin client for system index updates in integ tests (#372)
- Fixing Flaky Integration Tests (#369)
- Adding auto delete workflow for backport branches (#376)
- Using Github App to trigger CI on backport PRs (#375)
- Add JDK 11 to CI test matrix (#395)
- Fixing failing IT for validate API (#402)
- Add remote integ test workflow; clean up old integ test workflow (#163)
- Reformat using Prettier CLI and add doc to developer guide (#168)
- Remove Beta label from bug issue template (#169)
- Add .whitesource and config files to activate whitesource integration (#165)
- Using Github App to trigger CI on backport PRs (#175)
- Adding auto delete workflow for backport branches (#176)
- Remove cypress & all integration tests (#174)
- Upgrade follow-redirect dependency (#179)
- Add test IDs to components for integ tests (#183)
- Added backwards compatibility tests for async search(#95)
- Updates common-utils version to 1.3 (#99)
- Update build.sh script to include optional platform param. (#95)
- Update copyright notice and add DCO check workflow. (#94)
- [CI] Default CI Java Version to Java 11, run tests on 8, 11 and 17 (#329)
- Remove jcenter repo from gradle build (#278)
- Ws package update (#283)
- Guava package update (#282)
- Add auto-backport functionality for reporting (#286)
- Add java 8 support in compile and test (#304)
- Remove incorrect tag form issue template (#294)
- Replace Centos links to fix link checker CI (#297)
- Add support for codeowners to repo (#195)
- Adds test and build workflow for mac and windows (#210)
- Adding debug log to log the user object for all user callable transport actions (#166)
- Added ISM policy backwards compatibility test (#181)
- Add backport and auto delete workflow (#283)
- Updates integTest gradle scripts to run via remote cluster independently (#291)
- Adds developer certificate of origin check workflow (#129)
- Fixes retry failed managed index cypress test (#125)
- Run CI on JDK 8, 11, and 14. (130)
- Auto increment version after release. (115)
- Update build.gradle to include job-scheduler jar in staging maven publications (117)
- Using Github App token to trigger CI for version increment PRs (126)
- Remove jcenter repo from build related gradle files (#261)
- Add write permissions to backport action (#262)
- Add JDK 11 to CI and docs (#271)
- [Benchmark] Remove ingest results collection (#272)
- Update backport workflow to include custom branch name (#273)
- Add CI to run every night (#278)
- Use Github App to trigger CI on backport PRs (#288)
- Add auto delete workflow for backport branches (#289)
- Updates Guava versions to address CVE (#292)
- [CODE STYLE] Switch checkstyle to spotless (#297)
- Switch main to 2.0.0-SNAPSHOT, update to Gradle 7.3.3 (#301)
- Run CI on JDK 8 (#302)
- Update numpy version to 1.22.1 (#305)
- Add git ignore file (#92)
- Change common utils to 1.2 snapshot;add more test (#94)
- Remove jcenter dependency (#121)
- Add integration test for train and predict API (#157)
- Fix build/CI and add backport workflow (#161)
- Publish ml client to maven (#165)
- Add integ tests for model APIs (#166)
- Add security IT (#168)
- Fix maven group (#170)
- Add more UT for ml-algorithms (#182)
- Add java 8 to CI workflow (#194)
- Add more UT and IT for rest actions (#192)
- Add more UT to client module (#203)
- Add more UT for task manager/runner (#206)
- Create config and workflow files for release note (#209)
- Use 1.3.0 docker to run CI (#212)
- Change to support java 8 in compile and runtime (#575)
- Update cypress test (#564)
- Fixed flaky panel test (#565)
- Feature flyout tests (#553)
- Add cypress tests for application analytics (#544)
- Update panels cypress (#545)
- Update cypress for trace analytics traces view (#536)
- Cypress fix for panels and events (#531)
- Updated panels flaky jest tests (#505)
- Change Default CI java version to 11 (#504)
- Update backport and add auto-delete workflows (#496)
- Add auto backporting functionality (#491)
- [main] jcenter removed from gradle.build (#374)
- Configure WhiteSource for GitHub.com (#365)
- Disable flaky test in JdbcTestIT. (#475)
- Added 1.3 release notes. (#336)
- Updated DEVELOPER_GUIDE.md to reference changes to the supported JDKs. (#338)
- Reformat using Prettier CLI and add doc to developer guide (#168)
- Add roadmap badge in README (#295)
- Add backport documentation link (#161)
- Add release notes for 1.3.0.0 (#143)
- Add support for codeowners to repo (#91)
- Add how to develop new function doc to readme (#95)
- Update license header (#134)
- Sync PPL commands doc with main repo (#549)
- Fixed documentation links (#534)
- Add parse command docs (#535)
- Updating readme and badges (#352)
- Modify license headers (#153)
- Improves developer guide (#889)
- Adds back removed portion of developer guide (#893)
- Updates maintainers list (#902)
- Add parse docs to PPL commands index (#486)
- Add limitation section in PPL docs (#456)
- Add how to setup aws credentials for ODBC Tableau (#394)
- Bumps to version 1.3. (#248)
- Update GitHub Actions to run on all branches. (#256)
- Added support for JDK 8 and 14. (#335)
- Bumping version to 1.3. (#159)
- Adding CODEOWNERS file (#150)
- Configure WhiteSource for GitHub.com (#153)
- Adding basic unit tests (#151)
- Updated copyright notices and headers. (#168)
- Adding a few more basic unit tests (#180)
- Add backport workflow (#176)
- Bump plugin to 1.3.0.0 (#160)
- Removed jcenter(#94)
- Bump gantt chart for 1.3 release (#51)
- Updating license headers (#196)
- Configure WhiteSource for GitHub.com (#244)
- Upgrades detekt version to 1.17.1 (#252)
- Changes integ test java version from 14 to 11 (#284)
- Add support for codeowners to repo (#131)
- Fixes copyright header (#150)
- Updating license headers (#130)
- Create backport workflow (#148)
- Bump version to 1.3 (#106)
- Bumps cron-utils version (111)
- Update copyright notices (87)
- Add support for codeowners to repo (100)
- Fixes copyright header (127)
- Bump main to 1.3 (#361)
- Upgrade docker to 1.3 (#114)
- Upgrade plugin to 1.3.0 and log4j to 2.17.1 (#118)
- Removing deprecated InitialBootClassLoaderMetaspaceSize JVM command line flag (#124)
- Upgrade guava, protobuf version (#127)
- Update jacksonVersion to 2.12.6 (#129)
- Upgrade netty and bouncycastle versions (#130)
- Remove jcenter (#136)
- Update grpc licenses (#139)
- Updates bug template (#1582)
- Updates jackson-databind library version (#1584)
- Upgrades Kafka version (#1598)
- Upgrades Guava version (#1594)
- Update maintainers list (#1607)
- Exclude velocity 1.7 from OpenSAML dependency (#1606)
- Migrate build system to gradle (#1592)
- Updates documentation for practices for maintainers (#1611)
- Remove jcenter repository (#1625)
- Remove '-SNAPSHOT' from opensearch.version in plugin descriptor (#1634)
- Add git ignore for VScode IDE settings (#1629)
- Remove netty-tcnative dependency to unblock security plugin build on ARM64 (#1649)
- Add plugin-descriptor.properties to .gitignore (#1651)
- Removes Github DCO action as it is replaced by Github app (1657)
- Configure ML reserved roles and system indices (#1662)
- Release Notes for 1.3.0.0 (#1671)
- Bumps version to 1.3.0.0 (#884)
- Adds support for codeowners to repo (#883)
- Adds .whitesource and configs file to activate whitesource integration (#885)
- Uses 1.x branch of Dashboards for unit tests (#890)
- Makes PR template easier to fill in (#888)
- Adds release notes for 1.3.0.0 (#918)
- Updates release notes for 1.3.0.0 (#920)
- Add JDK 8 to CI Matrix (#483)
- Add CI Matrix for JDK 11 and 14 (#451)
- Update backport and add auto-delete workflows (#446)
- Add auto backport functionality for SQL (#445)
- Version bump to 1.3 (#419)
- Revert to windows 2019 for odbc CI (#413)
- Refactor benchmark dataset format and add big ann benchmark format (#265)
- Merge develop branch into main branch (#87)
- Refactor API input/output/URL; add execute API for non-model based algorithm (#93)
- Cleanup code and refactor (#106)
- Support registering ML objects; refactor ML engine interface (#108)
- Refactor persisting ML model (#109)
- Refactor transport APIs;fix class cast exception (#127)
- Add ML custom exceptions (#133)
- Rename tribuo AD algorithm name (#144)