Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[BUG] PPL and SQL queries produces seemingly incorrect results #3287

Closed
hbrodin opened this issue Dec 20, 2024 · 3 comments
Closed

[BUG] PPL and SQL queries produces seemingly incorrect results #3287

hbrodin opened this issue Dec 20, 2024 · 3 comments
Labels
bug Something isn't working untriaged

Comments

@hbrodin
Copy link

hbrodin commented Dec 20, 2024

Describe the bug
When filtering the results for a specific manufacturer in either PPL or SQL-mode it seems like results not having that manufacturer is returned

To Reproduce

Steps to reproduce the behavior:

  1. Login anonymous in the future playground.
  2. Select the OTEL demo environment.
  3. Select Discover from the menu on the left hand side
  4. In the data source selection dropdown, select opensearch*ecomm*
  5. Using PPL query mode, set the time filter to absolute mode starting at Oct 20, 2024 @ 00:00:00.00 and ending at Oct 20, 2024 @23:00:00.00 then run source = opensearch*ecomm* | where manufacturer = "Oceanavigations",
  6. Notice how not every manufacturer-field has the value Oceanavigations, some have e.g. Low Tide Media.

Expected behavior
When using the specific filter one would expect result to have the manufacturer field set to Oceanavigations.

OpenSearch Version

2.18

Dashboards Version

2.18

Plugins

Alerting, anomaly-detection, asynchronous-search, cross-cluster-replication, custom-codecs, flow-framework, geospatial, index-management, job-scheduler, knn, ml, neural-search, notifications, notifications-core, observability, performance-analyzer, reports-scheduler, security, security-analytics, skills, sql, system-templates, query-insights

Screenshots

N/A

Host/Environment:

  • OS: macOS
  • Browser and version Google Chrome, version 131.0.6778.205

Additional context
Running the equivalent SQL-query SELECT * from opensearch*ecomm* where manufacturer = "Oceanavigations" shows a similar result where not every manufacturer-field is set to Oceanavigations.
However, running the DQL query manufacturer: Oceanavigations, it can be seen that several documents have multiple manufacturers e.g. manufacturer: Oceanavigations, Low Tide Media.
Peeking in the developer console it can be seen that the results are represented very differently if the query mode is DQL or PPL/SQL. It appears as if PPL/SQL-representations can only handle a single value, whereas DQL can handle an array.

@hbrodin hbrodin added bug Something isn't working untriaged labels Dec 20, 2024
@krisfreedain
Copy link
Member

Catch All Triage - 1, 2, 3

@kavilla
Copy link
Member

kavilla commented Jan 30, 2025

@opensearch-project/admin please transfer this to @opensearch-project/sql to see if this is an issue or not.

@peterzhuamazon peterzhuamazon transferred this issue from opensearch-project/OpenSearch-Dashboards Jan 31, 2025
@joshuali925
Copy link
Member

should be supported by #3095 in 2.19

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
bug Something isn't working untriaged
Projects
None yet
Development

No branches or pull requests

4 participants